You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/03/08 05:22:23 UTC
[JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.8.0-fcs-b132) - Build
# 9713 - Failure!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/9713/
Java: 64bit/jdk1.8.0-fcs-b132 -XX:+UseCompressedOops -XX:+UseSerialGC
1 tests failed.
REGRESSION: org.apache.solr.cloud.CustomCollectionTest.testDistribSearch
Error Message:
createcollection the collection time out:180s
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: createcollection the collection time out:180s
at __randomizedtesting.SeedInfo.seed([563EEE761CE7E21C:D7D8606E6BB88220]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:497)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:199)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1606)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1570)
at org.apache.solr.cloud.CustomCollectionTest.testCustomCollectionsAPI(CustomCollectionTest.java:184)
at org.apache.solr.cloud.CustomCollectionTest.doTest(CustomCollectionTest.java:127)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:870)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:744)
Build Log:
[...truncated 10283 lines...]
[junit4] Suite: org.apache.solr.cloud.CustomCollectionTest
[junit4] 2> 99580 T441 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (true)
[junit4] 2> 99581 T441 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /z_/ok
[junit4] 2> 99584 T441 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-CustomCollectionTest-1394251330650
[junit4] 2> 99585 T441 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 99586 T442 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 99686 T441 oasc.ZkTestServer.run start zk server on port:48366
[junit4] 2> 99687 T441 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 99751 T448 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@18f69253 name:ZooKeeperConnection Watcher:127.0.0.1:48366 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 99752 T441 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 99752 T441 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 99757 T441 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 99759 T450 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5934d682 name:ZooKeeperConnection Watcher:127.0.0.1:48366/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 99759 T441 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 99760 T441 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 99762 T441 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 99765 T441 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 99767 T441 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 99769 T441 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 99770 T441 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 99774 T441 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 99775 T441 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 99778 T441 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 99778 T441 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 99781 T441 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 99782 T441 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 99785 T441 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 99786 T441 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 99788 T441 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 99788 T441 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 99791 T441 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 99791 T441 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 99793 T441 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 99793 T441 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 99795 T441 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 99796 T441 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 99802 T441 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 99802 T441 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 99805 T441 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 99806 T441 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 100114 T441 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 100167 T441 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:60491
[junit4] 2> 100168 T441 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 100168 T441 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 100168 T441 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CustomCollectionTest-controljetty-1394251330873
[junit4] 2> 100169 T441 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CustomCollectionTest-controljetty-1394251330873/'
[junit4] 2> 100184 T441 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CustomCollectionTest-controljetty-1394251330873/solr.xml
[junit4] 2> 100194 T441 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CustomCollectionTest-controljetty-1394251330873
[junit4] 2> 100195 T441 oasc.CoreContainer.<init> New CoreContainer 2103453372
[junit4] 2> 100195 T441 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CustomCollectionTest-controljetty-1394251330873/]
[junit4] 2> 100196 T441 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 100196 T441 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 100197 T441 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 100197 T441 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 100197 T441 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 100198 T441 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 100198 T441 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 100198 T441 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 100199 T441 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 100202 T441 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 100202 T441 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 100202 T441 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 100203 T441 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:48366/solr
[junit4] 2> 100203 T441 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 100235 T441 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 100236 T461 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@45ba473e name:ZooKeeperConnection Watcher:127.0.0.1:48366 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 100237 T441 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 100255 T441 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 100259 T463 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@206e12ae name:ZooKeeperConnection Watcher:127.0.0.1:48366/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 100259 T441 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 100261 T441 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 100265 T441 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 100274 T441 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 100276 T441 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60491_z_%2Fok
[junit4] 2> 100277 T441 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:60491_z_%2Fok
[junit4] 2> 100280 T441 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 100283 T441 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 100287 T441 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:60491_z_%2Fok
[junit4] 2> 100288 T441 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 100295 T441 oasc.Overseer.start Overseer (id=91373655205740547-127.0.0.1:60491_z_%2Fok-n_0000000000) starting
[junit4] 2> 100298 T441 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 100304 T464 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 100306 T465 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 100307 T441 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 100308 T465 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
[junit4] 2> 100311 T441 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 100313 T441 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 100316 T441 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CustomCollectionTest-controljetty-1394251330873
[junit4] 2> 100326 T441 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CustomCollectionTest-controljetty-1394251330873/conf/
[junit4] 2> 100482 T441 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 100483 T441 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4] 2> 100483 T441 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 100484 T441 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 100486 T468 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@196fbdd9 name:ZooKeeperConnection Watcher:127.0.0.1:48366/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 100486 T441 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 100488 T441 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 100490 T441 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 100780 T441 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 100781 T441 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 100783 T441 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:60471
[junit4] 2> 100785 T441 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 100785 T441 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 100785 T441 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CustomCollectionTest-jetty1-1394251331555
[junit4] 2> 100786 T441 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CustomCollectionTest-jetty1-1394251331555/'
[junit4] 2> 100800 T441 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CustomCollectionTest-jetty1-1394251331555/solr.xml
[junit4] 2> 100809 T441 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CustomCollectionTest-jetty1-1394251331555
[junit4] 2> 100809 T441 oasc.CoreContainer.<init> New CoreContainer 1307770414
[junit4] 2> 100810 T441 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CustomCollectionTest-jetty1-1394251331555/]
[junit4] 2> 100810 T441 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 100810 T441 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 100811 T441 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 100811 T441 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 100811 T441 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 100812 T441 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 100812 T441 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 100812 T441 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 100813 T441 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 100816 T441 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 100816 T441 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 100816 T441 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 100817 T441 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:48366/solr
[junit4] 2> 100817 T441 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 100818 T441 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 100820 T479 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2245ebf7 name:ZooKeeperConnection Watcher:127.0.0.1:48366 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 100820 T441 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 100824 T441 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 100826 T481 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@79c5219a name:ZooKeeperConnection Watcher:127.0.0.1:48366/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 100827 T441 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 100833 T441 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 101836 T441 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60471_z_%2Fok
[junit4] 2> 101837 T441 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:60471_z_%2Fok
[junit4] 2> 101840 T463 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 101840 T481 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 101840 T468 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 101843 T441 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CustomCollectionTest-jetty1-1394251331555
[junit4] 2> 101849 T441 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CustomCollectionTest-jetty1-1394251331555/conf/
[junit4] 2> 101946 T441 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 101946 T441 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4] 2> 101946 T441 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 102163 T441 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 102164 T441 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 102165 T441 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:39417
[junit4] 2> 102167 T441 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 102167 T441 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 102167 T441 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CustomCollectionTest-jetty2-1394251333012
[junit4] 2> 102168 T441 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CustomCollectionTest-jetty2-1394251333012/'
[junit4] 2> 102180 T441 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CustomCollectionTest-jetty2-1394251333012/solr.xml
[junit4] 2> 102188 T441 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CustomCollectionTest-jetty2-1394251333012
[junit4] 2> 102188 T441 oasc.CoreContainer.<init> New CoreContainer 1879162351
[junit4] 2> 102189 T441 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CustomCollectionTest-jetty2-1394251333012/]
[junit4] 2> 102189 T441 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 102189 T441 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 102189 T441 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 102190 T441 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 102190 T441 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 102190 T441 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 102190 T441 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 102190 T441 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 102191 T441 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 102192 T441 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 102193 T441 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 102193 T441 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 102193 T441 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:48366/solr
[junit4] 2> 102193 T441 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 102194 T441 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 102196 T493 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7faf3b38 name:ZooKeeperConnection Watcher:127.0.0.1:48366 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 102197 T441 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 102200 T441 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 102201 T495 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@48ac4d80 name:ZooKeeperConnection Watcher:127.0.0.1:48366/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 102202 T441 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 102206 T441 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 103209 T441 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39417_z_%2Fok
[junit4] 2> 103210 T441 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:39417_z_%2Fok
[junit4] 2> 103213 T463 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 103214 T468 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 103214 T481 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 103214 T495 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 103218 T441 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CustomCollectionTest-jetty2-1394251333012
[junit4] 2> 103224 T441 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CustomCollectionTest-jetty2-1394251333012/conf/
[junit4] 2> 103334 T441 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 103334 T441 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4] 2> 103335 T441 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 103537 T441 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 103537 T441 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 103539 T441 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:58902
[junit4] 2> 103540 T441 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 103541 T441 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 103541 T441 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.CustomCollectionTest-jetty3-1394251334400
[junit4] 2> 103541 T441 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.CustomCollectionTest-jetty3-1394251334400/'
[junit4] 2> 103550 T441 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CustomCollectionTest-jetty3-1394251334400/solr.xml
[junit4] 2> 103559 T441 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CustomCollectionTest-jetty3-1394251334400
[junit4] 2> 103560 T441 oasc.CoreContainer.<init> New CoreContainer 652932422
[junit4] 2> 103560 T441 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.CustomCollectionTest-jetty3-1394251334400/]
[junit4] 2> 103561 T441 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 103561 T441 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 103561 T441 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 103562 T441 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 103562 T441 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 103562 T441 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 103563 T441 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 103563 T441 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 103563 T441 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 103566 T441 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 103567 T441 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 103567 T441 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 103567 T441 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:48366/solr
[junit4] 2> 103568 T441 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 103569 T441 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 103573 T507 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@50f18377 name:ZooKeeperConnection Watcher:127.0.0.1:48366 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 103573 T441 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 103580 T441 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 103583 T509 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@60563abb name:ZooKeeperConnection Watcher:127.0.0.1:48366/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 103583 T441 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 103595 T441 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 104599 T441 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58902_z_%2Fok
[junit4] 2> 104600 T441 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:58902_z_%2Fok
[junit4] 2> 104603 T495 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 104603 T468 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 104603 T481 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 104604 T509 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 104604 T463 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 104608 T441 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CustomCollectionTest-jetty3-1394251334400
[junit4] 2> 104617 T441 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CustomCollectionTest-jetty3-1394251334400/conf/
[junit4] 2> 104753 T441 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 104753 T441 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4] 2> 104754 T441 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 104953 T441 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 4
[junit4] 2> 104954 T441 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 104956 T441 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:54289
[junit4] 2> 104956 T441 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 104957 T441 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 104957 T441 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CustomCollectionTest-jetty4-1394251335819
[junit4] 2> 104958 T441 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CustomCollectionTest-jetty4-1394251335819/'
[junit4] 2> 104967 T441 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CustomCollectionTest-jetty4-1394251335819/solr.xml
[junit4] 2> 104974 T441 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CustomCollectionTest-jetty4-1394251335819
[junit4] 2> 104974 T441 oasc.CoreContainer.<init> New CoreContainer 1333954069
[junit4] 2> 104974 T441 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CustomCollectionTest-jetty4-1394251335819/]
[junit4] 2> 104975 T441 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 104975 T441 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 104975 T441 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 104975 T441 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 104976 T441 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 104976 T441 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 104976 T441 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 104976 T441 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 104976 T441 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 104978 T441 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 104979 T441 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 104979 T441 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 104979 T441 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:48366/solr
[junit4] 2> 104979 T441 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 104983 T441 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 104985 T521 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@365679c name:ZooKeeperConnection Watcher:127.0.0.1:48366 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 104986 T441 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 104991 T441 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 104993 T523 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@54a4bb67 name:ZooKeeperConnection Watcher:127.0.0.1:48366/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 104993 T441 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 104997 T441 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 105999 T441 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54289_z_%2Fok
[junit4] 2> 106000 T441 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:54289_z_%2Fok
[junit4] 2> 106003 T495 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 106003 T463 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 106004 T481 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 106004 T523 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 106004 T509 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 106004 T468 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 106007 T441 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CustomCollectionTest-jetty4-1394251335819
[junit4] 2> 106018 T441 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CustomCollectionTest-jetty4-1394251335819/conf/
[junit4] 2> 106198 T441 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 106199 T441 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4] 2> 106199 T441 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 106200 T441 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 106204 T526 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6857f4fe name:ZooKeeperConnection Watcher:127.0.0.1:48366/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 106206 T441 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 106208 T441 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 106211 T441 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 106221 T528 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@333e65cf name:ZooKeeperConnection Watcher:127.0.0.1:48366/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 106221 T441 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 106223 T441 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 106229 T491 oasha.CollectionsHandler.handleCreateAction Creating Collection : replicationFactor=2&shards=a,b,c&maxShardsPerNode=2&router.name=implicit&name=implicitcoll0&action=CREATE&wt=javabin&version=2
[junit4] 2> 106231 T463 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4] 2> 106233 T465 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
[junit4] 2> "operation":"createcollection",
[junit4] 2> "fromApi":"true",
[junit4] 2> "name":"implicitcoll0",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "maxShardsPerNode":"2",
[junit4] 2> "shards":"a,b,c",
[junit4] 2> "router.name":"implicit"}
[junit4] 2> 106233 T465 oasc.OverseerCollectionProcessor.processMessage WARN OverseerCollectionProcessor.processMessage : createcollection , {
[junit4] 2> "operation":"createcollection",
[junit4] 2> "fromApi":"true",
[junit4] 2> "name":"implicitcoll0",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "maxShardsPerNode":"2",
[junit4] 2> "shards":"a,b,c",
[junit4] 2> "router.name":"implicit"}
[junit4] 2> 106235 T465 oasc.OverseerCollectionProcessor.createConfNode Only one config set found in zk - using it:conf1
[junit4] 2> 106235 T465 oasc.OverseerCollectionProcessor.createConfNode creating collections conf node /collections/implicitcoll0
[junit4] 2> 106236 T465 oascc.SolrZkClient.makePath makePath: /collections/implicitcoll0
[junit4] 2> 106240 T463 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 106241 T464 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 106242 T464 oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: implicitcoll0
[junit4] 2> 106242 T464 oasc.Overseer$ClusterStateUpdater.createCollection Create collection implicitcoll0 with shards [a, b, c]
[junit4] 2> 106245 T463 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 106246 T523 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 106246 T509 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 106246 T495 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 106246 T526 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 106246 T468 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 106246 T463 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 106246 T481 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 106248 T528 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 106340 T465 oasc.OverseerCollectionProcessor.createCollection Creating SolrCores for new collection, shardNames [a, b, c] , replicationFactor : 2
[junit4] 2> 106340 T465 oasc.OverseerCollectionProcessor.createCollection Creating shard implicitcoll0_a_replica1 as part of slice a of collection implicitcoll0 on 127.0.0.1:39417_z_%2Fok
[junit4] 2> 106341 T465 oasc.OverseerCollectionProcessor.createCollection Creating shard implicitcoll0_a_replica2 as part of slice a of collection implicitcoll0 on 127.0.0.1:58902_z_%2Fok
[junit4] 2> 106343 T465 oasc.OverseerCollectionProcessor.createCollection Creating shard implicitcoll0_b_replica1 as part of slice b of collection implicitcoll0 on 127.0.0.1:60471_z_%2Fok
[junit4] 2> 106344 T465 oasc.OverseerCollectionProcessor.createCollection Creating shard implicitcoll0_b_replica2 as part of slice b of collection implicitcoll0 on 127.0.0.1:54289_z_%2Fok
[junit4] 2> 106357 T489 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=implicitcoll0_a_replica1&action=CREATE&numShards=3&collection=implicitcoll0&shard=a&wt=javabin&version=2
[junit4] 2> 106357 T503 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=implicitcoll0_a_replica2&action=CREATE&numShards=3&collection=implicitcoll0&shard=a&wt=javabin&version=2
[junit4] 2> 106357 T465 oasc.OverseerCollectionProcessor.createCollection Creating shard implicitcoll0_c_replica1 as part of slice c of collection implicitcoll0 on 127.0.0.1:60491_z_%2Fok
[junit4] 2> 106361 T465 oasc.OverseerCollectionProcessor.createCollection Creating shard implicitcoll0_c_replica2 as part of slice c of collection implicitcoll0 on 127.0.0.1:39417_z_%2Fok
[junit4] 2> 106361 T503 oasc.ZkController.publish publishing core=implicitcoll0_a_replica2 state=down collection=implicitcoll0
[junit4] 2> 106362 T518 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=implicitcoll0_b_replica2&action=CREATE&numShards=3&collection=implicitcoll0&shard=b&wt=javabin&version=2
[junit4] 2> 106362 T489 oasc.ZkController.publish publishing core=implicitcoll0_a_replica1 state=down collection=implicitcoll0
[junit4] 2> 106363 T503 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 106363 T463 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 106373 T518 oasc.ZkController.publish publishing core=implicitcoll0_b_replica2 state=down collection=implicitcoll0
[junit4] 2> 106373 T489 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 106374 T490 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=implicitcoll0_c_replica2&action=CREATE&numShards=3&collection=implicitcoll0&shard=c&wt=javabin&version=2
[junit4] 2> 106375 T457 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=implicitcoll0_c_replica1&action=CREATE&numShards=3&collection=implicitcoll0&shard=c&wt=javabin&version=2
[junit4] 2> 106376 T518 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 106375 T475 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=implicitcoll0_b_replica1&action=CREATE&numShards=3&collection=implicitcoll0&shard=b&wt=javabin&version=2
[junit4] 2> 106377 T490 oasc.ZkController.publish publishing core=implicitcoll0_c_replica2 state=down collection=implicitcoll0
[junit4] 2> 106378 T463 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 106378 T475 oasc.ZkController.publish publishing core=implicitcoll0_b_replica1 state=down collection=implicitcoll0
[junit4] 2> 106378 T457 oasc.ZkController.publish publishing core=implicitcoll0_c_replica1 state=down collection=implicitcoll0
[junit4] 2> 106378 T464 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 106378 T490 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 106380 T475 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 106380 T457 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 106381 T464 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:58902/z_/ok",
[junit4] 2> "core":"implicitcoll0_a_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:58902_z_%2Fok",
[junit4] 2> "shard":"a",
[junit4] 2> "collection":"implicitcoll0",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 106385 T464 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:39417/z_/ok",
[junit4] 2> "core":"implicitcoll0_a_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:39417_z_%2Fok",
[junit4] 2> "shard":"a",
[junit4] 2> "collection":"implicitcoll0",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 106389 T463 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 106390 T464 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:54289/z_/ok",
[junit4] 2> "core":"implicitcoll0_b_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:54289_z_%2Fok",
[junit4] 2> "shard":"b",
[junit4] 2> "collection":"implicitcoll0",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 106393 T463 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 106393 T464 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:39417/z_/ok",
[junit4] 2> "core":"implicitcoll0_c_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:39417_z_%2Fok",
[junit4] 2> "shard":"c",
[junit4] 2> "collection":"implicitcoll0",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 106396 T463 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 106397 T464 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:60471/z_/ok",
[junit4] 2> "core":"implicitcoll0_b_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:60471_z_%2Fok",
[junit4] 2> "shard":"b",
[junit4] 2> "collection":"implicitcoll0",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 106414 T463 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 106416 T464 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:60491/z_/ok",
[junit4] 2> "core":"implicitcoll0_c_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:60491_z_%2Fok",
[junit4] 2> "shard":"c",
[junit4] 2> "collection":"implicitcoll0",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 106418 T463 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 106521 T481 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 106521 T468 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 106521 T463 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 106521 T495 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 106521 T509 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 106521 T523 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 106521 T526 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 106521 T528 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 107363 T503 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for implicitcoll0_a_replica2
[junit4] 2> 107365 T503 oasc.CoreContainer.create Creating SolrCore 'implicitcoll0_a_replica2' using instanceDir: ./org.apache.solr.cloud.CustomCollectionTest-jetty3-1394251334400/implicitcoll0_a_replica2
[junit4] 2> 107365 T503 oasc.ZkController.createCollectionZkNode Check for collection zkNode:implicitcoll0
[junit4] 2> 107365 T503 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 107366 T503 oascc.ZkStateReader.readConfigName Load collection config from:/collections/implicitcoll0
[junit4] 2> 107367 T503 oascc.ZkStateReader.readConfigName path=/collections/implicitcoll0 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 107367 T503 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.CustomCollectionTest-jetty3-1394251334400/implicitcoll0_a_replica2/'
[junit4] 2> 107374 T489 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for implicitcoll0_a_replica1
[junit4] 2> 107375 T489 oasc.CoreContainer.create Creating SolrCore 'implicitcoll0_a_replica1' using instanceDir: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CustomCollectionTest-jetty2-1394251333012/implicitcoll0_a_replica1
[junit4] 2> 107375 T489 oasc.ZkController.createCollectionZkNode Check for collection zkNode:implicitcoll0
[junit4] 2> 107376 T489 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 107376 T489 oascc.ZkStateReader.readConfigName Load collection config from:/collections/implicitcoll0
[junit4] 2> 107376 T518 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for implicitcoll0_b_replica2
[junit4] 2> 107377 T489 oascc.ZkStateReader.readConfigName path=/collections/implicitcoll0 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 107377 T489 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CustomCollectionTest-jetty2-1394251333012/implicitcoll0_a_replica1/'
[junit4] 2> 107377 T518 oasc.CoreContainer.create Creating SolrCore 'implicitcoll0_b_replica2' using instanceDir: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CustomCollectionTest-jetty4-1394251335819/implicitcoll0_b_replica2
[junit4] 2> 107378 T518 oasc.ZkController.createCollectionZkNode Check for collection zkNode:implicitcoll0
[junit4] 2> 107379 T518 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 107379 T518 oascc.ZkStateReader.readConfigName Load collection config from:/collections/implicitcoll0
[junit4] 2> 107383 T475 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for implicitcoll0_b_replica1
[junit4] 2> 107383 T457 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for implicitcoll0_c_replica1
[junit4] 2> 107383 T490 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for implicitcoll0_c_replica2
[junit4] 2> 107384 T475 oasc.CoreContainer.create Creating SolrCore 'implicitcoll0_b_replica1' using instanceDir: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CustomCollectionTest-jetty1-1394251331555/implicitcoll0_b_replica1
[junit4] 2> 107385 T475 oasc.ZkController.createCollectionZkNode Check for collection zkNode:implicitcoll0
[junit4] 2> 107385 T490 oasc.CoreContainer.create Creating SolrCore 'implicitcoll0_c_replica2' using instanceDir: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CustomCollectionTest-jetty2-1394251333012/implicitcoll0_c_replica2
[junit4] 2> 107385 T490 oasc.ZkController.createCollectionZkNode Check for collection zkNode:implicitcoll0
[junit4] 2> 107384 T457 oasc.CoreContainer.create Creating SolrCore 'implicitcoll0_c_replica1' using instanceDir: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CustomCollectionTest-controljetty-1394251330873/implicitcoll0_c_replica1
[junit4] 2> 107386 T475 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 107386 T457 oasc.ZkController.createCollectionZkNode Check for collection zkNode:implicitcoll0
[junit4] 2> 107386 T475 oascc.ZkStateReader.readConfigName Load collection config from:/collections/implicitcoll0
[junit4] 2> 107387 T490 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 107387 T490 oascc.ZkStateReader.readConfigName Load collection config from:/collections/implicitcoll0
[junit4] 2> 107387 T457 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 107387 T457 oascc.ZkStateReader.readConfigName Load collection config from:/collections/implicitcoll0
[junit4] 2> 107387 T518 oascc.ZkStateReader.readConfigName path=/collections/implicitcoll0 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 107388 T518 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CustomCollectionTest-jetty4-1394251335819/implicitcoll0_b_replica2/'
[junit4] 2> 107388 T475 oascc.ZkStateReader.readConfigName path=/collections/implicitcoll0 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 107388 T490 oascc.ZkStateReader.readConfigName path=/collections/implicitcoll0 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 107389 T457 oascc.ZkStateReader.readConfigName path=/collections/implicitcoll0 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 107389 T490 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CustomCollectionTest-jetty2-1394251333012/implicitcoll0_c_replica2/'
[junit4] 2> 107388 T475 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CustomCollectionTest-jetty1-1394251331555/implicitcoll0_b_replica1/'
[junit4] 2> 107389 T457 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CustomCollectionTest-controljetty-1394251330873/implicitcoll0_c_replica1/'
[junit4] 2> 107404 T503 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 107415 T489 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 107416 T503 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 107418 T503 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 107447 T457 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 107450 T489 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 107451 T503 oass.IndexSchema.readSchema [implicitcoll0_a_replica2] Schema name=test
[junit4] 2> 107450 T475 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 107452 T489 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 107452 T518 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 107458 T457 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 107453 T490 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 107461 T457 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 107461 T489 oass.IndexSchema.readSchema [implicitcoll0_a_replica1] Schema name=test
[junit4] 2> 107489 T490 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 107490 T490 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 107492 T518 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 107495 T475 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 107496 T518 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 107497 T475 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 107498 T490 oass.IndexSchema.readSchema [implicitcoll0_c_replica2] Schema name=test
[junit4] 2> 107489 T457 oass.IndexSchema.readSchema [implicitcoll0_c_replica1] Schema name=test
[junit4] 2> 107518 T518 oass.IndexSchema.readSchema [implicitcoll0_b_replica2] Schema name=test
[junit4] 2> 107519 T475 oass.IndexSchema.readSchema [implicitcoll0_b_replica1] Schema name=test
[junit4] 2> 107711 T503 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 107717 T503 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 107719 T503 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 107756 T503 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 107761 T503 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 107767 T503 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 107771 T503 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 107781 T503 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 107782 T503 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 107783 T503 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 107783 T503 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 107784 T503 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 107784 T503 oasc.SolrCore.<init> [implicitcoll0_a_replica2] Opening new SolrCore at ./org.apache.solr.cloud.CustomCollectionTest-jetty3-1394251334400/implicitcoll0_a_replica2/, dataDir=./org.apache.solr.cloud.CustomCollectionTest-jetty3-1394251334400/implicitcoll0_a_replica2/data/
[junit4] 2> 107784 T503 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3815994
[junit4] 2> 107785 T503 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.CustomCollectionTest-jetty3-1394251334400/implicitcoll0_a_replica2/data
[junit4] 2> 107786 T503 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.CustomCollectionTest-jetty3-1394251334400/implicitcoll0_a_replica2/data/index/
[junit4] 2> 107786 T503 oasc.SolrCore.initIndex WARN [implicitcoll0_a_replica2] Solr index directory './org.apache.solr.cloud.CustomCollectionTest-jetty3-1394251334400/implicitcoll0_a_replica2/data/index' doesn't exist. Creating new index...
[junit4] 2> 107787 T503 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.CustomCollectionTest-jetty3-1394251334400/implicitcoll0_a_replica2/data/index
[junit4] 2> 107787 T503 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=14, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.559298670144839]
[junit4] 2> 107788 T503 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@2d7f0934 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@46f7afbf),segFN=segments_1,generation=1}
[junit4] 2> 107788 T503 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 107816 T503 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 107817 T503 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 107817 T503 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 107818 T503 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 107818 T503 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 107818 T503 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 107826 T489 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 107835 T503 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 107835 T503 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 107836 T503 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 107836 T503 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 107837 T503 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 107837 T503 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 107838 T503 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 107838 T503 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 107838 T503 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 107839 T503 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 107839 T503 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 107840 T489 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 107841 T489 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 107842 T503 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 107854 T503 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 107854 T503 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 107854 T475 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 107855 T503 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=18, maxMergeAtOnceExplicit=31, maxMergedSegmentMB=97.5078125, floorSegmentMB=1.1748046875, forceMergeDeletesPctAllowed=16.330470525747103, segmentsPerTier=49.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.3937247863475729
[junit4] 2> 107856 T503 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@2d7f0934 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@46f7afbf),segFN=segments_1,generation=1}
[junit4] 2> 107856 T503 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 107857 T503 oass.SolrIndexSearcher.<init> Opening Searcher@2d757c78[implicitcoll0_a_replica2] main
[junit4] 2> 107888 T490 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 107892 T490 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 107893 T475 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 107894 T490 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 107895 T489 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 107895 T475 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 107899 T535 oasc.SolrCore.registerSearcher [implicitcoll0_a_replica2] Registered new searcher Searcher@2d757c78[implicitcoll0_a_replica2] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 107904 T503 oasc.CoreContainer.registerCore registering core: implicitcoll0_a_replica2
[junit4] 2> 107905 T457 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 107905 T503 oasc.ZkController.register Register replica - core:implicitcoll0_a_replica2 address:http://127.0.0.1:58902/z_/ok collection:implicitcoll0 shard:a
[junit4] 2> 107906 T489 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 107907 T503 oascc.SolrZkClient.makePath makePath: /collections/implicitcoll0/leader_elect/a/election
[junit4] 2> 107909 T457 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 107910 T489 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 107913 T518 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 107911 T457 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 107915 T489 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 107917 T489 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 107918 T489 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 107921 T518 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 107923 T518 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 107924 T489 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 107924 T489 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 107925 T489 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 107925 T503 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard a
[junit4] 2> 107925 T489 oasc.SolrCore.<init> [implicitcoll0_a_replica1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CustomCollectionTest-jetty2-1394251333012/implicitcoll0_a_replica1/, dataDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CustomCollectionTest-jetty2-1394251333012/implicitcoll0_a_replica1/data/
[junit4] 2> 107937 T463 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 107937 T463 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 107937 T463 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 107938 T503 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up for shard a: total=2 found=1 timeoutin=4.89735928E14ms
[junit4] 2> 107954 T489 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3815994
[junit4] 2> 107947 T464 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 107955 T489 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CustomCollectionTest-jetty2-1394251333012/implicitcoll0_a_replica1/data
[junit4] 2> 107955 T489 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CustomCollectionTest-jetty2-1394251333012/implicitcoll0_a_replica1/data/index/
[junit4] 2> 107956 T489 oasc.SolrCore.initIndex WARN [implicitcoll0_a_replica1] Solr index directory '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CustomCollectionTest-jetty2-1394251333012/implicitcoll0_a_replica1/data/index' doesn't exist. Creating new index...
[junit4] 2> 107956 T489 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CustomCollectionTest-jetty2-1394251333012/implicitcoll0_a_replica1/data/index
[junit4] 2> 107957 T489 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=14, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.559298670144839]
[junit4] 2> 107958 T489 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@49c1f413 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2e5f587a),segFN=segments_1,generation=1}
[junit4] 2> 107958 T489 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 107959 T490 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 107959 T475 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 107960 T463 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 107962 T489 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 107962 T490 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 107962 T489 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 107962 T457 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 107963 T489 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 107964 T489 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 107965 T475 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 107965 T489 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 107965 T489 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 107966 T489 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 107966 T490 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 107966 T457 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 107966 T489 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 107970 T489 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 107969 T475 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 107970 T457 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 107970 T490 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 107971 T490 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 107972 T490 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 107972 T457 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 107972 T457 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 107972 T457 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 107971 T489 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 107973 T489 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 107974 T489 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 107972 T475 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 107975 T475 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 107975 T475 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 107975 T489 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 107974 T457 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 107976 T457 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 107974 T490 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 107976 T457 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 107976 T518 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 107977 T489 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 107977 T457 oasc.SolrCore.<init> [implicitcoll0_c_replica1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CustomCollectionTest-controljetty-1394251330873/implicitcoll0_c_replica1/, dataDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CustomCollectionTest-controljetty-1394251330873/implicitcoll0_c_replica1/data/
[junit4] 2> 107977 T475 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 107978 T475 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 107977 T490 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 107979 T475 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 107978 T489 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 107978 T457 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3815994
[junit4] 2> 107980 T489 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 107980 T489 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 107980 T457 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CustomCollectionTest-controljetty-1394251330873/implicitcoll0_c_replica1/data
[junit4] 2> 107981 T457 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CustomCollectionTest-controljetty-1394251330873/implicitcoll0_c_replica1/data/index/
[junit4] 2> 107981 T457 oasc.SolrCore.initIndex WARN [implicitcoll0_c_replica1] Solr index directory '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CustomCollectionTest-controljetty-1394251330873/implicitcoll0_c_replica1/data/index' doesn't exist. Creating new index...
[junit4] 2> 107981 T489 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 107981 T457 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CustomCollectionTest-controljetty-1394251330873/implicitcoll0_c_replica1/data/index
[junit4] 2> 107982 T457 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=14, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, max
[...truncated too long message...]
lr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CustomCollectionTest-jetty1-1394251331555/implicitcoll1_c_replica1/data/index;done=false>>]
[junit4] 2> 302690 T495 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 302690 T481 oasc.CachingDirectoryFactory.close Closing directory: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CustomCollectionTest-jetty1-1394251331555/implicitcoll1_c_replica1/data/index
[junit4] 2> 302690 T495 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 302691 T481 oascc.SolrZkClient.makePath makePath: /collections/implicitcoll1/leaders/c
[junit4] 2> 302691 T495 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:259)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 302691 T481 oasc.SolrException.log ERROR There was a problem trying to register as the leader:org.apache.solr.common.SolrException: Could not register as the leader because creating the ephemeral registration node in ZooKeeper failed
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:135)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:297)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:164)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:108)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1041)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:208)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:205)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:205)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:416)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:385)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:372)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContextBase$1.execute(ElectionContext.java:127)
[junit4] 2> at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:31)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:122)
[junit4] 2> ... 7 more
[junit4] 2>
[junit4] 2> 302692 T481 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/implicitcoll1/leader_elect/c/election/91373655205740550-core_node5-n_0000000001
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:176)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:173)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:173)
[junit4] 2> at org.apache.solr.cloud.ElectionContext.cancelElection(ElectionContext.java:71)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:317)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:164)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:108)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 302692 T481 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 302692 T481 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 302693 T481 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 302693 T481 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 302693 T481 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 302693 T481 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 302693 T481 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> NOTE: test params are: codec=Lucene46: {}, docValues:{}, sim=DefaultSimilarity, locale=ar_LY, timezone=Asia/Thimbu
[junit4] 2> NOTE: Linux 3.8.0-36-generic amd64/Oracle Corporation 1.8.0 (64-bit)/cpus=8,threads=1,free=43657384,total=303796224
[junit4] 2> NOTE: All tests run in this JVM: [TestLMDirichletSimilarityFactory, TestPHPSerializedResponseWriter, EnumFieldTest, IndexSchemaTest, TestGroupingSearch, InfoHandlerTest, TestSolrQueryParser, TestFunctionQuery, TestExtendedDismaxParser, TestCoreContainer, TestFieldTypeCollectionResource, TestFieldTypeResource, TestClassNameShortening, TestReversedWildcardFilterFactory, TestBlendedInfixSuggestions, TestLuceneMatchVersion, EchoParamsTest, TestStressVersions, NoFacetTest, ChangedSchemaMergeTest, TestSolrXMLSerializer, QueryResultKeyTest, ResponseLogComponentTest, DeleteShardTest, AnalysisAfterCoreReloadTest, PeerSyncTest, HdfsChaosMonkeySafeLeaderTest, BlockDirectoryTest, DistributedQueryElevationComponentTest, ReturnFieldsTest, LukeRequestHandlerTest, CustomCollectionTest]
[junit4] Completed on J0 in 204.14s, 1 test, 1 error <<< FAILURES!
[...truncated 1018 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:465: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:445: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:490: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1274: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:907: There were test failures: 379 suites, 1619 tests, 1 error, 49 ignored (20 assumptions)
Total time: 51 minutes 24 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.8.0-fcs-b132 -XX:+UseCompressedOops -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
Re: [JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.8.0-fcs-b132)
- Build # 9713 - Failure!
Posted by Mark Miller <ma...@gmail.com>.
This only seems to happen on the policeman jenkins. Never used to happen, simple code, lots of tests use it. Not sure what is going on here. It’s on my list of like a million things to try and figure out.
- Mark
http://about.me/markrmiller
On Mar 8, 2014, 1:15:40 AM, Policeman Jenkins Server <je...@thetaphi.de> wrote: Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/9714/
Java: 64bit/jdk1.8.0-fcs-b132 -XX:+UseCompressedOops -XX:+UseG1GC
1 tests failed.
FAILED: org.apache.solr.client.solrj.impl.CloudSolrServerTest.testShutdown
Error Message:
java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:60479 within 45000 ms
Stack Trace:
org.apache.solr.common.SolrException: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:60479 within 45000 ms
at __randomizedtesting.SeedInfo.seed([871F84DD27CE2D4E:64698D48C0B4B83C]:0)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:150)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:101)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:91)
at org.apache.solr.cloud.AbstractZkTestCase.buildZooKeeper(AbstractZkTestCase.java:89)
at org.apache.solr.cloud.AbstractZkTestCase.buildZooKeeper(AbstractZkTestCase.java:83)
at org.apache.solr.cloud.AbstractDistribZkTestBase.setUp(AbstractDistribZkTestBase.java:70)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.setUp(AbstractFullDistribZkTestBase.java:200)
at org.apache.solr.client.solrj.impl.CloudSolrServerTest.setUp(CloudSolrServerTest.java:78)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:771)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:744)
Caused by: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:60479 within 45000 ms
at org.apache.solr.common.cloud.ConnectionManager.waitForConnected(ConnectionManager.java:223)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:142)
... 46 more
Build Log:
[...truncated 11578 lines...]
[junit4] Suite: org.apache.solr.client.solrj.impl.CloudSolrServerTest
[junit4] 2> 730 T17 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (true)
[junit4] 2> 742 T17 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4] 2> 745 T17 oasc.AbstractZkTestCase.<clinit> WARN TEST_HOME() does not exist - solrj test?
[junit4] 2> 752 T17 oas.SolrTestCaseJ4.setUp ###Starting testShutdown
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1394259181153
[junit4] 2> 759 T17 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 763 T18 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 862 T17 oasc.ZkTestServer.run start zk server on port:60479
[junit4] 2> 904 T17 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 931 T19 oazs.NIOServerCnxn.doIO WARN Exception causing close of session 0x0 due to java.io.IOException: ZooKeeperServer not running
[junit4] 2> 98848 T21 oazsp.FileTxnLog.commit WARN fsync-ing the write ahead log in SyncThread:0 took 95816ms which will adversely effect operation latency. See the ZooKeeper troubleshooting guide
[junit4] 2> 98850 T17 oas.SolrTestCaseJ4.tearDown ###Ending testShutdown
[junit4] 2> 98865 T19 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x144a052beb60000, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 98867 T17 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:60479 60479
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=CloudSolrServerTest -Dtests.method=testShutdown -Dtests.seed=871F84DD27CE2D4E -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=en_NZ -Dtests.timezone=Antarctica/McMurdo -Dtests.file.encoding=UTF-8
[junit4] ERROR 98.3s J0 | CloudSolrServerTest.testShutdown <<<
[junit4] > Throwable #1: org.apache.solr.common.SolrException: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:60479 within 45000 ms
[junit4] > at __randomizedtesting.SeedInfo.seed([871F84DD27CE2D4E:64698D48C0B4B83C]:0)
[junit4] > at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:150)
[junit4] > at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:101)
[junit4] > at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:91)
[junit4] > at org.apache.solr.cloud.AbstractZkTestCase.buildZooKeeper(AbstractZkTestCase.java:89)
[junit4] > at org.apache.solr.cloud.AbstractZkTestCase.buildZooKeeper(AbstractZkTestCase.java:83)
[junit4] > at org.apache.solr.cloud.AbstractDistribZkTestBase.setUp(AbstractDistribZkTestBase.java:70)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.setUp(AbstractFullDistribZkTestBase.java:200)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrServerTest.setUp(CloudSolrServerTest.java:78)
[junit4] > at java.lang.Thread.run(Thread.java:744)
[junit4] > Caused by: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:60479 within 45000 ms
[junit4] > at org.apache.solr.common.cloud.ConnectionManager.waitForConnected(ConnectionManager.java:223)
[junit4] > at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:142)
[junit4] > ... 46 more
[junit4] 2> 99072 T17 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1394259279472
[junit4] 2> 99073 T17 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 99074 T25 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 99174 T17 oasc.ZkTestServer.run start zk server on port:55541
[junit4] 2> 99175 T17 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 99230 T31 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3b437918 name:ZooKeeperConnection Watcher:127.0.0.1:55541 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 99231 T17 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 99232 T17 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 99266 T17 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 99271 T33 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2d2b19ee name:ZooKeeperConnection Watcher:127.0.0.1:55541/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 99272 T17 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 99277 T17 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 99283 T17 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 99288 T17 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 99293 T17 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 99302 T17 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 99310 T17 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 99325 T17 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 99326 T17 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 99381 T17 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml because it doesn't exist
[junit4] 2> 99381 T17 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/stopwords.txt because it doesn't exist
[junit4] 2> 99382 T17 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/protwords.txt because it doesn't exist
[junit4] 2> 99383 T17 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/currency.xml because it doesn't exist
[junit4] 2> 99383 T17 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/enumsConfig.xml because it doesn't exist
[junit4] 2> 99384 T17 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/open-exchange-rates.json because it doesn't exist
[junit4] 2> 99385 T17 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/mapping-ISOLatin1Accent.txt because it doesn't exist
[junit4] 2> 99385 T17 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/old_synonyms.txt because it doesn't exist
[junit4] 2> 99386 T17 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/synonyms.txt because it doesn't exist
[junit4] 2> 99759 T17 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 99960 T17 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:55573
[junit4] 2> 100042 T17 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 100043 T17 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 100044 T17 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1394259279794
[junit4] 2> 100044 T17 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1394259279794/'
[junit4] 2> 100070 T17 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1394259279794/solr.xml
[junit4] 2> 100228 T17 oasc.CoreContainer.<init> New CoreContainer 697646028
[junit4] 2> 100229 T17 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1394259279794/]
[junit4] 2> 100254 T17 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4] 2> 100255 T17 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
[junit4] 2> 100263 T17 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4] 2> 100264 T17 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 100265 T17 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 100265 T17 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 100266 T17 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 100267 T17 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 100267 T17 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 100493 T17 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 100495 T17 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 100498 T17 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 100499 T17 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55541/solr
[junit4] 2> 100517 T17 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 100518 T17 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 100526 T45 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4594e282 name:ZooKeeperConnection Watcher:127.0.0.1:55541 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 100527 T17 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 100538 T17 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 100542 T47 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@22c8c3fc name:ZooKeeperConnection Watcher:127.0.0.1:55541/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 100543 T17 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 100612 T17 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 100632 T17 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 100658 T17 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 100662 T17 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55573_
[junit4] 2> 100666 T17 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55573_
[junit4] 2> 100675 T17 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 100680 T17 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 100695 T17 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:55573_
[junit4] 2> 100696 T17 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 100706 T17 oasc.Overseer.start Overseer (id=91374176139739139-127.0.0.1:55573_-n_0000000000) starting
[junit4] 2> 100725 T17 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 100861 T49 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 100862 T17 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 100876 T49 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
[junit4] 2> 100876 T17 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 100882 T17 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 100898 T48 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 101025 T50 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
[junit4] 2> 101026 T50 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 101030 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 101032 T50 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 101037 T48 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 101040 T48 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:55573",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:55573_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 101040 T48 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 101054 T48 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 101061 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 101066 T47 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 102032 T50 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 102033 T50 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1394259279794/collection1
[junit4] 2> 102033 T50 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 102036 T50 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 102037 T50 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 102039 T50 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 102039 T50 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1394259279794/collection1/'
[junit4] 2> 102131 T50 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 102251 T50 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 102265 T50 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 102378 T50 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 102537 T50 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableIntField]. Please consult documentation how to replace it accordingly.
[junit4] 2> 102551 T50 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableLongField]. Please consult documentation how to replace it accordingly.
[junit4] 2> 102558 T50 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableFloatField]. Please consult documentation how to replace it accordingly.
[junit4] 2> 102567 T50 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableDoubleField]. Please consult documentation how to replace it accordingly.
[junit4] 2> 102920 T50 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 102921 T50 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 102928 T50 oass.IndexSchema.readSchema WARN Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 102928 T50 oass.IndexSchema.readSchema WARN Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 102966 T50 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 102974 T50 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1394259279794/collection1/, dataDir=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/control/data/
[junit4] 2> 102976 T50 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 103012 T50 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/control/data
[junit4] 2> 103012 T50 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/control/data/index/
[junit4] 2> 103013 T50 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/control/data/index' doesn't exist. Creating new index...
[junit4] 2> 103023 T50 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/control/data/index
[junit4] 2> 103065 T50 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@79964587 lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/control/data/index),segFN=segments_1,generation=1}
[junit4] 2> 103067 T50 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 103211 T50 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 103223 T50 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 103224 T50 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 103225 T50 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 103232 T50 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 103238 T50 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 103240 T50 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 103243 T50 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: solr.PingRequestHandler
[junit4] 2> 103267 T50 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 103288 T50 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 103289 T50 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 103291 T50 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@79964587 lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/control/data/index),segFN=segments_1,generation=1}
[junit4] 2> 103291 T50 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 103309 T50 oass.SolrIndexSearcher.<init> Opening Searcher@727b1191[collection1] main
[junit4] 2> 103340 T50 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 103340 T51 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@727b1191[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 103346 T17 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0
[junit4] 2> 103346 T54 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:55573 collection:control_collection shard:shard1
[junit4] 2> 103346 T17 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 103353 T54 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 103359 T17 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 103362 T54 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 103363 T56 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6470051 name:ZooKeeperConnection Watcher:127.0.0.1:55541/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 103363 T17 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 103365 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 103365 T17 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 103366 T54 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 103366 T54 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 103367 T48 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 103370 T17 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> ASYNC NEW_CORE C0 name=collection1 org.apache.solr.core.SolrCore@6efa0529 url=http://127.0.0.1:55573/collection1 node=127.0.0.1:55573_ C0_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:55573, core=collection1, node_name=127.0.0.1:55573_}
[junit4] 2> 103370 T54 C0 P55573 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:55573/collection1/
[junit4] 2> 103375 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 103375 T54 C0 P55573 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 103376 T54 C0 P55573 oasc.SyncStrategy.syncToMe http://127.0.0.1:55573/collection1/ has no replicas
[junit4] 2> 103376 T56 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 103376 T47 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 103376 T54 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:55573/collection1/ shard1
[junit4] 2> 103379 T54 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 103389 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 103391 T48 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 103395 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 103405 T17 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 103407 T17 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 103410 T17 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:59672
[junit4] 2> 103411 T17 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 103411 T17 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 103411 T17 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1394259283770
[junit4] 2> 103412 T17 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1394259283770/'
[junit4] 2> 103430 T17 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1394259283770/solr.xml
[junit4] 2> 103451 T17 oasc.CoreContainer.<init> New CoreContainer 1363939353
[junit4] 2> 103452 T17 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1394259283770/]
[junit4] 2> 103452 T17 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4] 2> 103453 T17 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
[junit4] 2> 103453 T17 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4] 2> 103454 T17 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 103454 T17 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 103454 T17 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 103455 T17 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 103456 T17 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 103456 T17 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 103460 T17 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 103460 T17 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 103461 T17 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 103461 T17 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55541/solr
[junit4] 2> 103462 T17 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 103463 T17 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 103465 T67 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@42bf1637 name:ZooKeeperConnection Watcher:127.0.0.1:55541 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 103465 T17 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 103472 T17 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 103474 T69 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3a52fa52 name:ZooKeeperConnection Watcher:127.0.0.1:55541/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 103474 T17 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 103479 T17 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 103497 T56 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 103497 T47 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 103497 T69 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 103541 T54 oasc.ZkController.register We are http://127.0.0.1:55573/collection1/ and leader is http://127.0.0.1:55573/collection1/
[junit4] 2> 103542 T54 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:55573
[junit4] 2> 103542 T54 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 103543 T54 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
[junit4] 2> 103543 T54 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 103545 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 103545 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 103545 T54 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 103545 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 103547 T48 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 103548 T48 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:55573",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:55573_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 103552 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 103656 T56 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 103656 T47 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 103656 T69 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 104482 T17 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59672_
[junit4] 2> 104485 T17 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59672_
[junit4] 2> 104489 T56 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 104489 T69 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 104489 T47 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 104496 T70 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 104497 T70 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 104498 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 104498 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 104499 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 104498 T70 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 104500 T48 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 104501 T48 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:59672",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:59672_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 104502 T48 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
[junit4] 2> 104502 T48 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 104505 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 104609 T47 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 104609 T56 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 104610 T69 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 105502 T70 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 105503 T70 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1394259283770/collection1
[junit4] 2> 105503 T70 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 105505 T70 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 105505 T70 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 105506 T70 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 105507 T70 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1394259283770/collection1/'
[junit4] 2> 105541 T70 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 105558 T70 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 105560 T70 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 105636 T70 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 105966 T70 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 105968 T70 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 105971 T70 oass.IndexSchema.readSchema WARN Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 105973 T70 oass.IndexSchema.readSchema WARN Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 105975 T70 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 105975 T70 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1394259283770/collection1/, dataDir=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty1/
[junit4] 2> 105975 T70 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 105980 T70 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty1
[junit4] 2> 105981 T70 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty1/index/
[junit4] 2> 105981 T70 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty1/index' doesn't exist. Creating new index...
[junit4] 2> 105982 T70 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty1/index
[junit4] 2> 105989 T70 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@7200e69f lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty1/index),segFN=segments_1,generation=1}
[junit4] 2> 105990 T70 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 105991 T70 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 105991 T70 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 105992 T70 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 105992 T70 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 105992 T70 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 105993 T70 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 105993 T70 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 105993 T70 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: solr.PingRequestHandler
[junit4] 2> 105996 T70 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 106000 T70 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 106000 T70 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 106003 T70 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@7200e69f lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty1/index),segFN=segments_1,generation=1}
[junit4] 2> 106003 T70 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 106008 T70 oass.SolrIndexSearcher.<init> Opening Searcher@7b787bc1[collection1] main
[junit4] 2> 106010 T71 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7b787bc1[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 106010 T70 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 106012 T17 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0
[junit4] 2> 106012 T17 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 106012 T74 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:59672 collection:collection1 shard:shard2
[junit4] 2> 106019 T74 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 106032 T74 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 106042 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 106042 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 106042 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 106042 T74 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 106043 T74 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 106045 T48 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> ASYNC NEW_CORE C1 name=collection1 org.apache.solr.core.SolrCore@5debe52b url=http://127.0.0.1:59672/collection1 node=127.0.0.1:59672_ C1_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:59672, core=collection1, node_name=127.0.0.1:59672_}
[junit4] 2> 106043 T74 C1 P59672 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:59672/collection1/
[junit4] 2> 106060 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 106061 T74 C1 P59672 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 106061 T17 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 106061 T74 C1 P59672 oasc.SyncStrategy.syncToMe http://127.0.0.1:59672/collection1/ has no replicas
[junit4] 2> 106062 T74 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:59672/collection1/ shard2
[junit4] 2> 106062 T17 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 106062 T74 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 106071 T17 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:40121
[junit4] 2> 106075 T17 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 106081 T17 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 106082 T17 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1394259286412
[junit4] 2> 106083 T17 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1394259286412/'
[junit4] 2> 106091 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 106101 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 106129 T17 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1394259286412/solr.xml
[junit4] 2> 106152 T17 oasc.CoreContainer.<init> New CoreContainer 1520964013
[junit4] 2> 106153 T17 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1394259286412/]
[junit4] 2> 106157 T17 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4] 2> 106158 T17 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
[junit4] 2> 106168 T17 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4] 2> 106169 T17 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 106169 T17 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 106170 T17 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 106170 T17 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 106171 T17 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 106172 T17 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 106186 T17 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 106187 T17 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 106187 T17 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 106188 T17 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55541/solr
[junit4] 2> 106189 T17 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 106191 T17 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 106194 T85 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@23c61723 name:ZooKeeperConnection Watcher:127.0.0.1:55541 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 106194 T17 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 106207 T17 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 106263 T56 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 106263 T47 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 106263 T69 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 106266 T87 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7126b030 name:ZooKeeperConnection Watcher:127.0.0.1:55541/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 106269 T17 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 106275 T17 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 106294 T74 oasc.ZkController.register We are http://127.0.0.1:59672/collection1/ and leader is http://127.0.0.1:59672/collection1/
[junit4] 2> 106294 T74 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:59672
[junit4] 2> 106294 T74 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 106295 T74 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 106295 T74 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 106301 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 106302 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 106302 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 106303 T74 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 106306 T48 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 106308 T48 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:59672",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:59672_",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 106320 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 106427 T56 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 106427 T69 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 106427 T87 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 106427 T47 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 107283 T17 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40121_
[junit4] 2> 107285 T17 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:40121_
[junit4] 2> 107287 T47 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 107289 T56 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 107289 T87 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 107289 T69 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 107297 T88 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 107298 T88 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 107300 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 107300 T88 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 107300 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 107301 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 107302 T48 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 107303 T48 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:40121",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:40121_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 107303 T48 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 107304 T48 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 107307 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 107488 T56 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 107488 T47 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 107488 T87 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 107488 T69 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 108301 T88 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 108302 T88 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1394259286412/collection1
[junit4] 2> 108302 T88 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 108304 T88 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 108304 T88 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 108306 T88 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 108306 T88 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1394259286412/collection1/'
[junit4] 2> 108340 T88 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 108360 T88 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 108362 T88 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 108390 T88 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 108531 T88 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 108533 T88 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 108534 T88 oass.IndexSchema.readSchema WARN Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 108535 T88 oass.IndexSchema.readSchema WARN Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 108536 T88 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 108537 T88 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1394259286412/collection1/, dataDir=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty2/
[junit4] 2> 108537 T88 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 108538 T88 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty2
[junit4] 2> 108538 T88 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty2/index/
[junit4] 2> 108538 T88 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty2/index' doesn't exist. Creating new index...
[junit4] 2> 108539 T88 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty2/index
[junit4] 2> 108541 T88 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@2a9faac lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty2/index),segFN=segments_1,generation=1}
[junit4] 2> 108541 T88 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 108543 T88 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 108544 T88 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 108544 T88 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 108544 T88 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 108551 T88 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 108552 T88 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 108553 T88 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 108553 T88 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: solr.PingRequestHandler
[junit4] 2> 108555 T88 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 108557 T88 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 108557 T88 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 108559 T88 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@2a9faac lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty2/index),segFN=segments_1,generation=1}
[junit4] 2> 108560 T88 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 108560 T88 oass.SolrIndexSearcher.<init> Opening Searcher@2fdd91d0[collection1] main
[junit4] 2> 108561 T89 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2fdd91d0[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 108561 T88 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 108562 T17 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0
[junit4] 2> 108563 T17 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 108562 T92 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:40121 collection:collection1 shard:shard1
[junit4] 2> 108565 T92 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 108571 T92 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 108574 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 108574 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 108574 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 108574 T92 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 108575 T92 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C2 name=collection1 org.apache.solr.core.SolrCore@5452a467 url=http://127.0.0.1:40121/collection1 node=127.0.0.1:40121_ C2_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:40121, core=collection1, node_name=127.0.0.1:40121_}
[junit4] 2> 108575 T92 C2 P40121 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:40121/collection1/
[junit4] 2> 108575 T92 C2 P40121 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 108575 T92 C2 P40121 oasc.SyncStrategy.syncToMe http://127.0.0.1:40121/collection1/ has no replicas
[junit4] 2> 108576 T48 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 108576 T92 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:40121/collection1/ shard1
[junit4] 2> 108576 T92 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 108581 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 108584 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 108587 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 108599 T17 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 108600 T17 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 108603 T17 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:59111
[junit4] 2> 108605 T17 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 108605 T17 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 108605 T17 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1394259288964
[junit4] 2> 108606 T17 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1394259288964/'
[junit4] 2> 108622 T17 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1394259288964/solr.xml
[junit4] 2> 108634 T17 oasc.CoreContainer.<init> New CoreContainer 1243096640
[junit4] 2> 108635 T17 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1394259288964/]
[junit4] 2> 108636 T17 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4] 2> 108636 T17 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
[junit4] 2> 108637 T17 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4] 2> 108637 T17 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 108637 T17 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 108638 T17 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 108638 T17 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 108639 T17 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 108639 T17 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 108642 T17 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 108643 T17 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 108643 T17 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 108643 T17 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55541/solr
[junit4] 2> 108644 T17 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 108644 T17 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 108647 T103 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2d53b855 name:ZooKeeperConnection Watcher:127.0.0.1:55541 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 108648 T17 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 108651 T17 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 108653 T105 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3bfa44b1 name:ZooKeeperConnection Watcher:127.0.0.1:55541/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 108653 T17 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 108658 T17 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 108691 T87 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 108692 T105 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 108691 T56 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 108691 T69 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 108693 T47 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 108735 T92 oasc.ZkController.register We are http://127.0.0.1:40121/collection1/ and leader is http://127.0.0.1:40121/collection1/
[junit4] 2> 108736 T92 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:40121
[junit4] 2> 108736 T92 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 108736 T92 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 108737 T92 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 108738 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 108738 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 108738 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 108738 T92 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 108740 T48 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 108741 T48 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:40121",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:40121_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node2"}
[junit4] 2> 108744 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 108847 T56 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 108847 T47 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 108847 T105 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 108848 T69 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 108848 T87 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 109662 T17 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59111_
[junit4] 2> 109664 T17 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59111_
[junit4] 2> 109666 T56 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 109666 T105 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 109666 T69 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 109666 T87 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 109667 T47 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 109676 T106 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 109676 T106 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 109677 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 109677 T106 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 109677 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 109678 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 109679 T48 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 109680 T48 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:59111",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:59111_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 109680 T48 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 109680 T48 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 109682 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 109785 T105 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 109785 T69 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 109785 T47 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 109785 T56 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 109785 T87 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 110678 T106 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 110678 T106 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1394259288964/collection1
[junit4] 2> 110679 T106 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 110680 T106 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 110680 T106 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 110681 T106 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 110681 T106 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1394259288964/collection1/'
[junit4] 2> 110708 T106 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 110717 T106 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 110719 T106 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 110742 T106 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 110881 T106 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 110882 T106 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 110884 T106 oass.IndexSchema.readSchema WARN Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 110885 T106 oass.IndexSchema.readSchema WARN Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 110886 T106 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 110887 T106 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1394259288964/collection1/, dataDir=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty3/
[junit4] 2> 110887 T106 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 110888 T106 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty3
[junit4] 2> 110888 T106 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty3/index/
[junit4] 2> 110889 T106 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty3/index' doesn't exist. Creating new index...
[junit4] 2> 110889 T106 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty3/index
[junit4] 2> 110891 T106 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@76327f71 lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty3/index),segFN=segments_1,generation=1}
[junit4] 2> 110891 T106 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 110893 T106 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 110893 T106 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 110894 T106 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 110894 T106 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 110894 T106 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 110894 T106 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 110895 T106 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 110895 T106 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: solr.PingRequestHandler
[junit4] 2> 110896 T106 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 110898 T106 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 110898 T106 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 110899 T106 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@76327f71 lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty3/index),segFN=segments_1,generation=1}
[junit4] 2> 110899 T106 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 110900 T106 oass.SolrIndexSearcher.<init> Opening Searcher@60156be5[collection1] main
[junit4] 2> 110900 T107 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@60156be5[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 110900 T106 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 110901 T17 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0
[junit4] 2> 110902 T17 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 110901 T110 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:59111 collection:collection1 shard:shard2
[junit4] 2> 110907 T110 oasc.ZkController.register We are http://127.0.0.1:59111/collection1/ and leader is http://127.0.0.1:59672/collection1/
[junit4] 2> 110908 T110 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:59111
[junit4] 2> 110908 T110 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4] 2> 110908 T110 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4] 2> ASYNC NEW_CORE C3 name=collection1 org.apache.solr.core.SolrCore@f4e8e20 url=http://127.0.0.1:59111/collection1 node=127.0.0.1:59111_ C3_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:59111, core=collection1, node_name=127.0.0.1:59111_}
[junit4] 2> 110913 T111 C3 P59111 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4] 2> 110914 T110 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 110915 T111 C3 P59111 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4] 2> 110916 T111 C3 P59111 oas
[...truncated too long message...]
t4] 2> 121034 T17 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> 121841 T47 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 121841 T47 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 121934 T69 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 121934 T69 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 122940 T105 C12 P59111 oasc.SyncStrategy.sync WARN Closed, skipping sync up.
[junit4] 2> 122947 T105 oasc.ShardLeaderElectionContext.rejoinLeaderElection Not rejoining election because CoreContainer is shutdown
[junit4] 2> 122948 T105 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@f4e8e20
[junit4] 2> 122948 T105 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=6,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=2,cumulative_deletesById=1,cumulative_deletesByQuery=2,cumulative_errors=0,transaction_logs_total_size=0,transaction_logs_total_number=5}
[junit4] 2> 122949 T105 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 122949 T105 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 122949 T105 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 122952 T105 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 122952 T105 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 122952 T105 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty3 [CachedDir<<refCount=0;path=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty3;done=false>>]
[junit4] 2> 122953 T105 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty3
[junit4] 2> 122953 T105 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty3/index [CachedDir<<refCount=0;path=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty3/index;done=false>>]
[junit4] 2> 122953 T105 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty3/index
[junit4] 2> 122954 T105 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 122954 T105 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 122955 T105 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 122955 T105 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:259)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 123029 T124 C10 P46922 oasc.SyncStrategy.sync WARN Closed, skipping sync up.
[junit4] 2> 123030 T124 oasc.ShardLeaderElectionContext.rejoinLeaderElection Not rejoining election because CoreContainer is shutdown
[junit4] 2> 123030 T124 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@ee9ae71
[junit4] 2> 123032 T124 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=6,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=2,cumulative_deletesById=1,cumulative_deletesByQuery=2,cumulative_errors=0,transaction_logs_total_size=0,transaction_logs_total_number=5}
[junit4] 2> 123032 T124 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 123032 T124 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 123033 T124 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 123035 T124 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 123036 T124 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 123036 T124 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty4 [CachedDir<<refCount=0;path=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty4;done=false>>]
[junit4] 2> 123037 T124 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty4
[junit4] 2> 123037 T124 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty4/index [CachedDir<<refCount=0;path=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty4/index;done=false>>]
[junit4] 2> 123037 T124 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty4/index
[junit4] 2> 123038 T124 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:259)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 123039 T124 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> NOTE: test params are: codec=Lucene41, sim=DefaultSimilarity, locale=en_NZ, timezone=Antarctica/McMurdo
[junit4] 2> NOTE: Linux 3.8.0-36-generic amd64/Oracle Corporation 1.8.0 (64-bit)/cpus=8,threads=1,free=87751480,total=155189248
[junit4] 2> NOTE: All tests run in this JVM: [TestJavaBinCodec, ContentStreamTest, CloudSolrServerTest]
[junit4] Completed on J0 in 123.58s, 2 tests, 1 error <<< FAILURES!
[...truncated 112 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:465: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:445: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:202: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:490: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1274: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:907: There were test failures: 49 suites, 281 tests, 1 error
Total time: 47 minutes 27 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.8.0-fcs-b132 -XX:+UseCompressedOops -XX:+UseG1GC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.8.0-fcs-b132) - Build
# 9714 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/9714/
Java: 64bit/jdk1.8.0-fcs-b132 -XX:+UseCompressedOops -XX:+UseG1GC
1 tests failed.
FAILED: org.apache.solr.client.solrj.impl.CloudSolrServerTest.testShutdown
Error Message:
java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:60479 within 45000 ms
Stack Trace:
org.apache.solr.common.SolrException: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:60479 within 45000 ms
at __randomizedtesting.SeedInfo.seed([871F84DD27CE2D4E:64698D48C0B4B83C]:0)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:150)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:101)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:91)
at org.apache.solr.cloud.AbstractZkTestCase.buildZooKeeper(AbstractZkTestCase.java:89)
at org.apache.solr.cloud.AbstractZkTestCase.buildZooKeeper(AbstractZkTestCase.java:83)
at org.apache.solr.cloud.AbstractDistribZkTestBase.setUp(AbstractDistribZkTestBase.java:70)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.setUp(AbstractFullDistribZkTestBase.java:200)
at org.apache.solr.client.solrj.impl.CloudSolrServerTest.setUp(CloudSolrServerTest.java:78)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:771)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:744)
Caused by: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:60479 within 45000 ms
at org.apache.solr.common.cloud.ConnectionManager.waitForConnected(ConnectionManager.java:223)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:142)
... 46 more
Build Log:
[...truncated 11578 lines...]
[junit4] Suite: org.apache.solr.client.solrj.impl.CloudSolrServerTest
[junit4] 2> 730 T17 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (true)
[junit4] 2> 742 T17 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4] 2> 745 T17 oasc.AbstractZkTestCase.<clinit> WARN TEST_HOME() does not exist - solrj test?
[junit4] 2> 752 T17 oas.SolrTestCaseJ4.setUp ###Starting testShutdown
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1394259181153
[junit4] 2> 759 T17 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 763 T18 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 862 T17 oasc.ZkTestServer.run start zk server on port:60479
[junit4] 2> 904 T17 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 931 T19 oazs.NIOServerCnxn.doIO WARN Exception causing close of session 0x0 due to java.io.IOException: ZooKeeperServer not running
[junit4] 2> 98848 T21 oazsp.FileTxnLog.commit WARN fsync-ing the write ahead log in SyncThread:0 took 95816ms which will adversely effect operation latency. See the ZooKeeper troubleshooting guide
[junit4] 2> 98850 T17 oas.SolrTestCaseJ4.tearDown ###Ending testShutdown
[junit4] 2> 98865 T19 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x144a052beb60000, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 98867 T17 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:60479 60479
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=CloudSolrServerTest -Dtests.method=testShutdown -Dtests.seed=871F84DD27CE2D4E -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=en_NZ -Dtests.timezone=Antarctica/McMurdo -Dtests.file.encoding=UTF-8
[junit4] ERROR 98.3s J0 | CloudSolrServerTest.testShutdown <<<
[junit4] > Throwable #1: org.apache.solr.common.SolrException: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:60479 within 45000 ms
[junit4] > at __randomizedtesting.SeedInfo.seed([871F84DD27CE2D4E:64698D48C0B4B83C]:0)
[junit4] > at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:150)
[junit4] > at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:101)
[junit4] > at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:91)
[junit4] > at org.apache.solr.cloud.AbstractZkTestCase.buildZooKeeper(AbstractZkTestCase.java:89)
[junit4] > at org.apache.solr.cloud.AbstractZkTestCase.buildZooKeeper(AbstractZkTestCase.java:83)
[junit4] > at org.apache.solr.cloud.AbstractDistribZkTestBase.setUp(AbstractDistribZkTestBase.java:70)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.setUp(AbstractFullDistribZkTestBase.java:200)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrServerTest.setUp(CloudSolrServerTest.java:78)
[junit4] > at java.lang.Thread.run(Thread.java:744)
[junit4] > Caused by: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:60479 within 45000 ms
[junit4] > at org.apache.solr.common.cloud.ConnectionManager.waitForConnected(ConnectionManager.java:223)
[junit4] > at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:142)
[junit4] > ... 46 more
[junit4] 2> 99072 T17 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1394259279472
[junit4] 2> 99073 T17 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 99074 T25 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 99174 T17 oasc.ZkTestServer.run start zk server on port:55541
[junit4] 2> 99175 T17 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 99230 T31 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3b437918 name:ZooKeeperConnection Watcher:127.0.0.1:55541 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 99231 T17 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 99232 T17 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 99266 T17 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 99271 T33 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2d2b19ee name:ZooKeeperConnection Watcher:127.0.0.1:55541/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 99272 T17 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 99277 T17 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 99283 T17 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 99288 T17 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 99293 T17 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 99302 T17 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 99310 T17 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 99325 T17 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 99326 T17 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 99381 T17 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml because it doesn't exist
[junit4] 2> 99381 T17 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/stopwords.txt because it doesn't exist
[junit4] 2> 99382 T17 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/protwords.txt because it doesn't exist
[junit4] 2> 99383 T17 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/currency.xml because it doesn't exist
[junit4] 2> 99383 T17 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/enumsConfig.xml because it doesn't exist
[junit4] 2> 99384 T17 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/open-exchange-rates.json because it doesn't exist
[junit4] 2> 99385 T17 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/mapping-ISOLatin1Accent.txt because it doesn't exist
[junit4] 2> 99385 T17 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/old_synonyms.txt because it doesn't exist
[junit4] 2> 99386 T17 oasc.AbstractZkTestCase.putConfig skipping /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/collection1/conf/synonyms.txt because it doesn't exist
[junit4] 2> 99759 T17 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 99960 T17 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:55573
[junit4] 2> 100042 T17 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 100043 T17 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 100044 T17 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1394259279794
[junit4] 2> 100044 T17 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1394259279794/'
[junit4] 2> 100070 T17 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1394259279794/solr.xml
[junit4] 2> 100228 T17 oasc.CoreContainer.<init> New CoreContainer 697646028
[junit4] 2> 100229 T17 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1394259279794/]
[junit4] 2> 100254 T17 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4] 2> 100255 T17 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
[junit4] 2> 100263 T17 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4] 2> 100264 T17 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 100265 T17 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 100265 T17 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 100266 T17 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 100267 T17 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 100267 T17 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 100493 T17 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 100495 T17 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 100498 T17 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 100499 T17 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55541/solr
[junit4] 2> 100517 T17 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 100518 T17 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 100526 T45 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4594e282 name:ZooKeeperConnection Watcher:127.0.0.1:55541 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 100527 T17 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 100538 T17 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 100542 T47 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@22c8c3fc name:ZooKeeperConnection Watcher:127.0.0.1:55541/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 100543 T17 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 100612 T17 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 100632 T17 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 100658 T17 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 100662 T17 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55573_
[junit4] 2> 100666 T17 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55573_
[junit4] 2> 100675 T17 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 100680 T17 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 100695 T17 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:55573_
[junit4] 2> 100696 T17 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 100706 T17 oasc.Overseer.start Overseer (id=91374176139739139-127.0.0.1:55573_-n_0000000000) starting
[junit4] 2> 100725 T17 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 100861 T49 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 100862 T17 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 100876 T49 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
[junit4] 2> 100876 T17 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 100882 T17 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 100898 T48 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 101025 T50 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
[junit4] 2> 101026 T50 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 101030 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 101032 T50 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 101037 T48 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 101040 T48 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:55573",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:55573_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 101040 T48 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 101054 T48 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 101061 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 101066 T47 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 102032 T50 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 102033 T50 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1394259279794/collection1
[junit4] 2> 102033 T50 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 102036 T50 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 102037 T50 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 102039 T50 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 102039 T50 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1394259279794/collection1/'
[junit4] 2> 102131 T50 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 102251 T50 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 102265 T50 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 102378 T50 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 102537 T50 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableIntField]. Please consult documentation how to replace it accordingly.
[junit4] 2> 102551 T50 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableLongField]. Please consult documentation how to replace it accordingly.
[junit4] 2> 102558 T50 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableFloatField]. Please consult documentation how to replace it accordingly.
[junit4] 2> 102567 T50 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableDoubleField]. Please consult documentation how to replace it accordingly.
[junit4] 2> 102920 T50 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 102921 T50 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 102928 T50 oass.IndexSchema.readSchema WARN Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 102928 T50 oass.IndexSchema.readSchema WARN Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 102966 T50 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 102974 T50 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-controljetty-1394259279794/collection1/, dataDir=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/control/data/
[junit4] 2> 102976 T50 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 103012 T50 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/control/data
[junit4] 2> 103012 T50 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/control/data/index/
[junit4] 2> 103013 T50 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/control/data/index' doesn't exist. Creating new index...
[junit4] 2> 103023 T50 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/control/data/index
[junit4] 2> 103065 T50 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@79964587 lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/control/data/index),segFN=segments_1,generation=1}
[junit4] 2> 103067 T50 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 103211 T50 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 103223 T50 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 103224 T50 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 103225 T50 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 103232 T50 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 103238 T50 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 103240 T50 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 103243 T50 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: solr.PingRequestHandler
[junit4] 2> 103267 T50 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 103288 T50 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 103289 T50 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 103291 T50 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@79964587 lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/control/data/index),segFN=segments_1,generation=1}
[junit4] 2> 103291 T50 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 103309 T50 oass.SolrIndexSearcher.<init> Opening Searcher@727b1191[collection1] main
[junit4] 2> 103340 T50 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 103340 T51 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@727b1191[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 103346 T17 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0
[junit4] 2> 103346 T54 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:55573 collection:control_collection shard:shard1
[junit4] 2> 103346 T17 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 103353 T54 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 103359 T17 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 103362 T54 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 103363 T56 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6470051 name:ZooKeeperConnection Watcher:127.0.0.1:55541/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 103363 T17 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 103365 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 103365 T17 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 103366 T54 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 103366 T54 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 103367 T48 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 103370 T17 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> ASYNC NEW_CORE C0 name=collection1 org.apache.solr.core.SolrCore@6efa0529 url=http://127.0.0.1:55573/collection1 node=127.0.0.1:55573_ C0_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:55573, core=collection1, node_name=127.0.0.1:55573_}
[junit4] 2> 103370 T54 C0 P55573 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:55573/collection1/
[junit4] 2> 103375 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 103375 T54 C0 P55573 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 103376 T54 C0 P55573 oasc.SyncStrategy.syncToMe http://127.0.0.1:55573/collection1/ has no replicas
[junit4] 2> 103376 T56 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 103376 T47 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 103376 T54 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:55573/collection1/ shard1
[junit4] 2> 103379 T54 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 103389 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 103391 T48 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 103395 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 103405 T17 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 103407 T17 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 103410 T17 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:59672
[junit4] 2> 103411 T17 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 103411 T17 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 103411 T17 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1394259283770
[junit4] 2> 103412 T17 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1394259283770/'
[junit4] 2> 103430 T17 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1394259283770/solr.xml
[junit4] 2> 103451 T17 oasc.CoreContainer.<init> New CoreContainer 1363939353
[junit4] 2> 103452 T17 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1394259283770/]
[junit4] 2> 103452 T17 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4] 2> 103453 T17 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
[junit4] 2> 103453 T17 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4] 2> 103454 T17 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 103454 T17 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 103454 T17 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 103455 T17 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 103456 T17 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 103456 T17 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 103460 T17 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 103460 T17 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 103461 T17 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 103461 T17 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55541/solr
[junit4] 2> 103462 T17 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 103463 T17 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 103465 T67 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@42bf1637 name:ZooKeeperConnection Watcher:127.0.0.1:55541 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 103465 T17 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 103472 T17 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 103474 T69 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3a52fa52 name:ZooKeeperConnection Watcher:127.0.0.1:55541/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 103474 T17 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 103479 T17 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 103497 T56 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 103497 T47 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 103497 T69 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 103541 T54 oasc.ZkController.register We are http://127.0.0.1:55573/collection1/ and leader is http://127.0.0.1:55573/collection1/
[junit4] 2> 103542 T54 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:55573
[junit4] 2> 103542 T54 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 103543 T54 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
[junit4] 2> 103543 T54 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 103545 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 103545 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 103545 T54 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 103545 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 103547 T48 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 103548 T48 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:55573",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:55573_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 103552 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 103656 T56 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 103656 T47 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 103656 T69 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 104482 T17 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59672_
[junit4] 2> 104485 T17 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59672_
[junit4] 2> 104489 T56 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 104489 T69 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 104489 T47 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 104496 T70 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 104497 T70 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 104498 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 104498 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 104499 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 104498 T70 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 104500 T48 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 104501 T48 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:59672",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:59672_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 104502 T48 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
[junit4] 2> 104502 T48 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 104505 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 104609 T47 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 104609 T56 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 104610 T69 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 105502 T70 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 105503 T70 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1394259283770/collection1
[junit4] 2> 105503 T70 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 105505 T70 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 105505 T70 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 105506 T70 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 105507 T70 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1394259283770/collection1/'
[junit4] 2> 105541 T70 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 105558 T70 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 105560 T70 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 105636 T70 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 105966 T70 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 105968 T70 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 105971 T70 oass.IndexSchema.readSchema WARN Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 105973 T70 oass.IndexSchema.readSchema WARN Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 105975 T70 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 105975 T70 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty1-1394259283770/collection1/, dataDir=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty1/
[junit4] 2> 105975 T70 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 105980 T70 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty1
[junit4] 2> 105981 T70 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty1/index/
[junit4] 2> 105981 T70 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty1/index' doesn't exist. Creating new index...
[junit4] 2> 105982 T70 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty1/index
[junit4] 2> 105989 T70 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@7200e69f lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty1/index),segFN=segments_1,generation=1}
[junit4] 2> 105990 T70 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 105991 T70 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 105991 T70 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 105992 T70 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 105992 T70 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 105992 T70 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 105993 T70 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 105993 T70 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 105993 T70 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: solr.PingRequestHandler
[junit4] 2> 105996 T70 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 106000 T70 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 106000 T70 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 106003 T70 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@7200e69f lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty1/index),segFN=segments_1,generation=1}
[junit4] 2> 106003 T70 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 106008 T70 oass.SolrIndexSearcher.<init> Opening Searcher@7b787bc1[collection1] main
[junit4] 2> 106010 T71 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7b787bc1[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 106010 T70 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 106012 T17 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0
[junit4] 2> 106012 T17 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 106012 T74 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:59672 collection:collection1 shard:shard2
[junit4] 2> 106019 T74 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 106032 T74 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 106042 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 106042 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 106042 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 106042 T74 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 106043 T74 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 106045 T48 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> ASYNC NEW_CORE C1 name=collection1 org.apache.solr.core.SolrCore@5debe52b url=http://127.0.0.1:59672/collection1 node=127.0.0.1:59672_ C1_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:59672, core=collection1, node_name=127.0.0.1:59672_}
[junit4] 2> 106043 T74 C1 P59672 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:59672/collection1/
[junit4] 2> 106060 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 106061 T74 C1 P59672 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 106061 T17 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 106061 T74 C1 P59672 oasc.SyncStrategy.syncToMe http://127.0.0.1:59672/collection1/ has no replicas
[junit4] 2> 106062 T74 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:59672/collection1/ shard2
[junit4] 2> 106062 T17 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 106062 T74 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 106071 T17 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:40121
[junit4] 2> 106075 T17 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 106081 T17 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 106082 T17 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1394259286412
[junit4] 2> 106083 T17 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1394259286412/'
[junit4] 2> 106091 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 106101 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 106129 T17 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1394259286412/solr.xml
[junit4] 2> 106152 T17 oasc.CoreContainer.<init> New CoreContainer 1520964013
[junit4] 2> 106153 T17 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1394259286412/]
[junit4] 2> 106157 T17 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4] 2> 106158 T17 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
[junit4] 2> 106168 T17 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4] 2> 106169 T17 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 106169 T17 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 106170 T17 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 106170 T17 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 106171 T17 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 106172 T17 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 106186 T17 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 106187 T17 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 106187 T17 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 106188 T17 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55541/solr
[junit4] 2> 106189 T17 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 106191 T17 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 106194 T85 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@23c61723 name:ZooKeeperConnection Watcher:127.0.0.1:55541 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 106194 T17 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 106207 T17 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 106263 T56 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 106263 T47 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 106263 T69 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 106266 T87 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7126b030 name:ZooKeeperConnection Watcher:127.0.0.1:55541/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 106269 T17 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 106275 T17 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 106294 T74 oasc.ZkController.register We are http://127.0.0.1:59672/collection1/ and leader is http://127.0.0.1:59672/collection1/
[junit4] 2> 106294 T74 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:59672
[junit4] 2> 106294 T74 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 106295 T74 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 106295 T74 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 106301 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 106302 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 106302 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 106303 T74 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 106306 T48 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 106308 T48 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:59672",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:59672_",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 106320 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 106427 T56 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 106427 T69 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 106427 T87 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 106427 T47 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 107283 T17 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40121_
[junit4] 2> 107285 T17 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:40121_
[junit4] 2> 107287 T47 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 107289 T56 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 107289 T87 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 107289 T69 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 107297 T88 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 107298 T88 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 107300 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 107300 T88 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 107300 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 107301 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 107302 T48 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 107303 T48 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:40121",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:40121_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 107303 T48 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 107304 T48 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 107307 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 107488 T56 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 107488 T47 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 107488 T87 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 107488 T69 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 108301 T88 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 108302 T88 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1394259286412/collection1
[junit4] 2> 108302 T88 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 108304 T88 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 108304 T88 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 108306 T88 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 108306 T88 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1394259286412/collection1/'
[junit4] 2> 108340 T88 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 108360 T88 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 108362 T88 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 108390 T88 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 108531 T88 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 108533 T88 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 108534 T88 oass.IndexSchema.readSchema WARN Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 108535 T88 oass.IndexSchema.readSchema WARN Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 108536 T88 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 108537 T88 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty2-1394259286412/collection1/, dataDir=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty2/
[junit4] 2> 108537 T88 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 108538 T88 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty2
[junit4] 2> 108538 T88 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty2/index/
[junit4] 2> 108538 T88 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty2/index' doesn't exist. Creating new index...
[junit4] 2> 108539 T88 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty2/index
[junit4] 2> 108541 T88 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@2a9faac lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty2/index),segFN=segments_1,generation=1}
[junit4] 2> 108541 T88 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 108543 T88 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 108544 T88 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 108544 T88 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 108544 T88 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 108551 T88 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 108552 T88 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 108553 T88 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 108553 T88 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: solr.PingRequestHandler
[junit4] 2> 108555 T88 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 108557 T88 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 108557 T88 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 108559 T88 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@2a9faac lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty2/index),segFN=segments_1,generation=1}
[junit4] 2> 108560 T88 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 108560 T88 oass.SolrIndexSearcher.<init> Opening Searcher@2fdd91d0[collection1] main
[junit4] 2> 108561 T89 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2fdd91d0[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 108561 T88 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 108562 T17 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0
[junit4] 2> 108563 T17 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 108562 T92 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:40121 collection:collection1 shard:shard1
[junit4] 2> 108565 T92 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 108571 T92 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 108574 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 108574 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 108574 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 108574 T92 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 108575 T92 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C2 name=collection1 org.apache.solr.core.SolrCore@5452a467 url=http://127.0.0.1:40121/collection1 node=127.0.0.1:40121_ C2_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:40121, core=collection1, node_name=127.0.0.1:40121_}
[junit4] 2> 108575 T92 C2 P40121 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:40121/collection1/
[junit4] 2> 108575 T92 C2 P40121 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 108575 T92 C2 P40121 oasc.SyncStrategy.syncToMe http://127.0.0.1:40121/collection1/ has no replicas
[junit4] 2> 108576 T48 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 108576 T92 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:40121/collection1/ shard1
[junit4] 2> 108576 T92 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 108581 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 108584 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 108587 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 108599 T17 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 108600 T17 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 108603 T17 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:59111
[junit4] 2> 108605 T17 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 108605 T17 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 108605 T17 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1394259288964
[junit4] 2> 108606 T17 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1394259288964/'
[junit4] 2> 108622 T17 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1394259288964/solr.xml
[junit4] 2> 108634 T17 oasc.CoreContainer.<init> New CoreContainer 1243096640
[junit4] 2> 108635 T17 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1394259288964/]
[junit4] 2> 108636 T17 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4] 2> 108636 T17 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
[junit4] 2> 108637 T17 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4] 2> 108637 T17 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 108637 T17 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 108638 T17 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 108638 T17 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 108639 T17 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 108639 T17 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 108642 T17 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 108643 T17 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 108643 T17 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 108643 T17 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55541/solr
[junit4] 2> 108644 T17 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 108644 T17 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 108647 T103 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2d53b855 name:ZooKeeperConnection Watcher:127.0.0.1:55541 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 108648 T17 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 108651 T17 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 108653 T105 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3bfa44b1 name:ZooKeeperConnection Watcher:127.0.0.1:55541/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 108653 T17 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 108658 T17 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 108691 T87 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 108692 T105 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 108691 T56 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 108691 T69 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 108693 T47 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 108735 T92 oasc.ZkController.register We are http://127.0.0.1:40121/collection1/ and leader is http://127.0.0.1:40121/collection1/
[junit4] 2> 108736 T92 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:40121
[junit4] 2> 108736 T92 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 108736 T92 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 108737 T92 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 108738 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 108738 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 108738 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 108738 T92 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 108740 T48 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 108741 T48 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:40121",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:40121_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node2"}
[junit4] 2> 108744 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 108847 T56 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 108847 T47 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 108847 T105 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 108848 T69 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 108848 T87 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 109662 T17 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59111_
[junit4] 2> 109664 T17 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59111_
[junit4] 2> 109666 T56 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 109666 T105 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 109666 T69 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 109666 T87 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 109667 T47 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 109676 T106 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 109676 T106 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 109677 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 109677 T106 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 109677 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 109678 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 109679 T48 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 109680 T48 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:59111",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:59111_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 109680 T48 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 109680 T48 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 109682 T47 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 109785 T105 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 109785 T69 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 109785 T47 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 109785 T56 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 109785 T87 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 110678 T106 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 110678 T106 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1394259288964/collection1
[junit4] 2> 110679 T106 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 110680 T106 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 110680 T106 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 110681 T106 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 110681 T106 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1394259288964/collection1/'
[junit4] 2> 110708 T106 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 110717 T106 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 110719 T106 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 110742 T106 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 110881 T106 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 110882 T106 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 110884 T106 oass.IndexSchema.readSchema WARN Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 110885 T106 oass.IndexSchema.readSchema WARN Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 110886 T106 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 110887 T106 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./org.apache.solr.client.solrj.impl.CloudSolrServerTest-jetty3-1394259288964/collection1/, dataDir=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty3/
[junit4] 2> 110887 T106 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 110888 T106 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty3
[junit4] 2> 110888 T106 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty3/index/
[junit4] 2> 110889 T106 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty3/index' doesn't exist. Creating new index...
[junit4] 2> 110889 T106 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty3/index
[junit4] 2> 110891 T106 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@76327f71 lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty3/index),segFN=segments_1,generation=1}
[junit4] 2> 110891 T106 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 110893 T106 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 110893 T106 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 110894 T106 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 110894 T106 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 110894 T106 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 110894 T106 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 110895 T106 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 110895 T106 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: solr.PingRequestHandler
[junit4] 2> 110896 T106 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 110898 T106 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 110898 T106 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 110899 T106 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@76327f71 lockFactory=NativeFSLockFactory@./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty3/index),segFN=segments_1,generation=1}
[junit4] 2> 110899 T106 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 110900 T106 oass.SolrIndexSearcher.<init> Opening Searcher@60156be5[collection1] main
[junit4] 2> 110900 T107 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@60156be5[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 110900 T106 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 110901 T17 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0
[junit4] 2> 110902 T17 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 110901 T110 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:59111 collection:collection1 shard:shard2
[junit4] 2> 110907 T110 oasc.ZkController.register We are http://127.0.0.1:59111/collection1/ and leader is http://127.0.0.1:59672/collection1/
[junit4] 2> 110908 T110 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:59111
[junit4] 2> 110908 T110 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4] 2> 110908 T110 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4] 2> ASYNC NEW_CORE C3 name=collection1 org.apache.solr.core.SolrCore@f4e8e20 url=http://127.0.0.1:59111/collection1 node=127.0.0.1:59111_ C3_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:59111, core=collection1, node_name=127.0.0.1:59111_}
[junit4] 2> 110913 T111 C3 P59111 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4] 2> 110914 T110 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 110915 T111 C3 P59111 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4] 2> 110916 T111 C3 P59111 oas
[...truncated too long message...]
t4] 2> 121034 T17 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> 121841 T47 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 121841 T47 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 121934 T69 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 121934 T69 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 122940 T105 C12 P59111 oasc.SyncStrategy.sync WARN Closed, skipping sync up.
[junit4] 2> 122947 T105 oasc.ShardLeaderElectionContext.rejoinLeaderElection Not rejoining election because CoreContainer is shutdown
[junit4] 2> 122948 T105 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@f4e8e20
[junit4] 2> 122948 T105 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=6,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=2,cumulative_deletesById=1,cumulative_deletesByQuery=2,cumulative_errors=0,transaction_logs_total_size=0,transaction_logs_total_number=5}
[junit4] 2> 122949 T105 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 122949 T105 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 122949 T105 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 122952 T105 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 122952 T105 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 122952 T105 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty3 [CachedDir<<refCount=0;path=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty3;done=false>>]
[junit4] 2> 122953 T105 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty3
[junit4] 2> 122953 T105 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty3/index [CachedDir<<refCount=0;path=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty3/index;done=false>>]
[junit4] 2> 122953 T105 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty3/index
[junit4] 2> 122954 T105 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 122954 T105 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 122955 T105 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 122955 T105 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:259)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 123029 T124 C10 P46922 oasc.SyncStrategy.sync WARN Closed, skipping sync up.
[junit4] 2> 123030 T124 oasc.ShardLeaderElectionContext.rejoinLeaderElection Not rejoining election because CoreContainer is shutdown
[junit4] 2> 123030 T124 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@ee9ae71
[junit4] 2> 123032 T124 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=6,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=2,cumulative_deletesById=1,cumulative_deletesByQuery=2,cumulative_errors=0,transaction_logs_total_size=0,transaction_logs_total_number=5}
[junit4] 2> 123032 T124 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 123032 T124 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 123033 T124 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 123035 T124 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 123036 T124 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 123036 T124 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty4 [CachedDir<<refCount=0;path=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty4;done=false>>]
[junit4] 2> 123037 T124 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty4
[junit4] 2> 123037 T124 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty4/index [CachedDir<<refCount=0;path=./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty4/index;done=false>>]
[junit4] 2> 123037 T124 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.client.solrj.impl.CloudSolrServerTest-1394259279472/jetty4/index
[junit4] 2> 123038 T124 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:259)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 123039 T124 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> NOTE: test params are: codec=Lucene41, sim=DefaultSimilarity, locale=en_NZ, timezone=Antarctica/McMurdo
[junit4] 2> NOTE: Linux 3.8.0-36-generic amd64/Oracle Corporation 1.8.0 (64-bit)/cpus=8,threads=1,free=87751480,total=155189248
[junit4] 2> NOTE: All tests run in this JVM: [TestJavaBinCodec, ContentStreamTest, CloudSolrServerTest]
[junit4] Completed on J0 in 123.58s, 2 tests, 1 error <<< FAILURES!
[...truncated 112 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:465: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:445: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:202: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:490: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1274: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:907: There were test failures: 49 suites, 281 tests, 1 error
Total time: 47 minutes 27 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.8.0-fcs-b132 -XX:+UseCompressedOops -XX:+UseG1GC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure