You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/12/18 16:21:32 UTC

[JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.8.0_20) - Build # 11768 - Failure!

Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/11768/
Java: 32bit/jdk1.8.0_20 -client -XX:+UseSerialGC (asserts: false)

1 tests failed.
FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testDistribSearch

Error Message:
expected:<...9942E65A94EC1-001/te[mpDir-003/solrj_test_core_props_shard1_replica1]> but was:<...9942E65A94EC1-001/te[stPropertyParamsForCreate-001/instanceDir-fmchl]>

Stack Trace:
org.junit.ComparisonFailure: expected:<...9942E65A94EC1-001/te[mpDir-003/solrj_test_core_props_shard1_replica1]> but was:<...9942E65A94EC1-001/te[stPropertyParamsForCreate-001/instanceDir-fmchl]>
	at __randomizedtesting.SeedInfo.seed([8219942E65A94EC1:3FF1A3612F62EFD]:0)
	at org.junit.Assert.assertEquals(Assert.java:125)
	at org.junit.Assert.assertEquals(Assert.java:147)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.checkInstanceDirs(CollectionsAPIDistributedZkTest.java:1135)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:883)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:204)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
	at sun.reflect.GeneratedMethodAccessor48.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:483)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 9884 lines...]
   [junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
   [junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/init-core-data-001
   [junit4]   2> 1891096 T6117 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (true)
   [junit4]   2> 1891096 T6117 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
   [junit4]   2> 1891102 T6117 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> 1891103 T6117 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1891104 T6118 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 1891204 T6117 oasc.ZkTestServer.run start zk server on port:50799
   [junit4]   2> 1891204 T6117 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 1891206 T6117 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1891210 T6125 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1db686b name:ZooKeeperConnection Watcher:127.0.0.1:50799 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1891210 T6117 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1891211 T6117 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 1891212 T6117 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 1891217 T6117 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 1891218 T6117 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1891220 T6128 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@15a5a05 name:ZooKeeperConnection Watcher:127.0.0.1:50799/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1891221 T6117 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1891222 T6117 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 1891222 T6117 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 1891227 T6117 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 1891231 T6117 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 1891234 T6117 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 1891238 T6117 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 1891239 T6117 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 1891244 T6117 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 1891245 T6117 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 1891249 T6117 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1891249 T6117 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1891252 T6117 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 1891252 T6117 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 1891256 T6117 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 1891257 T6117 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 1891261 T6117 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 1891261 T6117 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 1891265 T6117 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 1891266 T6117 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 1891270 T6117 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1891271 T6117 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1891275 T6117 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1891276 T6117 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1891280 T6117 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 1891281 T6117 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 1891285 T6117 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 1891286 T6117 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> Using old style solr.xml
   [junit4]   2> 1891573 T6117 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1891576 T6117 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:47474
   [junit4]   2> 1891577 T6117 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1891577 T6117 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1891578 T6117 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-002
   [junit4]   2> 1891578 T6117 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-002/'
   [junit4]   2> 1891598 T6117 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-002/solr.xml
   [junit4]   2> 1891648 T6117 oasc.CoreContainer.<init> New CoreContainer 24677580
   [junit4]   2> 1891649 T6117 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-002/]
   [junit4]   2> 1891650 T6117 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
   [junit4]   2> 1891650 T6117 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
   [junit4]   2> 1891650 T6117 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1891651 T6117 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1891651 T6117 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
   [junit4]   2> 1891652 T6117 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1891652 T6117 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1891652 T6117 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1891653 T6117 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1891653 T6117 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1891654 T6117 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=3400000&connTimeout=45000&retry=false
   [junit4]   2> 1891654 T6117 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1891654 T6117 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1891655 T6117 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1891655 T6117 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50799/solr
   [junit4]   2> 1891655 T6117 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1891656 T6117 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 1891657 T6117 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1891658 T6140 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@13b6fc5 name:ZooKeeperConnection Watcher:127.0.0.1:50799 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1891659 T6117 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1891660 T6117 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 1891662 T6117 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1891663 T6143 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@19b295c name:ZooKeeperConnection Watcher:127.0.0.1:50799/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1891663 T6117 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1891665 T6117 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 1891669 T6117 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 1891672 T6117 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
   [junit4]   2> 1891675 T6117 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
   [junit4]   2> 1891679 T6117 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
   [junit4]   2> 1891683 T6117 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 1891686 T6117 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47474_
   [junit4]   2> 1891687 T6117 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:47474_
   [junit4]   2> 1891692 T6117 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 1891695 T6117 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 1891699 T6117 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 1891703 T6117 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:47474_
   [junit4]   2> 1891704 T6117 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 1891708 T6117 oasc.Overseer.start Overseer (id=92989978420707331-127.0.0.1:47474_-n_0000000000) starting
   [junit4]   2> 1891710 T6117 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 1891717 T6117 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 1891718 T6145 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 1891719 T6117 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 1891722 T6117 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 1891725 T6117 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1891731 T6144 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 1891734 T6117 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
   [junit4]   2> 1891735 T6117 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1891736 T6117 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 1891738 T6117 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1891739 T6150 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6e2f6f name:ZooKeeperConnection Watcher:127.0.0.1:50799/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1891740 T6117 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1891740 T6117 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 1891742 T6117 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1891748 T6117 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 1891748 T6117 oasc.AbstractFullDistribZkTestBase.createJettys Creating collection1 with stateFormat=2
   [junit4]   2> 1891749 T6117 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 1891750 T6117 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1891752 T6153 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@13b0c23 name:ZooKeeperConnection Watcher:127.0.0.1:50799/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1891753 T6117 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1891753 T6117 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 1891757 T6143 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 1891764 T6144 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 0, message = {
   [junit4]   2> 	  "operation":"create",
   [junit4]   2> 	  "name":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "stateFormat":2} current state version: 0
   [junit4]   2> 1891765 T6144 oasco.ClusterStateMutator.createCollection building a new cName: collection1
   [junit4]   2> 1891766 T6144 oasco.ZkStateWriter.writePendingUpdates going to create_collection /collections/collection1/state.json
   [junit4]   2> 1891768 T6143 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1891768 T6150 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1892028 T6117 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
   [junit4]   2> 1892029 T6117 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1892030 T6117 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:46875
   [junit4]   2> 1892032 T6117 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1892032 T6117 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1892032 T6117 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-003
   [junit4]   2> 1892033 T6117 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-003/'
   [junit4]   2> 1892049 T6117 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-003/solr.xml
   [junit4]   2> 1892061 T6117 oasc.CoreContainer.<init> New CoreContainer 28548621
   [junit4]   2> 1892062 T6117 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-003/]
   [junit4]   2> 1892063 T6117 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
   [junit4]   2> 1892063 T6117 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
   [junit4]   2> 1892063 T6117 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1892064 T6117 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1892064 T6117 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
   [junit4]   2> 1892064 T6117 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1892065 T6117 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1892065 T6117 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1892066 T6117 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1892066 T6117 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1892066 T6117 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=3400000&connTimeout=45000&retry=false
   [junit4]   2> 1892067 T6117 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1892067 T6117 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1892068 T6117 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1892068 T6117 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50799/solr
   [junit4]   2> 1892069 T6117 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1892069 T6117 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 1892070 T6117 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1892072 T6165 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2795f9 name:ZooKeeperConnection Watcher:127.0.0.1:50799 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1892073 T6117 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1892074 T6117 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 1892076 T6117 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1892078 T6168 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ab6a13 name:ZooKeeperConnection Watcher:127.0.0.1:50799/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1892078 T6117 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1892084 T6117 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1893091 T6117 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46875_
   [junit4]   2> 1893093 T6117 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:46875_
   [junit4]   2> 1893098 T6117 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 1893104 T6117 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
   [junit4]   2> 1893106 T6117 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1893374 T6117 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
   [junit4]   2> 1893375 T6117 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1893377 T6117 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:57048
   [junit4]   2> 1893377 T6117 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1893378 T6117 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1893378 T6117 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-004
   [junit4]   2> 1893379 T6117 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-004/'
   [junit4]   2> 1893406 T6117 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-004/solr.xml
   [junit4]   2> 1893423 T6117 oasc.CoreContainer.<init> New CoreContainer 21716652
   [junit4]   2> 1893424 T6117 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-004/]
   [junit4]   2> 1893425 T6117 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
   [junit4]   2> 1893425 T6117 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
   [junit4]   2> 1893426 T6117 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1893426 T6117 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1893427 T6117 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
   [junit4]   2> 1893427 T6117 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1893427 T6117 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1893428 T6117 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1893428 T6117 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1893429 T6117 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1893429 T6117 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=3400000&connTimeout=45000&retry=false
   [junit4]   2> 1893430 T6117 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1893430 T6117 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1893431 T6117 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1893431 T6117 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50799/solr
   [junit4]   2> 1893432 T6117 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1893432 T6117 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 1893433 T6117 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1893436 T6181 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@c50527 name:ZooKeeperConnection Watcher:127.0.0.1:50799 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1893437 T6117 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1893437 T6117 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 1893439 T6117 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1893441 T6184 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@17991b7 name:ZooKeeperConnection Watcher:127.0.0.1:50799/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1893442 T6117 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1893450 T6117 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1894458 T6117 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:57048_
   [junit4]   2> 1894460 T6117 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:57048_
   [junit4]   2> 1894464 T6117 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 1894466 T6117 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
   [junit4]   2> 1894466 T6117 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1894728 T6117 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
   [junit4]   2> 1894728 T6117 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1894730 T6117 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:34745
   [junit4]   2> 1894731 T6117 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1894731 T6117 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1894732 T6117 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-005
   [junit4]   2> 1894732 T6117 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-005/'
   [junit4]   2> 1894747 T6117 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-005/solr.xml
   [junit4]   2> 1894761 T6117 oasc.CoreContainer.<init> New CoreContainer 1265021
   [junit4]   2> 1894762 T6117 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-005/]
   [junit4]   2> 1894762 T6117 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
   [junit4]   2> 1894763 T6117 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
   [junit4]   2> 1894763 T6117 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1894763 T6117 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1894764 T6117 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
   [junit4]   2> 1894764 T6117 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1894764 T6117 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1894765 T6117 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1894765 T6117 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1894765 T6117 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1894766 T6117 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=3400000&connTimeout=45000&retry=false
   [junit4]   2> 1894766 T6117 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1894767 T6117 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1894767 T6117 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1894767 T6117 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50799/solr
   [junit4]   2> 1894768 T6117 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1894768 T6117 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 1894769 T6117 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1894770 T6197 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1eadb73 name:ZooKeeperConnection Watcher:127.0.0.1:50799 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1894771 T6117 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1894771 T6117 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 1894773 T6117 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1894775 T6200 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@15e15bb name:ZooKeeperConnection Watcher:127.0.0.1:50799/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1894775 T6117 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1894784 T6117 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1895789 T6117 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34745_
   [junit4]   2> 1895791 T6117 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:34745_
   [junit4]   2> 1895796 T6117 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 1895800 T6117 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
   [junit4]   2> 1895801 T6117 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1896155 T6117 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 4
   [junit4]   2> 1896156 T6117 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1896159 T6117 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50450
   [junit4]   2> 1896160 T6117 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1896160 T6117 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1896161 T6117 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-006
   [junit4]   2> 1896161 T6117 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-006/'
   [junit4]   2> 1896183 T6117 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-006/solr.xml
   [junit4]   2> 1896199 T6117 oasc.CoreContainer.<init> New CoreContainer 1095776
   [junit4]   2> 1896199 T6117 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-006/]
   [junit4]   2> 1896200 T6117 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
   [junit4]   2> 1896200 T6117 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
   [junit4]   2> 1896200 T6117 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1896201 T6117 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1896201 T6117 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
   [junit4]   2> 1896201 T6117 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1896202 T6117 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1896202 T6117 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1896202 T6117 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1896203 T6117 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1896203 T6117 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=3400000&connTimeout=45000&retry=false
   [junit4]   2> 1896204 T6117 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1896204 T6117 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1896204 T6117 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1896205 T6117 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50799/solr
   [junit4]   2> 1896205 T6117 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1896205 T6117 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 1896206 T6117 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1896208 T6213 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@16e3e33 name:ZooKeeperConnection Watcher:127.0.0.1:50799 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1896208 T6117 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1896209 T6117 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 1896210 T6117 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1896211 T6216 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@bf72cd name:ZooKeeperConnection Watcher:127.0.0.1:50799/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1896211 T6117 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1896216 T6117 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1897220 T6117 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50450_
   [junit4]   2> 1897222 T6117 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50450_
   [junit4]   2> 1897226 T6117 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 1897229 T6117 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
   [junit4]   2> 1897229 T6117 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1897237 T6160 oasha.CollectionsHandler.handleCreateAction Creating Collection : replicationFactor=2&collection.configName=conf1&router.field=myOwnField&name=solrj_collection&action=CREATE&numShards=2&wt=javabin&version=2
   [junit4]   2> 1897239 T6143 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/collection-queue-work state SyncConnected
   [junit4]   2> 1897244 T6145 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
   [junit4]   2> 	  "operation":"create",
   [junit4]   2> 	  "fromApi":"true",
   [junit4]   2> 	  "name":"solrj_collection",
   [junit4]   2> 	  "replicationFactor":"2",
   [junit4]   2> 	  "collection.configName":"conf1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "router.field":"myOwnField"}
   [junit4]   2> 1897245 T6218 oasc.OverseerCollectionProcessor.processMessage WARN OverseerCollectionProcessor.processMessage : create , {
   [junit4]   2> 	  "operation":"create",
   [junit4]   2> 	  "fromApi":"true",
   [junit4]   2> 	  "name":"solrj_collection",
   [junit4]   2> 	  "replicationFactor":"2",
   [junit4]   2> 	  "collection.configName":"conf1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "router.field":"myOwnField"}
   [junit4]   2> 1897245 T6218 oasc.OverseerCollectionProcessor.createConfNode creating collections conf node /collections/solrj_collection 
   [junit4]   2> 1897246 T6218 oascc.SolrZkClient.makePath makePath: /collections/solrj_collection
   [junit4]   2> 1897248 T6143 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 1897249 T6144 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"create",
   [junit4]   2> 	  "fromApi":"true",
   [junit4]   2> 	  "name":"solrj_collection",
   [junit4]   2> 	  "replicationFactor":"2",
   [junit4]   2> 	  "collection.configName":"conf1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "router.field":"myOwnField"} current state version: 1
   [junit4]   2> 1897250 T6144 oasco.ClusterStateMutator.createCollection building a new cName: solrj_collection
   [junit4]   2> 1897250 T6200 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1897251 T6143 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1897251 T6168 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1897250 T6216 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1897250 T6184 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1897250 T6150 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1897449 T6218 oasc.OverseerCollectionProcessor.createCollection Creating SolrCores for new collection solrj_collection, shardNames [shard1, shard2] , replicationFactor : 2
   [junit4]   2> 1897449 T6218 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard1_replica1 as part of slice shard1 of collection solrj_collection on 127.0.0.1:34745_
   [junit4]   2> 1897450 T6218 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard1_replica2 as part of slice shard1 of collection solrj_collection on 127.0.0.1:46875_
   [junit4]   2> 1897450 T6218 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard2_replica1 as part of slice shard2 of collection solrj_collection on 127.0.0.1:57048_
   [junit4]   2> 1897452 T6218 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard2_replica2 as part of slice shard2 of collection solrj_collection on 127.0.0.1:50450_
   [junit4]   2> 1897452 T6191 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=solrj_collection_shard1_replica1&action=CREATE&numShards=2&collection=solrj_collection&shard=shard1&wt=javabin&version=2
   [junit4]   2> 1897452 T6162 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=solrj_collection_shard1_replica2&action=CREATE&numShards=2&collection=solrj_collection&shard=shard1&wt=javabin&version=2
   [junit4]   2> 1897452 T6175 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=solrj_collection_shard2_replica1&action=CREATE&numShards=2&collection=solrj_collection&shard=shard2&wt=javabin&version=2
   [junit4]   2> 1897454 T6191 oasc.ZkController.publish publishing core=solrj_collection_shard1_replica1 state=down collection=solrj_collection
   [junit4]   2> 1897454 T6207 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=solrj_collection_shard2_replica2&action=CREATE&numShards=2&collection=solrj_collection&shard=shard2&wt=javabin&version=2
   [junit4]   2> 1897455 T6162 oasc.ZkController.publish publishing core=solrj_collection_shard1_replica2 state=down collection=solrj_collection
   [junit4]   2> 1897456 T6143 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 1897455 T6191 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1897455 T6175 oasc.ZkController.publish publishing core=solrj_collection_shard2_replica1 state=down collection=solrj_collection
   [junit4]   2> 1897456 T6207 oasc.ZkController.publish publishing core=solrj_collection_shard2_replica2 state=down collection=solrj_collection
   [junit4]   2> 1897457 T6144 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 2, message = {
   [junit4]   2> 	  "core":"solrj_collection_shard1_replica1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:34745",
   [junit4]   2> 	  "node_name":"127.0.0.1:34745_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"solrj_collection",
   [junit4]   2> 	  "operation":"state"} current state version: 2
   [junit4]   2> 1897456 T6162 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1897458 T6144 oasco.ReplicaMutator.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"solrj_collection_shard1_replica1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:34745",
   [junit4]   2> 	  "node_name":"127.0.0.1:34745_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"solrj_collection",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 1897458 T6207 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1897457 T6175 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1897461 T6144 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 3, message = {
   [junit4]   2> 	  "core":"solrj_collection_shard1_replica2",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:46875",
   [junit4]   2> 	  "node_name":"127.0.0.1:46875_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"solrj_collection",
   [junit4]   2> 	  "operation":"state"} current state version: 2
   [junit4]   2> 1897462 T6144 oasco.ReplicaMutator.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"solrj_collection_shard1_replica2",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:46875",
   [junit4]   2> 	  "node_name":"127.0.0.1:46875_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"solrj_collection",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 1897463 T6143 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 1897464 T6144 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 2, message = {
   [junit4]   2> 	  "core":"solrj_collection_shard2_replica1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:57048",
   [junit4]   2> 	  "node_name":"127.0.0.1:57048_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"solrj_collection",
   [junit4]   2> 	  "operation":"state"} current state version: 2
   [junit4]   2> 1897465 T6144 oasco.ReplicaMutator.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"solrj_collection_shard2_replica1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:57048",
   [junit4]   2> 	  "node_name":"127.0.0.1:57048_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"solrj_collection",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 1897467 T6143 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 1897468 T6144 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 2, message = {
   [junit4]   2> 	  "core":"solrj_collection_shard2_replica2",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:50450",
   [junit4]   2> 	  "node_name":"127.0.0.1:50450_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"solrj_collection",
   [junit4]   2> 	  "operation":"state"} current state version: 2
   [junit4]   2> 1897468 T6144 oasco.ReplicaMutator.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"solrj_collection_shard2_replica2",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:50450",
   [junit4]   2> 	  "node_name":"127.0.0.1:50450_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"solrj_collection",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 1897570 T6200 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1897571 T6184 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1897571 T6168 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1897570 T6150 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1897570 T6143 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1897570 T6216 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1898456 T6191 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard1_replica1
   [junit4]   2> 1898457 T6191 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
   [junit4]   2> 1898458 T6191 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1898458 T6162 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard1_replica2
   [junit4]   2> 1898458 T6191 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
   [junit4]   2> 1898459 T6207 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard2_replica2
   [junit4]   2> 1898459 T6162 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
   [junit4]   2> 1898459 T6207 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
   [junit4]   2> 1898459 T6175 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard2_replica1
   [junit4]   2> 1898461 T6175 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
   [junit4]   2> 1898461 T6207 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1898461 T6191 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1898462 T6162 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1898462 T6175 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1898463 T6175 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
   [junit4]   2> 1898462 T6207 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
   [junit4]   2> 1898464 T6175 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1898463 T6162 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
   [junit4]   2> 1898462 T6191 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-005/solrj_collection_shard1_replica1/'
   [junit4]   2> 1898464 T6207 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1898464 T6175 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-004/solrj_collection_shard2_replica1/'
   [junit4]   2> 1898466 T6207 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-006/solrj_collection_shard2_replica2/'
   [junit4]   2> 1898465 T6162 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1898467 T6162 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-003/solrj_collection_shard1_replica2/'
   [junit4]   2> 1898492 T6191 oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
   [junit4]   2> 1898495 T6191 oasc.Config.<init> loaded config solrconfig.xml with version 0 
   [junit4]   2> 1898497 T6162 oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
   [junit4]   2> 1898501 T6162 oasc.Config.<init> loaded config solrconfig.xml with version 0 
   [junit4]   2> 1898505 T6175 oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
   [junit4]   2> 1898507 T6175 oasc.Config.<init> loaded config solrconfig.xml with version 0 
   [junit4]   2> 1898516 T6207 oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
   [junit4]   2> 1898519 T6207 oasc.Config.<init> loaded config solrconfig.xml with version 0 
   [junit4]   2> 1898522 T6162 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 1898524 T6191 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 1898541 T6175 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 1898554 T6162 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1898554 T6207 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 1898554 T6191 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1898555 T6162 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 1898556 T6191 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 1898581 T6175 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1898584 T6207 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1898585 T6175 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 1898586 T6207 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 1898603 T6191 oass.IndexSchema.readSchema [solrj_collection_shard1_replica1] Schema name=test
   [junit4]   2> 1898603 T6162 oass.IndexSchema.readSchema [solrj_collection_shard1_replica2] Schema name=test
   [junit4]   2> 1898610 T6207 oass.IndexSchema.readSchema [solrj_collection_shard2_replica2] Schema name=test
   [junit4]   2> 1898615 T6175 oass.IndexSchema.readSchema [solrj_collection_shard2_replica1] Schema name=test
   [junit4]   2> 1898843 T6207 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1898843 T6191 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1898846 T6162 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1898852 T6207 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1898854 T6162 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1898855 T6207 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1898856 T6191 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1898856 T6162 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1898868 T6191 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1898874 T6175 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1898880 T6175 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1898883 T6175 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1898886 T6162 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1898887 T6207 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1898887 T6191 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1898892 T6207 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1898892 T6191 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1898892 T6162 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1898896 T6191 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1898897 T6207 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1898898 T6207 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1898900 T6207 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1898898 T6162 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1898898 T6191 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1898901 T6207 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1898908 T6162 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1898909 T6162 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1898909 T6162 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1898908 T6191 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1898910 T6191 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1898909 T6207 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1898911 T6207 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1898911 T6162 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1898912 T6162 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1898912 T6207 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard2_replica2' using configuration from collection solrj_collection
   [junit4]   2> 1898911 T6191 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1898913 T6191 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1898913 T6175 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1898912 T6162 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard1_replica2' using configuration from collection solrj_collection
   [junit4]   2> 1898914 T6191 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard1_replica1' using configuration from collection solrj_collection
   [junit4]   2> 1898913 T6207 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1898915 T6191 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1898915 T6162 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1898917 T6191 oasc.SolrCore.<init> [solrj_collection_shard1_replica1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-005/solrj_collection_shard1_replica1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-005/solrj_collection_shard1_replica1/data/
   [junit4]   2> 1898916 T6207 oasc.SolrCore.<init> [solrj_collection_shard2_replica2] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-006/solrj_collection_shard2_replica2/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-006/solrj_collection_shard2_replica2/data/
   [junit4]   2> 1898918 T6175 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1898917 T6162 oasc.SolrCore.<init> [solrj_collection_shard1_replica2] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-003/solrj_collection_shard1_replica2/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-003/solrj_collection_shard1_replica2/data/
   [junit4]   2> 1898918 T6191 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1be2f3e
   [junit4]   2> 1898919 T6162 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1be2f3e
   [junit4]   2> 1898920 T6207 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1be2f3e
   [junit4]   2> 1898921 T6175 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1898922 T6191 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-005/solrj_collection_shard1_replica1/data
   [junit4]   2> 1898922 T6207 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-006/solrj_collection_shard2_replica2/data
   [junit4]   2> 1898922 T6175 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1898923 T6175 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1898923 T6207 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-006/solrj_collection_shard2_replica2/data/index/
   [junit4]   2> 1898923 T6191 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-005/solrj_collection_shard1_replica1/data/index/
   [junit4]   2> 1898923 T6162 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-003/solrj_collection_shard1_replica2/data
   [junit4]   2> 1898925 T6191 oasc.SolrCore.initIndex WARN [solrj_collection_shard1_replica1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-005/solrj_collection_shard1_replica1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 1898924 T6207 oasc.SolrCore.initIndex WARN [solrj_collection_shard2_replica2] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-006/solrj_collection_shard2_replica2/data/index' doesn't exist. Creating new index...
   [junit4]   2> 1898924 T6175 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1898926 T6191 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-005/solrj_collection_shard1_replica1/data/index
   [junit4]   2> 1898927 T6175 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1898928 T6175 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1898928 T6175 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard2_replica1' using configuration from collection solrj_collection
   [junit4]   2> 1898929 T6175 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1898929 T6175 oasc.SolrCore.<init> [solrj_collection_shard2_replica1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-004/solrj_collection_shard2_replica1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-004/solrj_collection_shard2_replica1/data/
   [junit4]   2> 1898930 T6175 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1be2f3e
   [junit4]   2> 1898931 T6175 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-004/solrj_collection_shard2_replica1/data
   [junit4]   2> 1898931 T6175 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-004/solrj_collection_shard2_replica1/data/index/
   [junit4]   2> 1898932 T6175 oasc.SolrCore.initIndex WARN [solrj_collection_shard2_replica1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-004/solrj_collection_shard2_replica1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 1898933 T6175 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-004/solrj_collection_shard2_replica1/data/index
   [junit4]   2> 1898933 T6175 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=19, maxMergeAtOnceExplicit=49, maxMergedSegmentMB=77.87890625, floorSegmentMB=1.6240234375, forceMergeDeletesPctAllowed=18.87818731910226, segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 1898925 T6162 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-003/solrj_collection_shard1_replica2/data/index/
   [junit4]   2> 1898927 T6191 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=19, maxMergeAtOnceExplicit=49, maxMergedSegmentMB=77.87890625, floorSegmentMB=1.6240234375, forceMergeDeletesPctAllowed=18.87818731910226, segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 1898935 T6175 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@187f848 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1ef0897),segFN=segments_1,generation=1}
   [junit4]   2> 1898936 T6191 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@dc31bf lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@afcfe4),segFN=segments_1,generation=1}
   [junit4]   2> 1898936 T6191 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1898927 T6207 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-006/solrj_collection_shard2_replica2/data/index
   [junit4]   2> 1898936 T6175 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1898935 T6162 oasc.SolrCore.initIndex WARN [solrj_collection_shard1_replica2] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-003/solrj_collection_shard1_replica2/data/index' doesn't exist. Creating new index...
   [junit4]   2> 1898937 T6207 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=19, maxMergeAtOnceExplicit=49, maxMergedSegmentMB=77.87890625, floorSegmentMB=1.6240234375, forceMergeDeletesPctAllowed=18.87818731910226, segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 1898938 T6162 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-003/solrj_collection_shard1_replica2/data/index
   [junit4]   2> 1898939 T6162 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=19, maxMergeAtOnceExplicit=49, maxMergedSegmentMB=77.87890625, floorSegmentMB=1.6240234375, forceMergeDeletesPctAllowed=18.87818731910226, segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 1898940 T6162 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@15afcaa lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@14a30cc),segFN=segments_1,generation=1}
   [junit4]   2> 1898941 T6162 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1898943 T6191 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1898944 T6191 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1898944 T6175 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1898945 T6191 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1898945 T6175 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1898945 T6191 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1898946 T6175 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1898946 T6191 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1898947 T6162 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1898947 T6175 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1898948 T6162 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1898947 T6207 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@1a8592a lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@ff84d),segFN=segments_1,generation=1}
   [junit4]   2> 1898949 T6207 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1898947 T6191 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1898948 T6162 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1898948 T6175 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1898950 T6191 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1898950 T6162 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1898951 T6191 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1898951 T6175 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1898952 T6191 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1898951 T6162 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1898953 T6162 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1898954 T6162 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1898954 T6162 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1898954 T6162 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1898955 T6162 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1898956 T6175 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1898956 T6191 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1898956 T6175 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1898956 T6162 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1898957 T6207 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1898958 T6162 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1898957 T6191 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1898957 T6175 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1898958 T6162 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1898958 T6207 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1898959 T6175 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1898959 T6191 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1898960 T6207 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1898960 T6162 oasc.RequestHandlers.initHandlersFromConfig created /config: org.apache.solr.handler.SolrConfigHandler
   [junit4]   2> 1898961 T6207 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1898961 T6191 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1898960 T6175 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1898962 T6162 oasc.RequestHandlers.initHandlersFromConfig created /schema: org.apache.solr.handler.SchemaHandler
   [junit4]   2> 1898962 T6175 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1898962 T6207 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1898963 T6175 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1898963 T6207 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1898964 T6175 oasc.RequestHandlers.initHandlersFromConfig created /config: org.apache.solr.handler.SolrConfigHandler
   [junit4]   2> 1898963 T6162 oasc.RequestHandlers.initHandlersFromConfig created /replication: org.apache.solr.handler.ReplicationHandler
   [junit4]   2> 1898962 T6191 oasc.RequestHandlers.initHandlersFromConfig created /config: org.apache.solr.handler.SolrConfigHandler
   [junit4]   2> 1898965 T6162 oasc.RequestHandlers.initHandlersFromConfig created /get: org.apache.solr.handler.RealTimeGetHandler
   [junit4]   2> 1898964 T6175 oasc.RequestHandlers.initHandlersFromConfig created /schema: org.apache.solr.handler.SchemaHandler
   [junit4]   2> 1898964 T6207 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1898965 T6162 oasc.RequestHandlers.initHandlersFromConfig created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
   [junit4]   2> 1898965 T6191 oasc.RequestHandlers.initHandlersFromConfig created /schema: org.apache.solr.handler.SchemaHandler
   [junit4]   2> 1898966 T6175 oasc.RequestHandlers.initHandlersFromConfig created /replication: org.apache.solr.handler.ReplicationHandler
   [junit4]   2> 1898966 T6207 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1898967 T6207 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1898967 T6191 oasc.RequestHandlers.initHandlersFromConfig created /replication: org.apache.solr.handler.ReplicationHandler
   [junit4]   2> 1898967 T6162 oasc.RequestHandlers.initHandlersFromConfig created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
   [junit4]   2> 1898968 T6207 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1898967 T6175 oasc.RequestHandlers.initHandlersFromConfig created /get: org.apache.solr.handler.RealTimeGetHandler
   [junit4]   2> 1898969 T6207 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1898969 T6162 oasc.RequestHandlers.initHandlersFromConfig created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
   [junit4]   2> 1898969 T6191 oasc.RequestHandlers.initHandlersFromConfig created /get: org.apache.solr.handler.RealTimeGetHandler
   [junit4]   2> 1898970 T6207 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1898970 T6175 oasc.RequestHandlers.initHandlersFromConfig created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
   [junit4]   2> 1898971 T6207 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1898971 T6191 oasc.RequestHandlers.initHandlersFromConfig created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
   [junit4]   2> 1898971 T6162 oasc.RequestHandlers.initHandlersFromConfig created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
   [junit4]   2> 1898972 T6207 oasc.RequestHandlers.initHandlersFromConfig created /config: org.apache.solr.handler.SolrConfigHandler
   [junit4]   2> 1898972 T6175 oasc.RequestHandlers.initHandlersFromConfig created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
   [junit4]   2> 1898973 T6162 oasc.RequestHandlers.initHandlersFromConfig created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
   [junit4]   2> 1898973 T6191 oasc.RequestHandlers.initHandlersFromConfig created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
   [junit4]   2> 1898974 T6162 oasc.RequestHandlers.initHandlersFromConfig created /admin/properties: org.apache.solr.handler.admin.PropertiesRequestHandler
   [junit4]   2> 1898974 T6175 oasc.RequestHandlers.initHandlersFromConfig created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
   [junit4]   2> 1898975 T6162 oasc.RequestHandlers.initHandlersFromConfig created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
   [junit4]   2> 1898974 T6207 oasc.RequestHandlers.initHandlersFromConfig created /schema: org.apache.solr.handler.SchemaHandler
   [junit4]   2> 1898976 T6175 oasc.RequestHandlers.initHandlersFromConfig created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
   [junit4]   2> 1898975 T6191 oasc.RequestHandlers.initHandlersFromConfig created /admin/mbeans: org.apache.solr

[...truncated too long message...]

ementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 1952205 T6117 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 1952205 T6117 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-006/awholynewcollection_0_shard1_replica1/data [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-006/awholynewcollection_0_shard1_replica1/data;done=false>>]
   [junit4]   2> 1952205 T6117 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-006/awholynewcollection_0_shard1_replica1/data
   [junit4]   2> 1952206 T6117 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-006/awholynewcollection_0_shard1_replica1/data/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-006/awholynewcollection_0_shard1_replica1/data/index;done=false>>]
   [junit4]   2> 1952206 T6117 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-006/awholynewcollection_0_shard1_replica1/data/index
   [junit4]   2> 1952207 T6117 oasc.Overseer.close Overseer (id=92989978420707341-127.0.0.1:50450_-n_0000000004) closing
   [junit4]   2> 1952207 T6386 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:50450_
   [junit4]   2> 1953709 T6323 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 1953732 T6117 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
   [junit4]   2> 1958721 T6117 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
   [junit4]   2> 1958724 T6117 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:50799 50799
   [junit4]   2> 1959292 T6317 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:50799 50799
   [junit4]   2> 1959295 T6317 oasc.ZkTestServer$ZKServerMain.runFromConfig WARN Watch limit violations: 
   [junit4]   2> 	Maximum concurrent children watches above limit:
   [junit4]   2> 	
   [junit4]   2> 		4	/solr/overseer/queue
   [junit4]   2> 		4	/solr/overseer/collection-queue-work
   [junit4]   2> 	
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=CollectionsAPIDistributedZkTest -Dtests.method=testDistribSearch -Dtests.seed=8219942E65A94EC1 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=nl -Dtests.timezone=America/Halifax -Dtests.asserts=false -Dtests.file.encoding=ISO-8859-1
   [junit4] FAILURE 68.2s J0 | CollectionsAPIDistributedZkTest.testDistribSearch <<<
   [junit4]    > Throwable #1: org.junit.ComparisonFailure: expected:<...9942E65A94EC1-001/te[mpDir-003/solrj_test_core_props_shard1_replica1]> but was:<...9942E65A94EC1-001/te[stPropertyParamsForCreate-001/instanceDir-fmchl]>
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([8219942E65A94EC1:3FF1A3612F62EFD]:0)
   [junit4]    > 	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.checkInstanceDirs(CollectionsAPIDistributedZkTest.java:1135)
   [junit4]    > 	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:883)
   [junit4]    > 	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:204)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 1959323 T6117 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001
   [junit4]   2> 68234 T6116 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene50): {}, docValues:{}, sim=DefaultSimilarity, locale=nl, timezone=America/Halifax
   [junit4]   2> NOTE: Linux 3.13.0-43-generic i386/Oracle Corporation 1.8.0_20 (32-bit)/cpus=8,threads=1,free=59152008,total=265080832
   [junit4]   2> NOTE: All tests run in this JVM: [TestCollectionAPI, TestModifyConfFiles, SuggesterFSTTest, AssignTest, UUIDFieldTest, DocValuesTest, HdfsChaosMonkeySafeLeaderTest, EnumFieldTest, TestLazyCores, AliasIntegrationTest, HdfsDirectoryTest, TestShortCircuitedRequests, TestNoOpRegenerator, TestCustomSort, TestFunctionQuery, TestCursorMarkWithoutUniqueKey, TestRawResponseWriter, TestInitParams, TestDefaultSearchFieldResource, TestArbitraryIndexDir, CoreContainerCoreInitFailuresTest, RequestHandlersTest, LeaderInitiatedRecoveryOnCommitTest, TestBulkSchemaConcurrent, DirectUpdateHandlerTest, SimpleFacetsTest, OpenExchangeRatesOrgProviderTest, TestFileDictionaryLookup, SoftAutoCommitTest, TestManagedSchemaDynamicFieldResource, PeerSyncTest, XmlUpdateRequestHandlerTest, OverseerTest, PluginInfoTest, AddSchemaFieldsUpdateProcessorFactoryTest, DistributedIntervalFacetingTest, TestStressVersions, TestDFRSimilarityFactory, SolrCoreCheckLockOnStartupTest, NumericFieldsTest, AnalysisAfterCoreReloadTest, TestCoreContainer, TestLMDirichletSimilarityFactory, HdfsUnloadDistributedZkTest, DistributedQueueTest, TestTolerantSearch, TestClusterStateMutator, ModifyConfFileTest, TestBinaryField, VMParamsZkACLAndCredentialsProvidersTest, LegacyHTMLStripCharFilterTest, QueryElevationComponentTest, TestSolr4Spatial2, TestConfigOverlay, CustomCollectionTest, TestQueryUtils, TestRequestStatusCollectionAPI, TestRandomDVFaceting, SolrIndexConfigTest, TestHighFrequencyDictionaryFactory, FacetPivotSmallTest, SliceStateTest, DistributedSpellCheckComponentTest, TestAnalyzedSuggestions, OutOfBoxZkACLAndCredentialsProvidersTest, TestSweetSpotSimilarityFactory, UniqFieldsUpdateProcessorFactoryTest, ParsingFieldUpdateProcessorsTest, CoreAdminHandlerTest, TestImplicitCoreProperties, TestSearcherReuse, DistributedFacetPivotWhiteBoxTest, CacheHeaderTest, ZkStateWriterTest, PreAnalyzedUpdateProcessorTest, HdfsLockFactoryTest, TestSchemaResource, MultiThreadedOCPTest, TestCSVLoader, TestPartialUpdateDeduplication, MinimalSchemaTest, TestManagedSynonymFilterFactory, TestIndexSearcher, RecoveryZkTest, TestWriterPerf, MergeStrategyTest, SortByFunctionTest, TestIntervalFaceting, TestMissingGroups, CloudMLTQParserTest, TestFuzzyAnalyzedSuggestions, ZkControllerTest, TestDynamicFieldCollectionResource, TestSort, HttpPartitionTest, TestMaxScoreQueryParser, SystemInfoHandlerTest, HighlighterConfigTest, DirectSolrConnectionTest, SuggesterWFSTTest, TestSortingResponseWriter, TestAtomicUpdateErrorCases, CircularListTest, DistanceFunctionTest, TestConfigSets, DistributedFacetPivotSmallTest, ExternalCollectionsTest, DistributedQueryElevationComponentTest, NoCacheHeaderTest, BasicDistributedZkTest, UnloadDistributedZkTest, CollectionsAPIDistributedZkTest]
   [junit4] Completed on J0 in 68.53s, 1 test, 1 failure <<< FAILURES!

[...truncated 703 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:519: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:467: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:61: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:187: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:510: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1349: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:956: There were test failures: 452 suites, 1846 tests, 1 failure, 32 ignored (22 assumptions)

Total time: 85 minutes 3 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 32bit/jdk1.8.0_20 -client -XX:+UseSerialGC (asserts: false)
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



Re: [JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.8.0_20) - Build # 11768 - Failure!

Posted by Anshum Gupta <an...@anshumgupta.net>.
That didn't fix the issue. Seems like there's something else going on here.

On Thu, Dec 18, 2014 at 9:17 AM, Shalin Shekhar Mangar <
shalinmangar@gmail.com> wrote:
>
> I committed a fix. We should be comparing canonical paths, not absolute
> paths.
>
> On Thu, Dec 18, 2014 at 3:21 PM, Policeman Jenkins Server <
> jenkins@thetaphi.de> wrote:
>>
>> Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/11768/
>> Java: 32bit/jdk1.8.0_20 -client -XX:+UseSerialGC (asserts: false)
>>
>> 1 tests failed.
>> FAILED:
>> org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testDistribSearch
>>
>> Error Message:
>> expected:<...9942E65A94EC1-001/te[mpDir-003/solrj_test_core_props_shard1_replica1]>
>> but
>> was:<...9942E65A94EC1-001/te[stPropertyParamsForCreate-001/instanceDir-fmchl]>
>>
>> Stack Trace:
>> org.junit.ComparisonFailure:
>> expected:<...9942E65A94EC1-001/te[mpDir-003/solrj_test_core_props_shard1_replica1]>
>> but
>> was:<...9942E65A94EC1-001/te[stPropertyParamsForCreate-001/instanceDir-fmchl]>
>>         at
>> __randomizedtesting.SeedInfo.seed([8219942E65A94EC1:3FF1A3612F62EFD]:0)
>>         at org.junit.Assert.assertEquals(Assert.java:125)
>>         at org.junit.Assert.assertEquals(Assert.java:147)
>>         at
>> org.apache.solr.cloud.CollectionsAPIDistributedZkTest.checkInstanceDirs(CollectionsAPIDistributedZkTest.java:1135)
>>         at
>> org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:883)
>>         at
>> org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:204)
>>         at
>> org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
>>         at sun.reflect.GeneratedMethodAccessor48.invoke(Unknown Source)
>>         at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>         at java.lang.reflect.Method.invoke(Method.java:483)
>>         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
>>         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
>>         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
>>         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
>>         at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
>>         at
>> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
>>         at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>>         at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>>         at
>> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
>>         at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
>>         at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>>         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>>         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
>>         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
>>         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
>>         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
>>         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
>>         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
>>         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
>>         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>>         at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
>>         at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>>         at
>> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
>>         at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>>         at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>>         at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>>         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>>         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>>         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>>         at
>> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
>>         at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>>         at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
>>         at
>> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
>>         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>>         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
>>         at java.lang.Thread.run(Thread.java:745)
>>
>>
>>
>>
>> Build Log:
>> [...truncated 9884 lines...]
>>    [junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
>>    [junit4]   2> Creating dataDir:
>> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/init-core-data-001
>>    [junit4]   2> 1891096 T6117 oas.SolrTestCaseJ4.buildSSLConfig
>> Randomized ssl (false) and clientAuth (true)
>>    [junit4]   2> 1891096 T6117
>> oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext
>> system property: /
>>    [junit4]   2> 1891102 T6117 oas.SolrTestCaseJ4.setUp ###Starting
>> testDistribSearch
>>    [junit4]   2> 1891103 T6117 oasc.ZkTestServer.run STARTING ZK TEST
>> SERVER
>>    [junit4]   1> client port:0.0.0.0/0.0.0.0:0
>>    [junit4]   2> 1891104 T6118
>> oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
>>    [junit4]   2> 1891204 T6117 oasc.ZkTestServer.run start zk server on
>> port:50799
>>    [junit4]   2> 1891204 T6117
>> oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
>> ZkCredentialsProvider
>>    [junit4]   2> 1891206 T6117 oascc.ConnectionManager.waitForConnected
>> Waiting for client to connect to ZooKeeper
>>    [junit4]   2> 1891210 T6125 oascc.ConnectionManager.process Watcher
>> org.apache.solr.common.cloud.ConnectionManager@1db686b
>> name:ZooKeeperConnection Watcher:127.0.0.1:50799 got event WatchedEvent
>> state:SyncConnected type:None path:null path:null type:None
>>    [junit4]   2> 1891210 T6117 oascc.ConnectionManager.waitForConnected
>> Client is connected to ZooKeeper
>>    [junit4]   2> 1891211 T6117 oascc.SolrZkClient.createZkACLProvider
>> Using default ZkACLProvider
>>    [junit4]   2> 1891212 T6117 oascc.SolrZkClient.makePath makePath: /solr
>>    [junit4]   2> 1891217 T6117
>> oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
>> ZkCredentialsProvider
>>    [junit4]   2> 1891218 T6117 oascc.ConnectionManager.waitForConnected
>> Waiting for client to connect to ZooKeeper
>>    [junit4]   2> 1891220 T6128 oascc.ConnectionManager.process Watcher
>> org.apache.solr.common.cloud.ConnectionManager@15a5a05
>> name:ZooKeeperConnection Watcher:127.0.0.1:50799/solr got event
>> WatchedEvent state:SyncConnected type:None path:null path:null type:None
>>    [junit4]   2> 1891221 T6117 oascc.ConnectionManager.waitForConnected
>> Client is connected to ZooKeeper
>>    [junit4]   2> 1891222 T6117 oascc.SolrZkClient.createZkACLProvider
>> Using default ZkACLProvider
>>    [junit4]   2> 1891222 T6117 oascc.SolrZkClient.makePath makePath:
>> /collections/collection1
>>    [junit4]   2> 1891227 T6117 oascc.SolrZkClient.makePath makePath:
>> /collections/collection1/shards
>>    [junit4]   2> 1891231 T6117 oascc.SolrZkClient.makePath makePath:
>> /collections/control_collection
>>    [junit4]   2> 1891234 T6117 oascc.SolrZkClient.makePath makePath:
>> /collections/control_collection/shards
>>    [junit4]   2> 1891238 T6117 oasc.AbstractZkTestCase.putConfig put
>> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml
>> to /configs/conf1/solrconfig.xml
>>    [junit4]   2> 1891239 T6117 oascc.SolrZkClient.makePath makePath:
>> /configs/conf1/solrconfig.xml
>>    [junit4]   2> 1891244 T6117 oasc.AbstractZkTestCase.putConfig put
>> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml
>> to /configs/conf1/schema.xml
>>    [junit4]   2> 1891245 T6117 oascc.SolrZkClient.makePath makePath:
>> /configs/conf1/schema.xml
>>    [junit4]   2> 1891249 T6117 oasc.AbstractZkTestCase.putConfig put
>> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml
>> to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
>>    [junit4]   2> 1891249 T6117 oascc.SolrZkClient.makePath makePath:
>> /configs/conf1/solrconfig.snippet.randomindexconfig.xml
>>    [junit4]   2> 1891252 T6117 oasc.AbstractZkTestCase.putConfig put
>> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt
>> to /configs/conf1/stopwords.txt
>>    [junit4]   2> 1891252 T6117 oascc.SolrZkClient.makePath makePath:
>> /configs/conf1/stopwords.txt
>>    [junit4]   2> 1891256 T6117 oasc.AbstractZkTestCase.putConfig put
>> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt
>> to /configs/conf1/protwords.txt
>>    [junit4]   2> 1891257 T6117 oascc.SolrZkClient.makePath makePath:
>> /configs/conf1/protwords.txt
>>    [junit4]   2> 1891261 T6117 oasc.AbstractZkTestCase.putConfig put
>> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml
>> to /configs/conf1/currency.xml
>>    [junit4]   2> 1891261 T6117 oascc.SolrZkClient.makePath makePath:
>> /configs/conf1/currency.xml
>>    [junit4]   2> 1891265 T6117 oasc.AbstractZkTestCase.putConfig put
>> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml
>> to /configs/conf1/enumsConfig.xml
>>    [junit4]   2> 1891266 T6117 oascc.SolrZkClient.makePath makePath:
>> /configs/conf1/enumsConfig.xml
>>    [junit4]   2> 1891270 T6117 oasc.AbstractZkTestCase.putConfig put
>> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json
>> to /configs/conf1/open-exchange-rates.json
>>    [junit4]   2> 1891271 T6117 oascc.SolrZkClient.makePath makePath:
>> /configs/conf1/open-exchange-rates.json
>>    [junit4]   2> 1891275 T6117 oasc.AbstractZkTestCase.putConfig put
>> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt
>> to /configs/conf1/mapping-ISOLatin1Accent.txt
>>    [junit4]   2> 1891276 T6117 oascc.SolrZkClient.makePath makePath:
>> /configs/conf1/mapping-ISOLatin1Accent.txt
>>    [junit4]   2> 1891280 T6117 oasc.AbstractZkTestCase.putConfig put
>> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt
>> to /configs/conf1/old_synonyms.txt
>>    [junit4]   2> 1891281 T6117 oascc.SolrZkClient.makePath makePath:
>> /configs/conf1/old_synonyms.txt
>>    [junit4]   2> 1891285 T6117 oasc.AbstractZkTestCase.putConfig put
>> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt
>> to /configs/conf1/synonyms.txt
>>    [junit4]   2> 1891286 T6117 oascc.SolrZkClient.makePath makePath:
>> /configs/conf1/synonyms.txt
>>    [junit4]   2> Using old style solr.xml
>>    [junit4]   2> 1891573 T6117 oejs.Server.doStart jetty-8.1.10.v20130312
>>    [junit4]   2> 1891576 T6117 oejs.AbstractConnector.doStart Started
>> SelectChannelConnector@127.0.0.1:47474
>>    [junit4]   2> 1891577 T6117 oass.SolrDispatchFilter.init
>> SolrDispatchFilter.init()
>>    [junit4]   2> 1891577 T6117 oasc.SolrResourceLoader.locateSolrHome
>> JNDI not configured for solr (NoInitialContextEx)
>>    [junit4]   2> 1891578 T6117 oasc.SolrResourceLoader.locateSolrHome
>> using system property solr.solr.home:
>> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-002
>>    [junit4]   2> 1891578 T6117 oasc.SolrResourceLoader.<init> new
>> SolrResourceLoader for directory:
>> '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-002/'
>>    [junit4]   2> 1891598 T6117 oasc.ConfigSolr.fromFile Loading container
>> configuration from
>> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-002/solr.xml
>>    [junit4]   2> 1891648 T6117 oasc.CoreContainer.<init> New
>> CoreContainer 24677580
>>    [junit4]   2> 1891649 T6117 oasc.CoreContainer.load Loading cores into
>> CoreContainer
>> [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-002/]
>>    [junit4]   2> 1891650 T6117 oashc.HttpShardHandlerFactory.getParameter
>> Setting socketTimeout to: 120000
>>    [junit4]   2> 1891650 T6117 oashc.HttpShardHandlerFactory.getParameter
>> Setting urlScheme to: null
>>    [junit4]   2> 1891650 T6117 oashc.HttpShardHandlerFactory.getParameter
>> Setting connTimeout to: 15000
>>    [junit4]   2> 1891651 T6117 oashc.HttpShardHandlerFactory.getParameter
>> Setting maxConnectionsPerHost to: 20
>>    [junit4]   2> 1891651 T6117 oashc.HttpShardHandlerFactory.getParameter
>> Setting maxConnections to: 10000
>>    [junit4]   2> 1891652 T6117 oashc.HttpShardHandlerFactory.getParameter
>> Setting corePoolSize to: 0
>>    [junit4]   2> 1891652 T6117 oashc.HttpShardHandlerFactory.getParameter
>> Setting maximumPoolSize to: 2147483647
>>    [junit4]   2> 1891652 T6117 oashc.HttpShardHandlerFactory.getParameter
>> Setting maxThreadIdleTime to: 5
>>    [junit4]   2> 1891653 T6117 oashc.HttpShardHandlerFactory.getParameter
>> Setting sizeOfQueue to: -1
>>    [junit4]   2> 1891653 T6117 oashc.HttpShardHandlerFactory.getParameter
>> Setting fairnessPolicy to: false
>>    [junit4]   2> 1891654 T6117 oasu.UpdateShardHandler.<init> Creating
>> UpdateShardHandler HTTP client with params:
>> socketTimeout=3400000&connTimeout=45000&retry=false
>>    [junit4]   2> 1891654 T6117 oasl.LogWatcher.createWatcher SLF4J impl
>> is org.slf4j.impl.Log4jLoggerFactory
>>    [junit4]   2> 1891654 T6117 oasl.LogWatcher.newRegisteredLogWatcher
>> Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
>>    [junit4]   2> 1891655 T6117 oasc.CoreContainer.load Host Name:
>> 127.0.0.1
>>    [junit4]   2> 1891655 T6117 oasc.ZkContainer.initZooKeeper Zookeeper
>> client=127.0.0.1:50799/solr
>>    [junit4]   2> 1891655 T6117 oasc.ZkController.checkChrootPath zkHost
>> includes chroot
>>    [junit4]   2> 1891656 T6117
>> oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
>> ZkCredentialsProvider
>>    [junit4]   2> 1891657 T6117 oascc.ConnectionManager.waitForConnected
>> Waiting for client to connect to ZooKeeper
>>    [junit4]   2> 1891658 T6140 oascc.ConnectionManager.process Watcher
>> org.apache.solr.common.cloud.ConnectionManager@13b6fc5
>> name:ZooKeeperConnection Watcher:127.0.0.1:50799 got event WatchedEvent
>> state:SyncConnected type:None path:null path:null type:None
>>    [junit4]   2> 1891659 T6117 oascc.ConnectionManager.waitForConnected
>> Client is connected to ZooKeeper
>>    [junit4]   2> 1891660 T6117 oascc.SolrZkClient.createZkACLProvider
>> Using default ZkACLProvider
>>    [junit4]   2> 1891662 T6117 oascc.ConnectionManager.waitForConnected
>> Waiting for client to connect to ZooKeeper
>>    [junit4]   2> 1891663 T6143 oascc.ConnectionManager.process Watcher
>> org.apache.solr.common.cloud.ConnectionManager@19b295c
>> name:ZooKeeperConnection Watcher:127.0.0.1:50799/solr got event
>> WatchedEvent state:SyncConnected type:None path:null path:null type:None
>>    [junit4]   2> 1891663 T6117 oascc.ConnectionManager.waitForConnected
>> Client is connected to ZooKeeper
>>    [junit4]   2> 1891665 T6117 oascc.SolrZkClient.makePath makePath:
>> /overseer/queue
>>    [junit4]   2> 1891669 T6117 oascc.SolrZkClient.makePath makePath:
>> /overseer/collection-queue-work
>>    [junit4]   2> 1891672 T6117 oascc.SolrZkClient.makePath makePath:
>> /overseer/collection-map-running
>>    [junit4]   2> 1891675 T6117 oascc.SolrZkClient.makePath makePath:
>> /overseer/collection-map-completed
>>    [junit4]   2> 1891679 T6117 oascc.SolrZkClient.makePath makePath:
>> /overseer/collection-map-failure
>>    [junit4]   2> 1891683 T6117 oascc.SolrZkClient.makePath makePath:
>> /live_nodes
>>    [junit4]   2> 1891686 T6117 oasc.ZkController.createEphemeralLiveNode
>> Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47474_
>>    [junit4]   2> 1891687 T6117 oascc.SolrZkClient.makePath makePath:
>> /live_nodes/127.0.0.1:47474_
>>    [junit4]   2> 1891692 T6117 oascc.SolrZkClient.makePath makePath:
>> /overseer_elect
>>    [junit4]   2> 1891695 T6117 oascc.SolrZkClient.makePath makePath:
>> /overseer_elect/election
>>    [junit4]   2> 1891699 T6117 oasc.Overseer.close Overseer (id=null)
>> closing
>>    [junit4]   2> 1891703 T6117
>> oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader
>> 127.0.0.1:47474_
>>    [junit4]   2> 1891704 T6117 oascc.SolrZkClient.makePath makePath:
>> /overseer_elect/leader
>>    [junit4]   2> 1891708 T6117 oasc.Overseer.start Overseer
>> (id=92989978420707331-127.0.0.1:47474_-n_0000000000) starting
>>    [junit4]   2> 1891710 T6117 oascc.SolrZkClient.makePath makePath:
>> /overseer/queue-work
>>    [junit4]   2> 1891717 T6117
>> oasc.OverseerAutoReplicaFailoverThread.<init> Starting
>> OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000
>> autoReplicaFailoverWaitAfterExpiration=30000
>> autoReplicaFailoverBadNodeExpiration=60000
>>    [junit4]   2> 1891718 T6145 oasc.OverseerCollectionProcessor.run
>> Process current queue of collection creations
>>    [junit4]   2> 1891719 T6117 oascc.SolrZkClient.makePath makePath:
>> /clusterstate.json
>>    [junit4]   2> 1891722 T6117 oascc.SolrZkClient.makePath makePath:
>> /aliases.json
>>    [junit4]   2> 1891725 T6117
>> oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster
>> state from ZooKeeper...
>>    [junit4]   2> 1891731 T6144 oasc.Overseer$ClusterStateUpdater.run
>> Starting to work on the main queue
>>    [junit4]   2> 1891734 T6117 oass.SolrDispatchFilter.init
>> user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
>>    [junit4]   2> 1891735 T6117 oass.SolrDispatchFilter.init
>> SolrDispatchFilter.init() done
>>    [junit4]   2> 1891736 T6117
>> oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
>> ZkCredentialsProvider
>>    [junit4]   2> 1891738 T6117 oascc.ConnectionManager.waitForConnected
>> Waiting for client to connect to ZooKeeper
>>    [junit4]   2> 1891739 T6150 oascc.ConnectionManager.process Watcher
>> org.apache.solr.common.cloud.ConnectionManager@6e2f6f
>> name:ZooKeeperConnection Watcher:127.0.0.1:50799/solr got event
>> WatchedEvent state:SyncConnected type:None path:null path:null type:None
>>    [junit4]   2> 1891740 T6117 oascc.ConnectionManager.waitForConnected
>> Client is connected to ZooKeeper
>>    [junit4]   2> 1891740 T6117 oascc.SolrZkClient.createZkACLProvider
>> Using default ZkACLProvider
>>    [junit4]   2> 1891742 T6117
>> oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster
>> state from ZooKeeper...
>>    [junit4]   2> 1891748 T6117 oasc.ChaosMonkey.monkeyLog monkey: init -
>> expire sessions:false cause connection loss:false
>>    [junit4]   2> 1891748 T6117
>> oasc.AbstractFullDistribZkTestBase.createJettys Creating collection1 with
>> stateFormat=2
>>    [junit4]   2> 1891749 T6117
>> oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
>> ZkCredentialsProvider
>>    [junit4]   2> 1891750 T6117 oascc.ConnectionManager.waitForConnected
>> Waiting for client to connect to ZooKeeper
>>    [junit4]   2> 1891752 T6153 oascc.ConnectionManager.process Watcher
>> org.apache.solr.common.cloud.ConnectionManager@13b0c23
>> name:ZooKeeperConnection Watcher:127.0.0.1:50799/solr got event
>> WatchedEvent state:SyncConnected type:None path:null path:null type:None
>>    [junit4]   2> 1891753 T6117 oascc.ConnectionManager.waitForConnected
>> Client is connected to ZooKeeper
>>    [junit4]   2> 1891753 T6117 oascc.SolrZkClient.createZkACLProvider
>> Using default ZkACLProvider
>>    [junit4]   2> 1891757 T6143 oasc.DistributedQueue$LatchWatcher.process
>> NodeChildrenChanged fired on path /overseer/queue state SyncConnected
>>    [junit4]   2> 1891764 T6144 oasc.Overseer$ClusterStateUpdater.run
>> processMessage: queueSize: 0, message = {
>>    [junit4]   2>          "operation":"create",
>>    [junit4]   2>          "name":"collection1",
>>    [junit4]   2>          "numShards":"2",
>>    [junit4]   2>          "stateFormat":2} current state version: 0
>>    [junit4]   2> 1891765 T6144 oasco.ClusterStateMutator.createCollection
>> building a new cName: collection1
>>    [junit4]   2> 1891766 T6144 oasco.ZkStateWriter.writePendingUpdates
>> going to create_collection /collections/collection1/state.json
>>    [junit4]   2> 1891768 T6143 oascc.ZkStateReader$2.process A cluster
>> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
>> path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
>>    [junit4]   2> 1891768 T6150 oascc.ZkStateReader$2.process A cluster
>> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
>> path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
>>    [junit4]   2> 1892028 T6117
>> oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
>>    [junit4]   2> 1892029 T6117 oejs.Server.doStart jetty-8.1.10.v20130312
>>    [junit4]   2> 1892030 T6117 oejs.AbstractConnector.doStart Started
>> SelectChannelConnector@127.0.0.1:46875
>>    [junit4]   2> 1892032 T6117 oass.SolrDispatchFilter.init
>> SolrDispatchFilter.init()
>>    [junit4]   2> 1892032 T6117 oasc.SolrResourceLoader.locateSolrHome
>> JNDI not configured for solr (NoInitialContextEx)
>>    [junit4]   2> 1892032 T6117 oasc.SolrResourceLoader.locateSolrHome
>> using system property solr.solr.home:
>> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-003
>>    [junit4]   2> 1892033 T6117 oasc.SolrResourceLoader.<init> new
>> SolrResourceLoader for directory:
>> '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-003/'
>>    [junit4]   2> 1892049 T6117 oasc.ConfigSolr.fromFile Loading container
>> configuration from
>> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-003/solr.xml
>>    [junit4]   2> 1892061 T6117 oasc.CoreContainer.<init> New
>> CoreContainer 28548621
>>    [junit4]   2> 1892062 T6117 oasc.CoreContainer.load Loading cores into
>> CoreContainer
>> [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-003/]
>>    [junit4]   2> 1892063 T6117 oashc.HttpShardHandlerFactory.getParameter
>> Setting socketTimeout to: 120000
>>    [junit4]   2> 1892063 T6117 oashc.HttpShardHandlerFactory.getParameter
>> Setting urlScheme to: null
>>    [junit4]   2> 1892063 T6117 oashc.HttpShardHandlerFactory.getParameter
>> Setting connTimeout to: 15000
>>    [junit4]   2> 1892064 T6117 oashc.HttpShardHandlerFactory.getParameter
>> Setting maxConnectionsPerHost to: 20
>>    [junit4]   2> 1892064 T6117 oashc.HttpShardHandlerFactory.getParameter
>> Setting maxConnections to: 10000
>>    [junit4]   2> 1892064 T6117 oashc.HttpShardHandlerFactory.getParameter
>> Setting corePoolSize to: 0
>>    [junit4]   2> 1892065 T6117 oashc.HttpShardHandlerFactory.getParameter
>> Setting maximumPoolSize to: 2147483647
>>    [junit4]   2> 1892065 T6117 oashc.HttpShardHandlerFactory.getParameter
>> Setting maxThreadIdleTime to: 5
>>    [junit4]   2> 1892066 T6117 oashc.HttpShardHandlerFactory.getParameter
>> Setting sizeOfQueue to: -1
>>    [junit4]   2> 1892066 T6117 oashc.HttpShardHandlerFactory.getParameter
>> Setting fairnessPolicy to: false
>>    [junit4]   2> 1892066 T6117 oasu.UpdateShardHandler.<init> Creating
>> UpdateShardHandler HTTP client with params:
>> socketTimeout=3400000&connTimeout=45000&retry=false
>>    [junit4]   2> 1892067 T6117 oasl.LogWatcher.createWatcher SLF4J impl
>> is org.slf4j.impl.Log4jLoggerFactory
>>    [junit4]   2> 1892067 T6117 oasl.LogWatcher.newRegisteredLogWatcher
>> Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
>>    [junit4]   2> 1892068 T6117 oasc.CoreContainer.load Host Name:
>> 127.0.0.1
>>    [junit4]   2> 1892068 T6117 oasc.ZkContainer.initZooKeeper Zookeeper
>> client=127.0.0.1:50799/solr
>>    [junit4]   2> 1892069 T6117 oasc.ZkController.checkChrootPath zkHost
>> includes chroot
>>    [junit4]   2> 1892069 T6117
>> oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
>> ZkCredentialsProvider
>>    [junit4]   2> 1892070 T6117 oascc.ConnectionManager.waitForConnected
>> Waiting for client to connect to ZooKeeper
>>    [junit4]   2> 1892072 T6165 oascc.ConnectionManager.process Watcher
>> org.apache.solr.common.cloud.ConnectionManager@2795f9
>> name:ZooKeeperConnection Watcher:127.0.0.1:50799 got event WatchedEvent
>> state:SyncConnected type:None path:null path:null type:None
>>    [junit4]   2> 1892073 T6117 oascc.ConnectionManager.waitForConnected
>> Client is connected to ZooKeeper
>>    [junit4]   2> 1892074 T6117 oascc.SolrZkClient.createZkACLProvider
>> Using default ZkACLProvider
>>    [junit4]   2> 1892076 T6117 oascc.ConnectionManager.waitForConnected
>> Waiting for client to connect to ZooKeeper
>>    [junit4]   2> 1892078 T6168 oascc.ConnectionManager.process Watcher
>> org.apache.solr.common.cloud.ConnectionManager@ab6a13
>> name:ZooKeeperConnection Watcher:127.0.0.1:50799/solr got event
>> WatchedEvent state:SyncConnected type:None path:null path:null type:None
>>    [junit4]   2> 1892078 T6117 oascc.ConnectionManager.waitForConnected
>> Client is connected to ZooKeeper
>>    [junit4]   2> 1892084 T6117
>> oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster
>> state from ZooKeeper...
>>    [junit4]   2> 1893091 T6117 oasc.ZkController.createEphemeralLiveNode
>> Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46875_
>>    [junit4]   2> 1893093 T6117 oascc.SolrZkClient.makePath makePath:
>> /live_nodes/127.0.0.1:46875_
>>    [junit4]   2> 1893098 T6117 oasc.Overseer.close Overseer (id=null)
>> closing
>>    [junit4]   2> 1893104 T6117 oass.SolrDispatchFilter.init
>> user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
>>    [junit4]   2> 1893106 T6117 oass.SolrDispatchFilter.init
>> SolrDispatchFilter.init() done
>>    [junit4]   2> 1893374 T6117
>> oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
>>    [junit4]   2> 1893375 T6117 oejs.Server.doStart jetty-8.1.10.v20130312
>>    [junit4]   2> 1893377 T6117 oejs.AbstractConnector.doStart Started
>> SelectChannelConnector@127.0.0.1:57048
>>    [junit4]   2> 1893377 T6117 oass.SolrDispatchFilter.init
>> SolrDispatchFilter.init()
>>    [junit4]   2> 1893378 T6117 oasc.SolrResourceLoader.locateSolrHome
>> JNDI not configured for solr (NoInitialContextEx)
>>    [junit4]   2> 1893378 T6117 oasc.SolrResourceLoader.locateSolrHome
>> using system property solr.solr.home:
>> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-004
>>    [junit4]   2> 1893379 T6117 oasc.SolrResourceLoader.<init> new
>> SolrResourceLoader for directory:
>> '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-004/'
>>    [junit4]   2> 1893406 T6117 oasc.ConfigSolr.fromFile Loading container
>> configuration from
>> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-004/solr.xml
>>    [junit4]   2> 1893423 T6117 oasc.CoreContainer.<init> New
>> CoreContainer 21716652
>>    [junit4]   2> 1893424 T6117 oasc.CoreContainer.load Loading cores into
>> CoreContainer
>> [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-004/]
>>    [junit4]   2> 1893425 T6117 oashc.HttpShardHandlerFactory.getParameter
>> Setting socketTimeout to: 120000
>>    [junit4]   2> 1893425 T6117 oashc.HttpShardHandlerFactory.getParameter
>> Setting urlScheme to: null
>>    [junit4]   2> 1893426 T6117 oashc.HttpShardHandlerFactory.getParameter
>> Setting connTimeout to: 15000
>>    [junit4]   2> 1893426 T6117 oashc.HttpShardHandlerFactory.getParameter
>> Setting maxConnectionsPerHost to: 20
>>    [junit4]   2> 1893427 T6117 oashc.HttpShardHandlerFactory.getParameter
>> Setting maxConnections to: 10000
>>    [junit4]   2> 1893427 T6117 oashc.HttpShardHandlerFactory.getParameter
>> Setting corePoolSize to: 0
>>    [junit4]   2> 1893427 T6117 oashc.HttpShardHandlerFactory.getParameter
>> Setting maximumPoolSize to: 2147483647
>>    [junit4]   2> 1893428 T6117 oashc.HttpShardHandlerFactory.getParameter
>> Setting maxThreadIdleTime to: 5
>>    [junit4]   2> 1893428 T6117 oashc.HttpShardHandlerFactory.getParameter
>> Setting sizeOfQueue to: -1
>>    [junit4]   2> 1893429 T6117 oashc.HttpShardHandlerFactory.getParameter
>> Setting fairnessPolicy to: false
>>    [junit4]   2> 1893429 T6117 oasu.UpdateShardHandler.<init> Creating
>> UpdateShardHandler HTTP client with params:
>> socketTimeout=3400000&connTimeout=45000&retry=false
>>    [junit4]   2> 1893430 T6117 oasl.LogWatcher.createWatcher SLF4J impl
>> is org.slf4j.impl.Log4jLoggerFactory
>>    [junit4]   2> 1893430 T6117 oasl.LogWatcher.newRegisteredLogWatcher
>> Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
>>    [junit4]   2> 1893431 T6117 oasc.CoreContainer.load Host Name:
>> 127.0.0.1
>>    [junit4]   2> 1893431 T6117 oasc.ZkContainer.initZooKeeper Zookeeper
>> client=127.0.0.1:50799/solr
>>    [junit4]   2> 1893432 T6117 oasc.ZkController.checkChrootPath zkHost
>> includes chroot
>>    [junit4]   2> 1893432 T6117
>> oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
>> ZkCredentialsProvider
>>    [junit4]   2> 1893433 T6117 oascc.ConnectionManager.waitForConnected
>> Waiting for client to connect to ZooKeeper
>>    [junit4]   2> 1893436 T6181 oascc.ConnectionManager.process Watcher
>> org.apache.solr.common.cloud.ConnectionManager@c50527
>> name:ZooKeeperConnection Watcher:127.0.0.1:50799 got event WatchedEvent
>> state:SyncConnected type:None path:null path:null type:None
>>    [junit4]   2> 1893437 T6117 oascc.ConnectionManager.waitForConnected
>> Client is connected to ZooKeeper
>>    [junit4]   2> 1893437 T6117 oascc.SolrZkClient.createZkACLProvider
>> Using default ZkACLProvider
>>    [junit4]   2> 1893439 T6117 oascc.ConnectionManager.waitForConnected
>> Waiting for client to connect to ZooKeeper
>>    [junit4]   2> 1893441 T6184 oascc.ConnectionManager.process Watcher
>> org.apache.solr.common.cloud.ConnectionManager@17991b7
>> name:ZooKeeperConnection Watcher:127.0.0.1:50799/solr got event
>> WatchedEvent state:SyncConnected type:None path:null path:null type:None
>>    [junit4]   2> 1893442 T6117 oascc.ConnectionManager.waitForConnected
>> Client is connected to ZooKeeper
>>    [junit4]   2> 1893450 T6117
>> oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster
>> state from ZooKeeper...
>>    [junit4]   2> 1894458 T6117 oasc.ZkController.createEphemeralLiveNode
>> Register node as live in ZooKeeper:/live_nodes/127.0.0.1:57048_
>>    [junit4]   2> 1894460 T6117 oascc.SolrZkClient.makePath makePath:
>> /live_nodes/127.0.0.1:57048_
>>    [junit4]   2> 1894464 T6117 oasc.Overseer.close Overseer (id=null)
>> closing
>>    [junit4]   2> 1894466 T6117 oass.SolrDispatchFilter.init
>> user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
>>    [junit4]   2> 1894466 T6117 oass.SolrDispatchFilter.init
>> SolrDispatchFilter.init() done
>>    [junit4]   2> 1894728 T6117
>> oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
>>    [junit4]   2> 1894728 T6117 oejs.Server.doStart jetty-8.1.10.v20130312
>>    [junit4]   2> 1894730 T6117 oejs.AbstractConnector.doStart Started
>> SelectChannelConnector@127.0.0.1:34745
>>    [junit4]   2> 1894731 T6117 oass.SolrDispatchFilter.init
>> SolrDispatchFilter.init()
>>    [junit4]   2> 1894731 T6117 oasc.SolrResourceLoader.locateSolrHome
>> JNDI not configured for solr (NoInitialContextEx)
>>    [junit4]   2> 1894732 T6117 oasc.SolrResourceLoader.locateSolrHome
>> using system property solr.solr.home:
>> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-005
>>    [junit4]   2> 1894732 T6117 oasc.SolrResourceLoader.<init> new
>> SolrResourceLoader for directory:
>> '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-005/'
>>    [junit4]   2> 1894747 T6117 oasc.ConfigSolr.fromFile Loading container
>> configuration from
>> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-005/solr.xml
>>    [junit4]   2> 1894761 T6117 oasc.CoreContainer.<init> New
>> CoreContainer 1265021
>>    [junit4]   2> 1894762 T6117 oasc.CoreContainer.load Loading cores into
>> CoreContainer
>> [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-005/]
>>    [junit4]   2> 1894762 T6117 oashc.HttpShardHandlerFactory.getParameter
>> Setting socketTimeout to: 120000
>>    [junit4]   2> 1894763 T6117 oashc.HttpShardHandlerFactory.getParameter
>> Setting urlScheme to: null
>>    [junit4]   2> 1894763 T6117 oashc.HttpShardHandlerFactory.getParameter
>> Setting connTimeout to: 15000
>>    [junit4]   2> 1894763 T6117 oashc.HttpShardHandlerFactory.getParameter
>> Setting maxConnectionsPerHost to: 20
>>    [junit4]   2> 1894764 T6117 oashc.HttpShardHandlerFactory.getParameter
>> Setting maxConnections to: 10000
>>    [junit4]   2> 1894764 T6117 oashc.HttpShardHandlerFactory.getParameter
>> Setting corePoolSize to: 0
>>    [junit4]   2> 1894764 T6117 oashc.HttpShardHandlerFactory.getParameter
>> Setting maximumPoolSize to: 2147483647
>>    [junit4]   2> 1894765 T6117 oashc.HttpShardHandlerFactory.getParameter
>> Setting maxThreadIdleTime to: 5
>>    [junit4]   2> 1894765 T6117 oashc.HttpShardHandlerFactory.getParameter
>> Setting sizeOfQueue to: -1
>>    [junit4]   2> 1894765 T6117 oashc.HttpShardHandlerFactory.getParameter
>> Setting fairnessPolicy to: false
>>    [junit4]   2> 1894766 T6117 oasu.UpdateShardHandler.<init> Creating
>> UpdateShardHandler HTTP client with params:
>> socketTimeout=3400000&connTimeout=45000&retry=false
>>    [junit4]   2> 1894766 T6117 oasl.LogWatcher.createWatcher SLF4J impl
>> is org.slf4j.impl.Log4jLoggerFactory
>>    [junit4]   2> 1894767 T6117 oasl.LogWatcher.newRegisteredLogWatcher
>> Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
>>    [junit4]   2> 1894767 T6117 oasc.CoreContainer.load Host Name:
>> 127.0.0.1
>>    [junit4]   2> 1894767 T6117 oasc.ZkContainer.initZooKeeper Zookeeper
>> client=127.0.0.1:50799/solr
>>    [junit4]   2> 1894768 T6117 oasc.ZkController.checkChrootPath zkHost
>> includes chroot
>>    [junit4]   2> 1894768 T6117
>> oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
>> ZkCredentialsProvider
>>    [junit4]   2> 1894769 T6117 oascc.ConnectionManager.waitForConnected
>> Waiting for client to connect to ZooKeeper
>>    [junit4]   2> 1894770 T6197 oascc.ConnectionManager.process Watcher
>> org.apache.solr.common.cloud.ConnectionManager@1eadb73
>> name:ZooKeeperConnection Watcher:127.0.0.1:50799 got event WatchedEvent
>> state:SyncConnected type:None path:null path:null type:None
>>    [junit4]   2> 1894771 T6117 oascc.ConnectionManager.waitForConnected
>> Client is connected to ZooKeeper
>>    [junit4]   2> 1894771 T6117 oascc.SolrZkClient.createZkACLProvider
>> Using default ZkACLProvider
>>    [junit4]   2> 1894773 T6117 oascc.ConnectionManager.waitForConnected
>> Waiting for client to connect to ZooKeeper
>>    [junit4]   2> 1894775 T6200 oascc.ConnectionManager.process Watcher
>> org.apache.solr.common.cloud.ConnectionManager@15e15bb
>> name:ZooKeeperConnection Watcher:127.0.0.1:50799/solr got event
>> WatchedEvent state:SyncConnected type:None path:null path:null type:None
>>    [junit4]   2> 1894775 T6117 oascc.ConnectionManager.waitForConnected
>> Client is connected to ZooKeeper
>>    [junit4]   2> 1894784 T6117
>> oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster
>> state from ZooKeeper...
>>    [junit4]   2> 1895789 T6117 oasc.ZkController.createEphemeralLiveNode
>> Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34745_
>>    [junit4]   2> 1895791 T6117 oascc.SolrZkClient.makePath makePath:
>> /live_nodes/127.0.0.1:34745_
>>    [junit4]   2> 1895796 T6117 oasc.Overseer.close Overseer (id=null)
>> closing
>>    [junit4]   2> 1895800 T6117 oass.SolrDispatchFilter.init
>> user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
>>    [junit4]   2> 1895801 T6117 oass.SolrDispatchFilter.init
>> SolrDispatchFilter.init() done
>>    [junit4]   2> 1896155 T6117
>> oasc.AbstractFullDistribZkTestBase.createJettys create jetty 4
>>    [junit4]   2> 1896156 T6117 oejs.Server.doStart jetty-8.1.10.v20130312
>>    [junit4]   2> 1896159 T6117 oejs.AbstractConnector.doStart Started
>> SelectChannelConnector@127.0.0.1:50450
>>    [junit4]   2> 1896160 T6117 oass.SolrDispatchFilter.init
>> SolrDispatchFilter.init()
>>    [junit4]   2> 1896160 T6117 oasc.SolrResourceLoader.locateSolrHome
>> JNDI not configured for solr (NoInitialContextEx)
>>    [junit4]   2> 1896161 T6117 oasc.SolrResourceLoader.locateSolrHome
>> using system property solr.solr.home:
>> ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-006
>>    [junit4]   2> 1896161 T6117 oasc.SolrResourceLoader.<init> new
>> SolrResourceLoader for directory:
>> '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-006/'
>>    [junit4]   2> 1896183 T6117 oasc.ConfigSolr.fromFile Loading container
>> configuration from
>> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-006/solr.xml
>>    [junit4]   2> 1896199 T6117 oasc.CoreContainer.<init> New
>> CoreContainer 1095776
>>    [junit4]   2> 1896199 T6117 oasc.CoreContainer.load Loading cores into
>> CoreContainer
>> [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-006/]
>>    [junit4]   2> 1896200 T6117 oashc.HttpShardHandlerFactory.getParameter
>> Setting socketTimeout to: 120000
>>    [junit4]   2> 1896200 T6117 oashc.HttpShardHandlerFactory.getParameter
>> Setting urlScheme to: null
>>    [junit4]   2> 1896200 T6117 oashc.HttpShardHandlerFactory.getParameter
>> Setting connTimeout to: 15000
>>    [junit4]   2> 1896201 T6117 oashc.HttpShardHandlerFactory.getParameter
>> Setting maxConnectionsPerHost to: 20
>>    [junit4]   2> 1896201 T6117 oashc.HttpShardHandlerFactory.getParameter
>> Setting maxConnections to: 10000
>>    [junit4]   2> 1896201 T6117 oashc.HttpShardHandlerFactory.getParameter
>> Setting corePoolSize to: 0
>>    [junit4]   2> 1896202 T6117 oashc.HttpShardHandlerFactory.getParameter
>> Setting maximumPoolSize to: 2147483647
>>    [junit4]   2> 1896202 T6117 oashc.HttpShardHandlerFactory.getParameter
>> Setting maxThreadIdleTime to: 5
>>    [junit4]   2> 1896202 T6117 oashc.HttpShardHandlerFactory.getParameter
>> Setting sizeOfQueue to: -1
>>    [junit4]   2> 1896203 T6117 oashc.HttpShardHandlerFactory.getParameter
>> Setting fairnessPolicy to: false
>>    [junit4]   2> 1896203 T6117 oasu.UpdateShardHandler.<init> Creating
>> UpdateShardHandler HTTP client with params:
>> socketTimeout=3400000&connTimeout=45000&retry=false
>>    [junit4]   2> 1896204 T6117 oasl.LogWatcher.createWatcher SLF4J impl
>> is org.slf4j.impl.Log4jLoggerFactory
>>    [junit4]   2> 1896204 T6117 oasl.LogWatcher.newRegisteredLogWatcher
>> Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
>>    [junit4]   2> 1896204 T6117 oasc.CoreContainer.load Host Name:
>> 127.0.0.1
>>    [junit4]   2> 1896205 T6117 oasc.ZkContainer.initZooKeeper Zookeeper
>> client=127.0.0.1:50799/solr
>>    [junit4]   2> 1896205 T6117 oasc.ZkController.checkChrootPath zkHost
>> includes chroot
>>    [junit4]   2> 1896205 T6117
>> oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
>> ZkCredentialsProvider
>>    [junit4]   2> 1896206 T6117 oascc.ConnectionManager.waitForConnected
>> Waiting for client to connect to ZooKeeper
>>    [junit4]   2> 1896208 T6213 oascc.ConnectionManager.process Watcher
>> org.apache.solr.common.cloud.ConnectionManager@16e3e33
>> name:ZooKeeperConnection Watcher:127.0.0.1:50799 got event WatchedEvent
>> state:SyncConnected type:None path:null path:null type:None
>>    [junit4]   2> 1896208 T6117 oascc.ConnectionManager.waitForConnected
>> Client is connected to ZooKeeper
>>    [junit4]   2> 1896209 T6117 oascc.SolrZkClient.createZkACLProvider
>> Using default ZkACLProvider
>>    [junit4]   2> 1896210 T6117 oascc.ConnectionManager.waitForConnected
>> Waiting for client to connect to ZooKeeper
>>    [junit4]   2> 1896211 T6216 oascc.ConnectionManager.process Watcher
>> org.apache.solr.common.cloud.ConnectionManager@bf72cd
>> name:ZooKeeperConnection Watcher:127.0.0.1:50799/solr got event
>> WatchedEvent state:SyncConnected type:None path:null path:null type:None
>>    [junit4]   2> 1896211 T6117 oascc.ConnectionManager.waitForConnected
>> Client is connected to ZooKeeper
>>    [junit4]   2> 1896216 T6117
>> oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster
>> state from ZooKeeper...
>>    [junit4]   2> 1897220 T6117 oasc.ZkController.createEphemeralLiveNode
>> Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50450_
>>    [junit4]   2> 1897222 T6117 oascc.SolrZkClient.makePath makePath:
>> /live_nodes/127.0.0.1:50450_
>>    [junit4]   2> 1897226 T6117 oasc.Overseer.close Overseer (id=null)
>> closing
>>    [junit4]   2> 1897229 T6117 oass.SolrDispatchFilter.init
>> user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
>>    [junit4]   2> 1897229 T6117 oass.SolrDispatchFilter.init
>> SolrDispatchFilter.init() done
>>    [junit4]   2> 1897237 T6160
>> oasha.CollectionsHandler.handleCreateAction Creating Collection :
>> replicationFactor=2&collection.configName=conf1&router.field=myOwnField&name=solrj_collection&action=CREATE&numShards=2&wt=javabin&version=2
>>    [junit4]   2> 1897239 T6143 oasc.DistributedQueue$LatchWatcher.process
>> NodeChildrenChanged fired on path /overseer/collection-queue-work state
>> SyncConnected
>>    [junit4]   2> 1897244 T6145 oasc.OverseerCollectionProcessor.run
>> Overseer Collection Processor: Get the message
>> id:/overseer/collection-queue-work/qn-0000000000 message:{
>>    [junit4]   2>          "operation":"create",
>>    [junit4]   2>          "fromApi":"true",
>>    [junit4]   2>          "name":"solrj_collection",
>>    [junit4]   2>          "replicationFactor":"2",
>>    [junit4]   2>          "collection.configName":"conf1",
>>    [junit4]   2>          "numShards":"2",
>>    [junit4]   2>          "router.field":"myOwnField"}
>>    [junit4]   2> 1897245 T6218
>> oasc.OverseerCollectionProcessor.processMessage WARN
>> OverseerCollectionProcessor.processMessage : create , {
>>    [junit4]   2>          "operation":"create",
>>    [junit4]   2>          "fromApi":"true",
>>    [junit4]   2>          "name":"solrj_collection",
>>    [junit4]   2>          "replicationFactor":"2",
>>    [junit4]   2>          "collection.configName":"conf1",
>>    [junit4]   2>          "numShards":"2",
>>    [junit4]   2>          "router.field":"myOwnField"}
>>    [junit4]   2> 1897245 T6218
>> oasc.OverseerCollectionProcessor.createConfNode creating collections conf
>> node /collections/solrj_collection
>>    [junit4]   2> 1897246 T6218 oascc.SolrZkClient.makePath makePath:
>> /collections/solrj_collection
>>    [junit4]   2> 1897248 T6143 oasc.DistributedQueue$LatchWatcher.process
>> NodeChildrenChanged fired on path /overseer/queue state SyncConnected
>>    [junit4]   2> 1897249 T6144 oasc.Overseer$ClusterStateUpdater.run
>> processMessage: queueSize: 1, message = {
>>    [junit4]   2>          "operation":"create",
>>    [junit4]   2>          "fromApi":"true",
>>    [junit4]   2>          "name":"solrj_collection",
>>    [junit4]   2>          "replicationFactor":"2",
>>    [junit4]   2>          "collection.configName":"conf1",
>>    [junit4]   2>          "numShards":"2",
>>    [junit4]   2>          "router.field":"myOwnField"} current state
>> version: 1
>>    [junit4]   2> 1897250 T6144 oasco.ClusterStateMutator.createCollection
>> building a new cName: solrj_collection
>>    [junit4]   2> 1897250 T6200 oascc.ZkStateReader$2.process A cluster
>> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
>> path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
>>    [junit4]   2> 1897251 T6143 oascc.ZkStateReader$2.process A cluster
>> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
>> path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
>>    [junit4]   2> 1897251 T6168 oascc.ZkStateReader$2.process A cluster
>> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
>> path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
>>    [junit4]   2> 1897250 T6216 oascc.ZkStateReader$2.process A cluster
>> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
>> path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
>>    [junit4]   2> 1897250 T6184 oascc.ZkStateReader$2.process A cluster
>> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
>> path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
>>    [junit4]   2> 1897250 T6150 oascc.ZkStateReader$2.process A cluster
>> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
>> path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
>>    [junit4]   2> 1897449 T6218
>> oasc.OverseerCollectionProcessor.createCollection Creating SolrCores for
>> new collection solrj_collection, shardNames [shard1, shard2] ,
>> replicationFactor : 2
>>    [junit4]   2> 1897449 T6218
>> oasc.OverseerCollectionProcessor.createCollection Creating shard
>> solrj_collection_shard1_replica1 as part of slice shard1 of collection
>> solrj_collection on 127.0.0.1:34745_
>>    [junit4]   2> 1897450 T6218
>> oasc.OverseerCollectionProcessor.createCollection Creating shard
>> solrj_collection_shard1_replica2 as part of slice shard1 of collection
>> solrj_collection on 127.0.0.1:46875_
>>    [junit4]   2> 1897450 T6218
>> oasc.OverseerCollectionProcessor.createCollection Creating shard
>> solrj_collection_shard2_replica1 as part of slice shard2 of collection
>> solrj_collection on 127.0.0.1:57048_
>>    [junit4]   2> 1897452 T6218
>> oasc.OverseerCollectionProcessor.createCollection Creating shard
>> solrj_collection_shard2_replica2 as part of slice shard2 of collection
>> solrj_collection on 127.0.0.1:50450_
>>    [junit4]   2> 1897452 T6191 oasha.CoreAdminHandler.handleCreateAction
>> core create command
>> qt=/admin/cores&collection.configName=conf1&name=solrj_collection_shard1_replica1&action=CREATE&numShards=2&collection=solrj_collection&shard=shard1&wt=javabin&version=2
>>    [junit4]   2> 1897452 T6162 oasha.CoreAdminHandler.handleCreateAction
>> core create command
>> qt=/admin/cores&collection.configName=conf1&name=solrj_collection_shard1_replica2&action=CREATE&numShards=2&collection=solrj_collection&shard=shard1&wt=javabin&version=2
>>    [junit4]   2> 1897452 T6175 oasha.CoreAdminHandler.handleCreateAction
>> core create command
>> qt=/admin/cores&collection.configName=conf1&name=solrj_collection_shard2_replica1&action=CREATE&numShards=2&collection=solrj_collection&shard=shard2&wt=javabin&version=2
>>    [junit4]   2> 1897454 T6191 oasc.ZkController.publish publishing
>> core=solrj_collection_shard1_replica1 state=down collection=solrj_collection
>>    [junit4]   2> 1897454 T6207 oasha.CoreAdminHandler.handleCreateAction
>> core create command
>> qt=/admin/cores&collection.configName=conf1&name=solrj_collection_shard2_replica2&action=CREATE&numShards=2&collection=solrj_collection&shard=shard2&wt=javabin&version=2
>>    [junit4]   2> 1897455 T6162 oasc.ZkController.publish publishing
>> core=solrj_collection_shard1_replica2 state=down collection=solrj_collection
>>    [junit4]   2> 1897456 T6143 oasc.DistributedQueue$LatchWatcher.process
>> NodeChildrenChanged fired on path /overseer/queue state SyncConnected
>>    [junit4]   2> 1897455 T6191 oasc.ZkController.waitForCoreNodeName look
>> for our core node name
>>    [junit4]   2> 1897455 T6175 oasc.ZkController.publish publishing
>> core=solrj_collection_shard2_replica1 state=down collection=solrj_collection
>>    [junit4]   2> 1897456 T6207 oasc.ZkController.publish publishing
>> core=solrj_collection_shard2_replica2 state=down collection=solrj_collection
>>    [junit4]   2> 1897457 T6144 oasc.Overseer$ClusterStateUpdater.run
>> processMessage: queueSize: 2, message = {
>>    [junit4]   2>          "core":"solrj_collection_shard1_replica1",
>>    [junit4]   2>          "roles":null,
>>    [junit4]   2>          "base_url":"http://127.0.0.1:34745",
>>    [junit4]   2>          "node_name":"127.0.0.1:34745_",
>>    [junit4]   2>          "numShards":"2",
>>    [junit4]   2>          "state":"down",
>>    [junit4]   2>          "shard":"shard1",
>>    [junit4]   2>          "collection":"solrj_collection",
>>    [junit4]   2>          "operation":"state"} current state version: 2
>>    [junit4]   2> 1897456 T6162 oasc.ZkController.waitForCoreNodeName look
>> for our core node name
>>    [junit4]   2> 1897458 T6144 oasco.ReplicaMutator.updateState Update
>> state numShards=2 message={
>>    [junit4]   2>          "core":"solrj_collection_shard1_replica1",
>>    [junit4]   2>          "roles":null,
>>    [junit4]   2>          "base_url":"http://127.0.0.1:34745",
>>    [junit4]   2>          "node_name":"127.0.0.1:34745_",
>>    [junit4]   2>          "numShards":"2",
>>    [junit4]   2>          "state":"down",
>>    [junit4]   2>          "shard":"shard1",
>>    [junit4]   2>          "collection":"solrj_collection",
>>    [junit4]   2>          "operation":"state"}
>>    [junit4]   2> 1897458 T6207 oasc.ZkController.waitForCoreNodeName look
>> for our core node name
>>    [junit4]   2> 1897457 T6175 oasc.ZkController.waitForCoreNodeName look
>> for our core node name
>>    [junit4]   2> 1897461 T6144 oasc.Overseer$ClusterStateUpdater.run
>> processMessage: queueSize: 3, message = {
>>    [junit4]   2>          "core":"solrj_collection_shard1_replica2",
>>    [junit4]   2>          "roles":null,
>>    [junit4]   2>          "base_url":"http://127.0.0.1:46875",
>>    [junit4]   2>          "node_name":"127.0.0.1:46875_",
>>    [junit4]   2>          "numShards":"2",
>>    [junit4]   2>          "state":"down",
>>    [junit4]   2>          "shard":"shard1",
>>    [junit4]   2>          "collection":"solrj_collection",
>>    [junit4]   2>          "operation":"state"} current state version: 2
>>    [junit4]   2> 1897462 T6144 oasco.ReplicaMutator.updateState Update
>> state numShards=2 message={
>>    [junit4]   2>          "core":"solrj_collection_shard1_replica2",
>>    [junit4]   2>          "roles":null,
>>    [junit4]   2>          "base_url":"http://127.0.0.1:46875",
>>    [junit4]   2>          "node_name":"127.0.0.1:46875_",
>>    [junit4]   2>          "numShards":"2",
>>    [junit4]   2>          "state":"down",
>>    [junit4]   2>          "shard":"shard1",
>>    [junit4]   2>          "collection":"solrj_collection",
>>    [junit4]   2>          "operation":"state"}
>>    [junit4]   2> 1897463 T6143 oasc.DistributedQueue$LatchWatcher.process
>> NodeChildrenChanged fired on path /overseer/queue state SyncConnected
>>    [junit4]   2> 1897464 T6144 oasc.Overseer$ClusterStateUpdater.run
>> processMessage: queueSize: 2, message = {
>>    [junit4]   2>          "core":"solrj_collection_shard2_replica1",
>>    [junit4]   2>          "roles":null,
>>    [junit4]   2>          "base_url":"http://127.0.0.1:57048",
>>    [junit4]   2>          "node_name":"127.0.0.1:57048_",
>>    [junit4]   2>          "numShards":"2",
>>    [junit4]   2>          "state":"down",
>>    [junit4]   2>          "shard":"shard2",
>>    [junit4]   2>          "collection":"solrj_collection",
>>    [junit4]   2>          "operation":"state"} current state version: 2
>>    [junit4]   2> 1897465 T6144 oasco.ReplicaMutator.updateState Update
>> state numShards=2 message={
>>    [junit4]   2>          "core":"solrj_collection_shard2_replica1",
>>    [junit4]   2>          "roles":null,
>>    [junit4]   2>          "base_url":"http://127.0.0.1:57048",
>>    [junit4]   2>          "node_name":"127.0.0.1:57048_",
>>    [junit4]   2>          "numShards":"2",
>>    [junit4]   2>          "state":"down",
>>    [junit4]   2>          "shard":"shard2",
>>    [junit4]   2>          "collection":"solrj_collection",
>>    [junit4]   2>          "operation":"state"}
>>    [junit4]   2> 1897467 T6143 oasc.DistributedQueue$LatchWatcher.process
>> NodeChildrenChanged fired on path /overseer/queue state SyncConnected
>>    [junit4]   2> 1897468 T6144 oasc.Overseer$ClusterStateUpdater.run
>> processMessage: queueSize: 2, message = {
>>    [junit4]   2>          "core":"solrj_collection_shard2_replica2",
>>    [junit4]   2>          "roles":null,
>>    [junit4]   2>          "base_url":"http://127.0.0.1:50450",
>>    [junit4]   2>          "node_name":"127.0.0.1:50450_",
>>    [junit4]   2>          "numShards":"2",
>>    [junit4]   2>          "state":"down",
>>    [junit4]   2>          "shard":"shard2",
>>    [junit4]   2>          "collection":"solrj_collection",
>>    [junit4]   2>          "operation":"state"} current state version: 2
>>    [junit4]   2> 1897468 T6144 oasco.ReplicaMutator.updateState Update
>> state numShards=2 message={
>>    [junit4]   2>          "core":"solrj_collection_shard2_replica2",
>>    [junit4]   2>          "roles":null,
>>    [junit4]   2>          "base_url":"http://127.0.0.1:50450",
>>    [junit4]   2>          "node_name":"127.0.0.1:50450_",
>>    [junit4]   2>          "numShards":"2",
>>    [junit4]   2>          "state":"down",
>>    [junit4]   2>          "shard":"shard2",
>>    [junit4]   2>          "collection":"solrj_collection",
>>    [junit4]   2>          "operation":"state"}
>>    [junit4]   2> 1897570 T6200 oascc.ZkStateReader$2.process A cluster
>> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
>> path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
>>    [junit4]   2> 1897571 T6184 oascc.ZkStateReader$2.process A cluster
>> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
>> path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
>>    [junit4]   2> 1897571 T6168 oascc.ZkStateReader$2.process A cluster
>> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
>> path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
>>    [junit4]   2> 1897570 T6150 oascc.ZkStateReader$2.process A cluster
>> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
>> path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
>>    [junit4]   2> 1897570 T6143 oascc.ZkStateReader$2.process A cluster
>> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
>> path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
>>    [junit4]   2> 1897570 T6216 oascc.ZkStateReader$2.process A cluster
>> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
>> path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
>>    [junit4]   2> 1898456 T6191 oasc.ZkController.waitForShardId waiting
>> to find shard id in clusterstate for solrj_collection_shard1_replica1
>>    [junit4]   2> 1898457 T6191 oasc.ZkController.createCollectionZkNode
>> Check for collection zkNode:solrj_collection
>>    [junit4]   2> 1898458 T6191 oasc.ZkController.createCollectionZkNode
>> Collection zkNode exists
>>    [junit4]   2> 1898458 T6162 oasc.ZkController.waitForShardId waiting
>> to find shard id in clusterstate for solrj_collection_shard1_replica2
>>    [junit4]   2> 1898458 T6191 oascc.ZkStateReader.readConfigName Load
>> collection config from:/collections/solrj_collection
>>    [junit4]   2> 1898459 T6207 oasc.ZkController.waitForShardId waiting
>> to find shard id in clusterstate for solrj_collection_shard2_replica2
>>    [junit4]   2> 1898459 T6162 oasc.ZkController.createCollectionZkNode
>> Check for collection zkNode:solrj_collection
>>    [junit4]   2> 1898459 T6207 oasc.ZkController.createCollectionZkNode
>> Check for collection zkNode:solrj_collection
>>    [junit4]   2> 1898459 T6175 oasc.ZkController.waitForShardId waiting
>> to find shard id in clusterstate for solrj_collection_shard2_replica1
>>    [junit4]   2> 1898461 T6175 oasc.ZkController.createCollectionZkNode
>> Check for collection zkNode:solrj_collection
>>    [junit4]   2> 1898461 T6207 oasc.ZkController.createCollectionZkNode
>> Collection zkNode exists
>>    [junit4]   2> 1898461 T6191 oascc.ZkStateReader.readConfigName
>> path=/collections/solrj_collection configName=conf1 specified config exists
>> in ZooKeeper
>>    [junit4]   2> 1898462 T6162 oasc.ZkController.createCollectionZkNode
>> Collection zkNode exists
>>    [junit4]   2> 1898462 T6175 oasc.ZkController.createCollectionZkNode
>> Collection zkNode exists
>>    [junit4]   2> 1898463 T6175 oascc.ZkStateReader.readConfigName Load
>> collection config from:/collections/solrj_collection
>>    [junit4]   2> 1898462 T6207 oascc.ZkStateReader.readConfigName Load
>> collection config from:/collections/solrj_collection
>>    [junit4]   2> 1898464 T6175 oascc.ZkStateReader.readConfigName
>> path=/collections/solrj_collection configName=conf1 specified config exists
>> in ZooKeeper
>>    [junit4]   2> 1898463 T6162 oascc.ZkStateReader.readConfigName Load
>> collection config from:/collections/solrj_collection
>>    [junit4]   2> 1898462 T6191 oasc.SolrResourceLoader.<init> new
>> SolrResourceLoader for directory:
>> '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-005/solrj_collection_shard1_replica1/'
>>    [junit4]   2> 1898464 T6207 oascc.ZkStateReader.readConfigName
>> path=/collections/solrj_collection configName=conf1 specified config exists
>> in ZooKeeper
>>    [junit4]   2> 1898464 T6175 oasc.SolrResourceLoader.<init> new
>> SolrResourceLoader for directory:
>> '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-004/solrj_collection_shard2_replica1/'
>>    [junit4]   2> 1898466 T6207 oasc.SolrResourceLoader.<init> new
>> SolrResourceLoader for directory:
>> '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-006/solrj_collection_shard2_replica2/'
>>    [junit4]   2> 1898465 T6162 oascc.ZkStateReader.readConfigName
>> path=/collections/solrj_collection configName=conf1 specified config exists
>> in ZooKeeper
>>    [junit4]   2> 1898467 T6162 oasc.SolrResourceLoader.<init> new
>> SolrResourceLoader for directory:
>> '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-003/solrj_collection_shard1_replica2/'
>>    [junit4]   2> 1898492 T6191 oasc.ZkController.watchZKConfDir watch
>> zkdir /configs/conf1
>>    [junit4]   2> 1898495 T6191 oasc.Config.<init> loaded config
>> solrconfig.xml with version 0
>>    [junit4]   2> 1898497 T6162 oasc.ZkController.watchZKConfDir watch
>> zkdir /configs/conf1
>>    [junit4]   2> 1898501 T6162 oasc.Config.<init> loaded config
>> solrconfig.xml with version 0
>>    [junit4]   2> 1898505 T6175 oasc.ZkController.watchZKConfDir watch
>> zkdir /configs/conf1
>>    [junit4]   2> 1898507 T6175 oasc.Config.<init> loaded config
>> solrconfig.xml with version 0
>>    [junit4]   2> 1898516 T6207 oasc.ZkController.watchZKConfDir watch
>> zkdir /configs/conf1
>>    [junit4]   2> 1898519 T6207 oasc.Config.<init> loaded config
>> solrconfig.xml with version 0
>>    [junit4]   2> 1898522 T6162 oasc.SolrConfig.<init> Using Lucene
>> MatchVersion: 6.0.0
>>    [junit4]   2> 1898524 T6191 oasc.SolrConfig.<init> Using Lucene
>> MatchVersion: 6.0.0
>>    [junit4]   2> 1898541 T6175 oasc.SolrConfig.<init> Using Lucene
>> MatchVersion: 6.0.0
>>    [junit4]   2> 1898554 T6162 oasc.SolrConfig.<init> Loaded SolrConfig:
>> solrconfig.xml
>>    [junit4]   2> 1898554 T6207 oasc.SolrConfig.<init> Using Lucene
>> MatchVersion: 6.0.0
>>    [junit4]   2> 1898554 T6191 oasc.SolrConfig.<init> Loaded SolrConfig:
>> solrconfig.xml
>>    [junit4]   2> 1898555 T6162 oass.IndexSchema.readSchema Reading Solr
>> Schema from /configs/conf1/schema.xml
>>    [junit4]   2> 1898556 T6191 oass.IndexSchema.readSchema Reading Solr
>> Schema from /configs/conf1/schema.xml
>>    [junit4]   2> 1898581 T6175 oasc.SolrConfig.<init> Loaded SolrConfig:
>> solrconfig.xml
>>    [junit4]   2> 1898584 T6207 oasc.SolrConfig.<init> Loaded SolrConfig:
>> solrconfig.xml
>>    [junit4]   2> 1898585 T6175 oass.IndexSchema.readSchema Reading Solr
>> Schema from /configs/conf1/schema.xml
>>    [junit4]   2> 1898586 T6207 oass.IndexSchema.readSchema Reading Solr
>> Schema from /configs/conf1/schema.xml
>>    [junit4]   2> 1898603 T6191 oass.IndexSchema.readSchema
>> [solrj_collection_shard1_replica1] Schema name=test
>>    [junit4]   2> 1898603 T6162 oass.IndexSchema.readSchema
>> [solrj_collection_shard1_replica2] Schema name=test
>>    [junit4]   2> 1898610 T6207 oass.IndexSchema.readSchema
>> [solrj_collection_shard2_replica2] Schema name=test
>>    [junit4]   2> 1898615 T6175 oass.IndexSchema.readSchema
>> [solrj_collection_shard2_replica1] Schema name=test
>>    [junit4]   2> 1898843 T6207 oass.OpenExchangeRatesOrgProvider.init
>> Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
>>    [junit4]   2> 1898843 T6191 oass.OpenExchangeRatesOrgProvider.init
>> Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
>>    [junit4]   2> 1898846 T6162 oass.OpenExchangeRatesOrgProvider.init
>> Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
>>    [junit4]   2> 1898852 T6207 oass.IndexSchema.readSchema default search
>> field in schema is text
>>    [junit4]   2> 1898854 T6162 oass.IndexSchema.readSchema default search
>> field in schema is text
>>    [junit4]   2> 1898855 T6207 oass.IndexSchema.readSchema unique key
>> field: id
>>    [junit4]   2> 1898856 T6191 oass.IndexSchema.readSchema default search
>> field in schema is text
>>    [junit4]   2> 1898856 T6162 oass.IndexSchema.readSchema unique key
>> field: id
>>    [junit4]   2> 1898868 T6191 oass.IndexSchema.readSchema unique key
>> field: id
>>    [junit4]   2> 1898874 T6175 oass.OpenExchangeRatesOrgProvider.init
>> Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
>>    [junit4]   2> 1898880 T6175 oass.IndexSchema.readSchema default search
>> field in schema is text
>>    [junit4]   2> 1898883 T6175 oass.IndexSchema.readSchema unique key
>> field: id
>>    [junit4]   2> 1898886 T6162 oass.FileExchangeRateProvider.reload
>> Reloading exchange rates from file currency.xml
>>    [junit4]   2> 1898887 T6207 oass.FileExchangeRateProvider.reload
>> Reloading exchange rates from file currency.xml
>>    [junit4]   2> 1898887 T6191 oass.FileExchangeRateProvider.reload
>> Reloading exchange rates from file currency.xml
>>    [junit4]   2> 1898892 T6207 oass.FileExchangeRateProvider.reload
>> Reloading exchange rates from file currency.xml
>>    [junit4]   2> 1898892 T6191 oass.FileExchangeRateProvider.reload
>> Reloading exchange rates from file currency.xml
>>    [junit4]   2> 1898892 T6162 oass.FileExchangeRateProvider.reload
>> Reloading exchange rates from file currency.xml
>>    [junit4]   2> 1898896 T6191 oass.OpenExchangeRatesOrgProvider.reload
>> Reloading exchange rates from open-exchange-rates.json
>>    [junit4]   2> 1898897 T6207 oass.OpenExchangeRatesOrgProvider.reload
>> Reloading exchange rates from open-exchange-rates.json
>>    [junit4]   2> 1898898 T6207
>> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key
>> IMPORTANT NOTE
>>    [junit4]   2> 1898900 T6207
>> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected
>> key, got STRING
>>    [junit4]   2> 1898898 T6162 oass.OpenExchangeRatesOrgProvider.reload
>> Reloading exchange rates from open-exchange-rates.json
>>    [junit4]   2> 1898898 T6191
>> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key
>> IMPORTANT NOTE
>>    [junit4]   2> 1898901 T6207 oass.OpenExchangeRatesOrgProvider.reload
>> Reloading exchange rates from open-exchange-rates.json
>>    [junit4]   2> 1898908 T6162
>> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key
>> IMPORTANT NOTE
>>    [junit4]   2> 1898909 T6162
>> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected
>> key, got STRING
>>    [junit4]   2> 1898909 T6162 oass.OpenExchangeRatesOrgProvider.reload
>> Reloading exchange rates from open-exchange-rates.json
>>    [junit4]   2> 1898908 T6191
>> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected
>> key, got STRING
>>    [junit4]   2> 1898910 T6191 oass.OpenExchangeRatesOrgProvider.reload
>> Reloading exchange rates from open-exchange-rates.json
>>    [junit4]   2> 1898909 T6207
>> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key
>> IMPORTANT NOTE
>>    [junit4]   2> 1898911 T6207
>> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected
>> key, got STRING
>>    [junit4]   2> 1898911 T6162
>> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key
>> IMPORTANT NOTE
>>    [junit4]   2> 1898912 T6162
>> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected
>> key, got STRING
>>    [junit4]   2> 1898912 T6207 oasc.CoreContainer.create Creating
>> SolrCore 'solrj_collection_shard2_replica2' using configuration from
>> collection solrj_collection
>>    [junit4]   2> 1898911 T6191
>> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key
>> IMPORTANT NOTE
>>    [junit4]   2> 1898913 T6191
>> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected
>> key, got STRING
>>    [junit4]   2> 1898913 T6175 oass.FileExchangeRateProvider.reload
>> Reloading exchange rates from file currency.xml
>>    [junit4]   2> 1898912 T6162 oasc.CoreContainer.create Creating
>> SolrCore 'solrj_collection_shard1_replica2' using configuration from
>> collection solrj_collection
>>    [junit4]   2> 1898914 T6191 oasc.CoreContainer.create Creating
>> SolrCore 'solrj_collection_shard1_replica1' using configuration from
>> collection solrj_collection
>>    [junit4]   2> 1898913 T6207 oasc.SolrCore.initDirectoryFactory
>> org.apache.solr.core.MockDirectoryFactory
>>    [junit4]   2> 1898915 T6191 oasc.SolrCore.initDirectoryFactory
>> org.apache.solr.core.MockDirectoryFactory
>>    [junit4]   2> 1898915 T6162 oasc.SolrCore.initDirectoryFactory
>> org.apache.solr.core.MockDirectoryFactory
>>    [junit4]   2> 1898917 T6191 oasc.SolrCore.<init>
>> [solrj_collection_shard1_replica1] Opening new SolrCore at
>> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-005/solrj_collection_shard1_replica1/,
>> dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-005/solrj_collection_shard1_replica1/data/
>>    [junit4]   2> 1898916 T6207 oasc.SolrCore.<init>
>> [solrj_collection_shard2_replica2] Opening new SolrCore at
>> ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-006/solrj_collection_shard2_replica2/,
>> dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-006/solrj_collection_shard2_replica2/data/
>>    [junit4]   2> 1898918 T6175 oass.FileExchangeRateProvider.reload
>> Reloading exchange rates from file currency.xml
>>    [junit4]   2> 1898917 T6162 oasc.SolrCore.<init>
>> [solrj_collection_shard1_replica2] Opening new SolrCore at
>> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-003/solrj_collection_shard1_replica2/,
>> dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-003/solrj_collection_shard1_replica2/data/
>>    [junit4]   2> 1898918 T6191 oasc.JmxMonitoredMap.<init> JMX monitoring
>> is enabled. Adding Solr mbeans to JMX Server:
>> com.sun.jmx.mbeanserver.JmxMBeanServer@1be2f3e
>>    [junit4]   2> 1898919 T6162 oasc.JmxMonitoredMap.<init> JMX monitoring
>> is enabled. Adding Solr mbeans to JMX Server:
>> com.sun.jmx.mbeanserver.JmxMBeanServer@1be2f3e
>>    [junit4]   2> 1898920 T6207 oasc.JmxMonitoredMap.<init> JMX monitoring
>> is enabled. Adding Solr mbeans to JMX Server:
>> com.sun.jmx.mbeanserver.JmxMBeanServer@1be2f3e
>>    [junit4]   2> 1898921 T6175 oass.OpenExchangeRatesOrgProvider.reload
>> Reloading exchange rates from open-exchange-rates.json
>>    [junit4]   2> 1898922 T6191 oasc.CachingDirectoryFactory.get return
>> new directory for
>> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-005/solrj_collection_shard1_replica1/data
>>    [junit4]   2> 1898922 T6207 oasc.CachingDirectoryFactory.get return
>> new directory for
>> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-006/solrj_collection_shard2_replica2/data
>>    [junit4]   2> 1898922 T6175
>> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key
>> IMPORTANT NOTE
>>    [junit4]   2> 1898923 T6175
>> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected
>> key, got STRING
>>    [junit4]   2> 1898923 T6207 oasc.SolrCore.getNewIndexDir New index
>> directory detected: old=null
>> new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-006/solrj_collection_shard2_replica2/data/index/
>>    [junit4]   2> 1898923 T6191 oasc.SolrCore.getNewIndexDir New index
>> directory detected: old=null
>> new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-005/solrj_collection_shard1_replica1/data/index/
>>    [junit4]   2> 1898923 T6162 oasc.CachingDirectoryFactory.get return
>> new directory for
>> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-003/solrj_collection_shard1_replica2/data
>>    [junit4]   2> 1898925 T6191 oasc.SolrCore.initIndex WARN
>> [solrj_collection_shard1_replica1] Solr index directory
>> '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-005/solrj_collection_shard1_replica1/data/index'
>> doesn't exist. Creating new index...
>>    [junit4]   2> 1898924 T6207 oasc.SolrCore.initIndex WARN
>> [solrj_collection_shard2_replica2] Solr index directory
>> '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-006/solrj_collection_shard2_replica2/data/index'
>> doesn't exist. Creating new index...
>>    [junit4]   2> 1898924 T6175 oass.OpenExchangeRatesOrgProvider.reload
>> Reloading exchange rates from open-exchange-rates.json
>>    [junit4]   2> 1898926 T6191 oasc.CachingDirectoryFactory.get return
>> new directory for
>> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-005/solrj_collection_shard1_replica1/data/index
>>    [junit4]   2> 1898927 T6175
>> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key
>> IMPORTANT NOTE
>>    [junit4]   2> 1898928 T6175
>> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected
>> key, got STRING
>>    [junit4]   2> 1898928 T6175 oasc.CoreContainer.create Creating
>> SolrCore 'solrj_collection_shard2_replica1' using configuration from
>> collection solrj_collection
>>    [junit4]   2> 1898929 T6175 oasc.SolrCore.initDirectoryFactory
>> org.apache.solr.core.MockDirectoryFactory
>>    [junit4]   2> 1898929 T6175 oasc.SolrCore.<init>
>> [solrj_collection_shard2_replica1] Opening new SolrCore at
>> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-004/solrj_collection_shard2_replica1/,
>> dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-004/solrj_collection_shard2_replica1/data/
>>    [junit4]   2> 1898930 T6175 oasc.JmxMonitoredMap.<init> JMX monitoring
>> is enabled. Adding Solr mbeans to JMX Server:
>> com.sun.jmx.mbeanserver.JmxMBeanServer@1be2f3e
>>    [junit4]   2> 1898931 T6175 oasc.CachingDirectoryFactory.get return
>> new directory for
>> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-004/solrj_collection_shard2_replica1/data
>>    [junit4]   2> 1898931 T6175 oasc.SolrCore.getNewIndexDir New index
>> directory detected: old=null
>> new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-004/solrj_collection_shard2_replica1/data/index/
>>    [junit4]   2> 1898932 T6175 oasc.SolrCore.initIndex WARN
>> [solrj_collection_shard2_replica1] Solr index directory
>> '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-004/solrj_collection_shard2_replica1/data/index'
>> doesn't exist. Creating new index...
>>    [junit4]   2> 1898933 T6175 oasc.CachingDirectoryFactory.get return
>> new directory for
>> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-004/solrj_collection_shard2_replica1/data/index
>>    [junit4]   2> 1898933 T6175 oasu.RandomMergePolicy.<init>
>> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy:
>> [TieredMergePolicy: maxMergeAtOnce=19, maxMergeAtOnceExplicit=49,
>> maxMergedSegmentMB=77.87890625, floorSegmentMB=1.6240234375,
>> forceMergeDeletesPctAllowed=18.87818731910226, segmentsPerTier=20.0,
>> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
>>    [junit4]   2> 1898925 T6162 oasc.SolrCore.getNewIndexDir New index
>> directory detected: old=null
>> new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-003/solrj_collection_shard1_replica2/data/index/
>>    [junit4]   2> 1898927 T6191 oasu.RandomMergePolicy.<init>
>> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy:
>> [TieredMergePolicy: maxMergeAtOnce=19, maxMergeAtOnceExplicit=49,
>> maxMergedSegmentMB=77.87890625, floorSegmentMB=1.6240234375,
>> forceMergeDeletesPctAllowed=18.87818731910226, segmentsPerTier=20.0,
>> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
>>    [junit4]   2> 1898935 T6175 oasc.SolrDeletionPolicy.onCommit
>> SolrDeletionPolicy.onCommit: commits: num=1
>>    [junit4]   2>
>> commit{dir=MockDirectoryWrapper(RAMDirectory@187f848
>> lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1ef0897
>> ),segFN=segments_1,generation=1}
>>    [junit4]   2> 1898936 T6191 oasc.SolrDeletionPolicy.onCommit
>> SolrDeletionPolicy.onCommit: commits: num=1
>>    [junit4]   2>
>> commit{dir=MockDirectoryWrapper(RAMDirectory@dc31bf
>> lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@afcfe4
>> ),segFN=segments_1,generation=1}
>>    [junit4]   2> 1898936 T6191 oasc.SolrDeletionPolicy.updateCommits
>> newest commit generation = 1
>>    [junit4]   2> 1898927 T6207 oasc.CachingDirectoryFactory.get return
>> new directory for
>> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-006/solrj_collection_shard2_replica2/data/index
>>    [junit4]   2> 1898936 T6175 oasc.SolrDeletionPolicy.updateCommits
>> newest commit generation = 1
>>    [junit4]   2> 1898935 T6162 oasc.SolrCore.initIndex WARN
>> [solrj_collection_shard1_replica2] Solr index directory
>> '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-003/solrj_collection_shard1_replica2/data/index'
>> doesn't exist. Creating new index...
>>    [junit4]   2> 1898937 T6207 oasu.RandomMergePolicy.<init>
>> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy:
>> [TieredMergePolicy: maxMergeAtOnce=19, maxMergeAtOnceExplicit=49,
>> maxMergedSegmentMB=77.87890625, floorSegmentMB=1.6240234375,
>> forceMergeDeletesPctAllowed=18.87818731910226, segmentsPerTier=20.0,
>> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
>>    [junit4]   2> 1898938 T6162 oasc.CachingDirectoryFactory.get return
>> new directory for
>> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-003/solrj_collection_shard1_replica2/data/index
>>    [junit4]   2> 1898939 T6162 oasu.RandomMergePolicy.<init>
>> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy:
>> [TieredMergePolicy: maxMergeAtOnce=19, maxMergeAtOnceExplicit=49,
>> maxMergedSegmentMB=77.87890625, floorSegmentMB=1.6240234375,
>> forceMergeDeletesPctAllowed=18.87818731910226, segmentsPerTier=20.0,
>> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
>>    [junit4]   2> 1898940 T6162 oasc.SolrDeletionPolicy.onCommit
>> SolrDeletionPolicy.onCommit: commits: num=1
>>    [junit4]   2>
>> commit{dir=MockDirectoryWrapper(RAMDirectory@15afcaa
>> lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@14a30cc
>> ),segFN=segments_1,generation=1}
>>    [junit4]   2> 1898941 T6162 oasc.SolrDeletionPolicy.updateCommits
>> newest commit generation = 1
>>    [junit4]   2> 1898943 T6191 oasup.UpdateRequestProcessorChain.init
>> creating updateRequestProcessorChain "nodistrib"
>>    [junit4]   2> 1898944 T6191 oasup.UpdateRequestProcessorChain.init
>> creating updateRequestProcessorChain "dedupe"
>>    [junit4]   2> 1898944 T6175 oasup.UpdateRequestProcessorChain.init
>> creating updateRequestProcessorChain "nodistrib"
>>    [junit4]   2> 1898945 T6191 oasup.UpdateRequestProcessorChain.init
>> inserting DistributedUpdateProcessorFactory into
>> updateRequestProcessorChain "dedupe"
>>    [junit4]   2> 1898945 T6175 oasup.UpdateRequestProcessorChain.init
>> creating updateRequestProcessorChain "dedupe"
>>    [junit4]   2> 1898945 T6191 oasup.UpdateRequestProcessorChain.init
>> creating updateRequestProcessorChain "stored_sig"
>>    [junit4]   2> 1898946 T6175 oasup.UpdateRequestProcessorChain.init
>> inserting DistributedUpdateProcessorFactory into
>> updateRequestProcessorChain "dedupe"
>>    [junit4]   2> 1898946 T6191 oasup.UpdateRequestProcessorChain.init
>> inserting DistributedUpdateProcessorFactory into
>> updateRequestProcessorChain "stored_sig"
>>    [junit4]   2> 1898947 T6162 oasup.UpdateRequestProcessorChain.init
>> creating updateRequestProcessorChain "nodistrib"
>>    [junit4]   2> 1898947 T6175 oasup.UpdateRequestProcessorChain.init
>> creating updateRequestProcessorChain "stored_sig"
>>    [junit4]   2> 1898948 T6162 oasup.UpdateRequestProcessorChain.init
>> creating updateRequestProcessorChain "dedupe"
>>    [junit4]   2> 1898947 T6207 oasc.SolrDeletionPolicy.onCommit
>> SolrDeletionPolicy.onCommit: commits: num=1
>>    [junit4]   2>
>> commit{dir=MockDirectoryWrapper(RAMDirectory@1a8592a
>> lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@ff84d
>> ),segFN=segments_1,generation=1}
>>    [junit4]   2> 1898949 T6207 oasc.SolrDeletionPolicy.updateCommits
>> newest commit generation = 1
>>    [junit4]   2> 1898947 T6191 oasup.UpdateRequestProcessorChain.init
>> creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
>>    [junit4]   2> 1898948 T6162 oasup.UpdateRequestProcessorChain.init
>> inserting DistributedUpdateProcessorFactory into
>> updateRequestProcessorChain "dedupe"
>>    [junit4]   2> 1898948 T6175 oasup.UpdateRequestProcessorChain.init
>> inserting DistributedUpdateProcessorFactory into
>> updateRequestProcessorChain "stored_sig"
>>    [junit4]   2> 1898950 T6191 oasup.UpdateRequestProcessorChain.init
>> creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>>    [junit4]   2> 1898950 T6162 oasup.UpdateRequestProcessorChain.init
>> creating updateRequestProcessorChain "stored_sig"
>>    [junit4]   2> 1898951 T6191 oasup.UpdateRequestProcessorChain.init
>> inserting DistributedUpdateProcessorFactory into
>> updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>>    [junit4]   2> 1898951 T6175 oasup.UpdateRequestProcessorChain.init
>> creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
>>    [junit4]   2> 1898952 T6191 oasc.SolrCore.loadUpdateProcessorChains no
>> updateRequestProcessorChain defined as default, creating implicit default
>>    [junit4]   2> 1898951 T6162 oasup.UpdateRequestProcessorChain.init
>> inserting DistributedUpdateProcessorFactory into
>> updateRequestProcessorChain "stored_sig"
>>    [junit4]   2> 1898953 T6162 oasup.UpdateRequestProcessorChain.init
>> creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
>>    [junit4]   2> 1898954 T6162 oasup.UpdateRequestProcessorChain.init
>> creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>>    [junit4]   2> 1898954 T6162 oasup.UpdateRequestProcessorChain.init
>> inserting DistributedUpdateProcessorFactory into
>> updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>>    [junit4]   2> 1898954 T6162 oasc.SolrCore.loadUpdateProcessorChains no
>> updateRequestProcessorChain defined as default, creating implicit default
>>    [junit4]   2> 1898955 T6162
>> oasc.RequestHandlers.initHandlersFromConfig created /update:
>> org.apache.solr.handler.UpdateRequestHandler
>>    [junit4]   2> 1898956 T6175 oasup.UpdateRequestProcessorChain.init
>> creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>>    [junit4]   2> 1898956 T6191
>> oasc.RequestHandlers.initHandlersFromConfig created /update:
>> org.apache.solr.handler.UpdateRequestHandler
>>    [junit4]   2> 1898956 T6175 oasup.UpdateRequestProcessorChain.init
>> inserting DistributedUpdateProcessorFactory into
>> updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>>    [junit4]   2> 1898956 T6162
>> oasc.RequestHandlers.initHandlersFromConfig created /update/json:
>> org.apache.solr.handler.UpdateRequestHandler
>>    [junit4]   2> 1898957 T6207 oasup.UpdateRequestProcessorChain.init
>> creating updateRequestProcessorChain "nodistrib"
>>    [junit4]   2> 1898958 T6162
>> oasc.RequestHandlers.initHandlersFromConfig created /update/csv:
>> org.apache.solr.handler.UpdateRequestHandler
>>    [junit4]   2> 1898957 T6191
>> oasc.RequestHandlers.initHandlersFromConfig created /update/json:
>> org.apache.solr.handler.UpdateRequestHandler
>>    [junit4]   2> 1898957 T6175 oasc.SolrCore.loadUpdateProcessorChains no
>> updateRequestProcessorChain defined as default, creating implicit default
>>    [junit4]   2> 1898958 T6162
>> oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs:
>> org.apache.solr.handler.UpdateRequestHandler
>>    [junit4]   2> 1898958 T6207 oasup.UpdateRequestProcessorChain.init
>> creating updateRequestProcessorChain "dedupe"
>>    [junit4]   2> 1898959 T6175
>> oasc.RequestHandlers.initHandlersFromConfig created /update:
>> org.apache.solr.handler.UpdateRequestHandler
>>    [junit4]   2> 1898959 T6191
>> oasc.RequestHandlers.initHandlersFromConfig created /update/csv:
>> org.apache.solr.handler.UpdateRequestHandler
>>    [junit4]   2> 1898960 T6207 oasup.UpdateRequestProcessorChain.init
>> inserting DistributedUpdateProcessorFactory into
>> updateRequestProcessorChain "dedupe"
>>    [junit4]   2> 1898960 T6162
>> oasc.RequestHandlers.initHandlersFromConfig created /config:
>> org.apache.solr.handler.SolrConfigHandler
>>    [junit4]   2> 1898961 T6207 oasup.UpdateRequestProcessorChain.init
>> creating updateRequestProcessorChain "stored_sig"
>>    [junit4]   2> 1898961 T6191
>> oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs:
>> org.apache.solr.handler.UpdateRequestHandler
>>    [junit4]   2> 1898960 T6175
>> oasc.RequestHandlers.initHandlersFromConfig created /update/json:
>> org.apache.solr.handler.UpdateRequestHandler
>>    [junit4]   2> 1898962 T6162
>> oasc.RequestHandlers.initHandlersFromConfig created /schema:
>> org.apache.solr.handler.SchemaHandler
>>    [junit4]   2> 1898962 T6175
>> oasc.RequestHandlers.initHandlersFromConfig created /update/csv:
>> org.apache.solr.handler.UpdateRequestHandler
>>    [junit4]   2> 1898962 T6207 oasup.UpdateRequestProcessorChain.init
>> inserting DistributedUpdateProcessorFactory into
>> updateRequestProcessorChain "stored_sig"
>>    [junit4]   2> 1898963 T6175
>> oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs:
>> org.apache.solr.handler.UpdateRequestHandler
>>    [junit4]   2> 1898963 T6207 oasup.UpdateRequestProcessorChain.init
>> creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
>>    [junit4]   2> 1898964 T6175
>> oasc.RequestHandlers.initHandlersFromConfig created /config:
>> org.apache.solr.handler.SolrConfigHandler
>>    [junit4]   2> 1898963 T6162
>> oasc.RequestHandlers.initHandlersFromConfig created /replication:
>> org.apache.solr.handler.ReplicationHandler
>>    [junit4]   2> 1898962 T6191
>> oasc.RequestHandlers.initHandlersFromConfig created /config:
>> org.apache.solr.handler.SolrConfigHandler
>>    [junit4]   2> 1898965 T6162
>> oasc.RequestHandlers.initHandlersFromConfig created /get:
>> org.apache.solr.handler.RealTimeGetHandler
>>    [junit4]   2> 1898964 T6175
>> oasc.RequestHandlers.initHandlersFromConfig created /schema:
>> org.apache.solr.handler.SchemaHandler
>>    [junit4]   2> 1898964 T6207 oasup.UpdateRequestProcessorChain.init
>> creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>>    [junit4]   2> 1898965 T6162
>> oasc.RequestHandlers.initHandlersFromConfig created /admin/luke:
>> org.apache.solr.handler.admin.LukeRequestHandler
>>    [junit4]   2> 1898965 T6191
>> oasc.RequestHandlers.initHandlersFromConfig created /schema:
>> org.apache.solr.handler.SchemaHandler
>>    [junit4]   2> 1898966 T6175
>> oasc.RequestHandlers.initHandlersFromConfig created /replication:
>> org.apache.solr.handler.ReplicationHandler
>>    [junit4]   2> 1898966 T6207 oasup.UpdateRequestProcessorChain.init
>> inserting DistributedUpdateProcessorFactory into
>> updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>>    [junit4]   2> 1898967 T6207 oasc.SolrCore.loadUpdateProcessorChains no
>> updateRequestProcessorChain defined as default, creating implicit default
>>    [junit4]   2> 1898967 T6191
>> oasc.RequestHandlers.initHandlersFromConfig created /replication:
>> org.apache.solr.handler.ReplicationHandler
>>    [junit4]   2> 1898967 T6162
>> oasc.RequestHandlers.initHandlersFromConfig created /admin/system:
>> org.apache.solr.handler.admin.SystemInfoHandler
>>    [junit4]   2> 1898968 T6207
>> oasc.RequestHandlers.initHandlersFromConfig created /update:
>> org.apache.solr.handler.UpdateRequestHandler
>>    [junit4]   2> 1898967 T6175
>> oasc.RequestHandlers.initHandlersFromConfig created /get:
>> org.apache.solr.handler.RealTimeGetHandler
>>    [junit4]   2> 1898969 T6207
>> oasc.RequestHandlers.initHandlersFromConfig created /update/json:
>> org.apache.solr.handler.UpdateRequestHandler
>>    [junit4]   2> 1898969 T6162
>> oasc.RequestHandlers.initHandlersFromConfig created /admin/mbeans:
>> org.apache.solr.handler.admin.SolrInfoMBeanHandler
>>    [junit4]   2> 1898969 T6191
>> oasc.RequestHandlers.initHandlersFromConfig created /get:
>> org.apache.solr.handler.RealTimeGetHandler
>>    [junit4]   2> 1898970 T6207
>> oasc.RequestHandlers.initHandlersFromConfig created /update/csv:
>> org.apache.solr.handler.UpdateRequestHandler
>>    [junit4]   2> 1898970 T6175
>> oasc.RequestHandlers.initHandlersFromConfig created /admin/luke:
>> org.apache.solr.handler.admin.LukeRequestHandler
>>    [junit4]   2> 1898971 T6207
>> oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs:
>> org.apache.solr.handler.UpdateRequestHandler
>>    [junit4]   2> 1898971 T6191
>> oasc.RequestHandlers.initHandlersFromConfig created /admin/luke:
>> org.apache.solr.handler.admin.LukeRequestHandler
>>
> ...
>
> [Message clipped]



-- 
Anshum Gupta
http://about.me/anshumgupta

Re: [JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.8.0_20) - Build # 11768 - Failure!

Posted by Shalin Shekhar Mangar <sh...@gmail.com>.
I committed a fix. We should be comparing canonical paths, not absolute
paths.

On Thu, Dec 18, 2014 at 3:21 PM, Policeman Jenkins Server <
jenkins@thetaphi.de> wrote:
>
> Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/11768/
> Java: 32bit/jdk1.8.0_20 -client -XX:+UseSerialGC (asserts: false)
>
> 1 tests failed.
> FAILED:
> org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testDistribSearch
>
> Error Message:
> expected:<...9942E65A94EC1-001/te[mpDir-003/solrj_test_core_props_shard1_replica1]>
> but
> was:<...9942E65A94EC1-001/te[stPropertyParamsForCreate-001/instanceDir-fmchl]>
>
> Stack Trace:
> org.junit.ComparisonFailure:
> expected:<...9942E65A94EC1-001/te[mpDir-003/solrj_test_core_props_shard1_replica1]>
> but
> was:<...9942E65A94EC1-001/te[stPropertyParamsForCreate-001/instanceDir-fmchl]>
>         at
> __randomizedtesting.SeedInfo.seed([8219942E65A94EC1:3FF1A3612F62EFD]:0)
>         at org.junit.Assert.assertEquals(Assert.java:125)
>         at org.junit.Assert.assertEquals(Assert.java:147)
>         at
> org.apache.solr.cloud.CollectionsAPIDistributedZkTest.checkInstanceDirs(CollectionsAPIDistributedZkTest.java:1135)
>         at
> org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:883)
>         at
> org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:204)
>         at
> org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
>         at sun.reflect.GeneratedMethodAccessor48.invoke(Unknown Source)
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:483)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
>         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
>         at
> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
>         at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at
> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
>         at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
>         at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
>         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
>         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
>         at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at
> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
>         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
>         at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
>         at
> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
>         at java.lang.Thread.run(Thread.java:745)
>
>
>
>
> Build Log:
> [...truncated 9884 lines...]
>    [junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
>    [junit4]   2> Creating dataDir:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/init-core-data-001
>    [junit4]   2> 1891096 T6117 oas.SolrTestCaseJ4.buildSSLConfig
> Randomized ssl (false) and clientAuth (true)
>    [junit4]   2> 1891096 T6117
> oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext
> system property: /
>    [junit4]   2> 1891102 T6117 oas.SolrTestCaseJ4.setUp ###Starting
> testDistribSearch
>    [junit4]   2> 1891103 T6117 oasc.ZkTestServer.run STARTING ZK TEST
> SERVER
>    [junit4]   1> client port:0.0.0.0/0.0.0.0:0
>    [junit4]   2> 1891104 T6118
> oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
>    [junit4]   2> 1891204 T6117 oasc.ZkTestServer.run start zk server on
> port:50799
>    [junit4]   2> 1891204 T6117
> oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
> ZkCredentialsProvider
>    [junit4]   2> 1891206 T6117 oascc.ConnectionManager.waitForConnected
> Waiting for client to connect to ZooKeeper
>    [junit4]   2> 1891210 T6125 oascc.ConnectionManager.process Watcher
> org.apache.solr.common.cloud.ConnectionManager@1db686b
> name:ZooKeeperConnection Watcher:127.0.0.1:50799 got event WatchedEvent
> state:SyncConnected type:None path:null path:null type:None
>    [junit4]   2> 1891210 T6117 oascc.ConnectionManager.waitForConnected
> Client is connected to ZooKeeper
>    [junit4]   2> 1891211 T6117 oascc.SolrZkClient.createZkACLProvider
> Using default ZkACLProvider
>    [junit4]   2> 1891212 T6117 oascc.SolrZkClient.makePath makePath: /solr
>    [junit4]   2> 1891217 T6117
> oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
> ZkCredentialsProvider
>    [junit4]   2> 1891218 T6117 oascc.ConnectionManager.waitForConnected
> Waiting for client to connect to ZooKeeper
>    [junit4]   2> 1891220 T6128 oascc.ConnectionManager.process Watcher
> org.apache.solr.common.cloud.ConnectionManager@15a5a05
> name:ZooKeeperConnection Watcher:127.0.0.1:50799/solr got event
> WatchedEvent state:SyncConnected type:None path:null path:null type:None
>    [junit4]   2> 1891221 T6117 oascc.ConnectionManager.waitForConnected
> Client is connected to ZooKeeper
>    [junit4]   2> 1891222 T6117 oascc.SolrZkClient.createZkACLProvider
> Using default ZkACLProvider
>    [junit4]   2> 1891222 T6117 oascc.SolrZkClient.makePath makePath:
> /collections/collection1
>    [junit4]   2> 1891227 T6117 oascc.SolrZkClient.makePath makePath:
> /collections/collection1/shards
>    [junit4]   2> 1891231 T6117 oascc.SolrZkClient.makePath makePath:
> /collections/control_collection
>    [junit4]   2> 1891234 T6117 oascc.SolrZkClient.makePath makePath:
> /collections/control_collection/shards
>    [junit4]   2> 1891238 T6117 oasc.AbstractZkTestCase.putConfig put
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml
> to /configs/conf1/solrconfig.xml
>    [junit4]   2> 1891239 T6117 oascc.SolrZkClient.makePath makePath:
> /configs/conf1/solrconfig.xml
>    [junit4]   2> 1891244 T6117 oasc.AbstractZkTestCase.putConfig put
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml
> to /configs/conf1/schema.xml
>    [junit4]   2> 1891245 T6117 oascc.SolrZkClient.makePath makePath:
> /configs/conf1/schema.xml
>    [junit4]   2> 1891249 T6117 oasc.AbstractZkTestCase.putConfig put
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml
> to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
>    [junit4]   2> 1891249 T6117 oascc.SolrZkClient.makePath makePath:
> /configs/conf1/solrconfig.snippet.randomindexconfig.xml
>    [junit4]   2> 1891252 T6117 oasc.AbstractZkTestCase.putConfig put
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt
> to /configs/conf1/stopwords.txt
>    [junit4]   2> 1891252 T6117 oascc.SolrZkClient.makePath makePath:
> /configs/conf1/stopwords.txt
>    [junit4]   2> 1891256 T6117 oasc.AbstractZkTestCase.putConfig put
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt
> to /configs/conf1/protwords.txt
>    [junit4]   2> 1891257 T6117 oascc.SolrZkClient.makePath makePath:
> /configs/conf1/protwords.txt
>    [junit4]   2> 1891261 T6117 oasc.AbstractZkTestCase.putConfig put
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml
> to /configs/conf1/currency.xml
>    [junit4]   2> 1891261 T6117 oascc.SolrZkClient.makePath makePath:
> /configs/conf1/currency.xml
>    [junit4]   2> 1891265 T6117 oasc.AbstractZkTestCase.putConfig put
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml
> to /configs/conf1/enumsConfig.xml
>    [junit4]   2> 1891266 T6117 oascc.SolrZkClient.makePath makePath:
> /configs/conf1/enumsConfig.xml
>    [junit4]   2> 1891270 T6117 oasc.AbstractZkTestCase.putConfig put
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json
> to /configs/conf1/open-exchange-rates.json
>    [junit4]   2> 1891271 T6117 oascc.SolrZkClient.makePath makePath:
> /configs/conf1/open-exchange-rates.json
>    [junit4]   2> 1891275 T6117 oasc.AbstractZkTestCase.putConfig put
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt
> to /configs/conf1/mapping-ISOLatin1Accent.txt
>    [junit4]   2> 1891276 T6117 oascc.SolrZkClient.makePath makePath:
> /configs/conf1/mapping-ISOLatin1Accent.txt
>    [junit4]   2> 1891280 T6117 oasc.AbstractZkTestCase.putConfig put
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt
> to /configs/conf1/old_synonyms.txt
>    [junit4]   2> 1891281 T6117 oascc.SolrZkClient.makePath makePath:
> /configs/conf1/old_synonyms.txt
>    [junit4]   2> 1891285 T6117 oasc.AbstractZkTestCase.putConfig put
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt
> to /configs/conf1/synonyms.txt
>    [junit4]   2> 1891286 T6117 oascc.SolrZkClient.makePath makePath:
> /configs/conf1/synonyms.txt
>    [junit4]   2> Using old style solr.xml
>    [junit4]   2> 1891573 T6117 oejs.Server.doStart jetty-8.1.10.v20130312
>    [junit4]   2> 1891576 T6117 oejs.AbstractConnector.doStart Started
> SelectChannelConnector@127.0.0.1:47474
>    [junit4]   2> 1891577 T6117 oass.SolrDispatchFilter.init
> SolrDispatchFilter.init()
>    [junit4]   2> 1891577 T6117 oasc.SolrResourceLoader.locateSolrHome JNDI
> not configured for solr (NoInitialContextEx)
>    [junit4]   2> 1891578 T6117 oasc.SolrResourceLoader.locateSolrHome
> using system property solr.solr.home:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-002
>    [junit4]   2> 1891578 T6117 oasc.SolrResourceLoader.<init> new
> SolrResourceLoader for directory:
> '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-002/'
>    [junit4]   2> 1891598 T6117 oasc.ConfigSolr.fromFile Loading container
> configuration from
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-002/solr.xml
>    [junit4]   2> 1891648 T6117 oasc.CoreContainer.<init> New CoreContainer
> 24677580
>    [junit4]   2> 1891649 T6117 oasc.CoreContainer.load Loading cores into
> CoreContainer
> [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-002/]
>    [junit4]   2> 1891650 T6117 oashc.HttpShardHandlerFactory.getParameter
> Setting socketTimeout to: 120000
>    [junit4]   2> 1891650 T6117 oashc.HttpShardHandlerFactory.getParameter
> Setting urlScheme to: null
>    [junit4]   2> 1891650 T6117 oashc.HttpShardHandlerFactory.getParameter
> Setting connTimeout to: 15000
>    [junit4]   2> 1891651 T6117 oashc.HttpShardHandlerFactory.getParameter
> Setting maxConnectionsPerHost to: 20
>    [junit4]   2> 1891651 T6117 oashc.HttpShardHandlerFactory.getParameter
> Setting maxConnections to: 10000
>    [junit4]   2> 1891652 T6117 oashc.HttpShardHandlerFactory.getParameter
> Setting corePoolSize to: 0
>    [junit4]   2> 1891652 T6117 oashc.HttpShardHandlerFactory.getParameter
> Setting maximumPoolSize to: 2147483647
>    [junit4]   2> 1891652 T6117 oashc.HttpShardHandlerFactory.getParameter
> Setting maxThreadIdleTime to: 5
>    [junit4]   2> 1891653 T6117 oashc.HttpShardHandlerFactory.getParameter
> Setting sizeOfQueue to: -1
>    [junit4]   2> 1891653 T6117 oashc.HttpShardHandlerFactory.getParameter
> Setting fairnessPolicy to: false
>    [junit4]   2> 1891654 T6117 oasu.UpdateShardHandler.<init> Creating
> UpdateShardHandler HTTP client with params:
> socketTimeout=3400000&connTimeout=45000&retry=false
>    [junit4]   2> 1891654 T6117 oasl.LogWatcher.createWatcher SLF4J impl is
> org.slf4j.impl.Log4jLoggerFactory
>    [junit4]   2> 1891654 T6117 oasl.LogWatcher.newRegisteredLogWatcher
> Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
>    [junit4]   2> 1891655 T6117 oasc.CoreContainer.load Host Name: 127.0.0.1
>    [junit4]   2> 1891655 T6117 oasc.ZkContainer.initZooKeeper Zookeeper
> client=127.0.0.1:50799/solr
>    [junit4]   2> 1891655 T6117 oasc.ZkController.checkChrootPath zkHost
> includes chroot
>    [junit4]   2> 1891656 T6117
> oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
> ZkCredentialsProvider
>    [junit4]   2> 1891657 T6117 oascc.ConnectionManager.waitForConnected
> Waiting for client to connect to ZooKeeper
>    [junit4]   2> 1891658 T6140 oascc.ConnectionManager.process Watcher
> org.apache.solr.common.cloud.ConnectionManager@13b6fc5
> name:ZooKeeperConnection Watcher:127.0.0.1:50799 got event WatchedEvent
> state:SyncConnected type:None path:null path:null type:None
>    [junit4]   2> 1891659 T6117 oascc.ConnectionManager.waitForConnected
> Client is connected to ZooKeeper
>    [junit4]   2> 1891660 T6117 oascc.SolrZkClient.createZkACLProvider
> Using default ZkACLProvider
>    [junit4]   2> 1891662 T6117 oascc.ConnectionManager.waitForConnected
> Waiting for client to connect to ZooKeeper
>    [junit4]   2> 1891663 T6143 oascc.ConnectionManager.process Watcher
> org.apache.solr.common.cloud.ConnectionManager@19b295c
> name:ZooKeeperConnection Watcher:127.0.0.1:50799/solr got event
> WatchedEvent state:SyncConnected type:None path:null path:null type:None
>    [junit4]   2> 1891663 T6117 oascc.ConnectionManager.waitForConnected
> Client is connected to ZooKeeper
>    [junit4]   2> 1891665 T6117 oascc.SolrZkClient.makePath makePath:
> /overseer/queue
>    [junit4]   2> 1891669 T6117 oascc.SolrZkClient.makePath makePath:
> /overseer/collection-queue-work
>    [junit4]   2> 1891672 T6117 oascc.SolrZkClient.makePath makePath:
> /overseer/collection-map-running
>    [junit4]   2> 1891675 T6117 oascc.SolrZkClient.makePath makePath:
> /overseer/collection-map-completed
>    [junit4]   2> 1891679 T6117 oascc.SolrZkClient.makePath makePath:
> /overseer/collection-map-failure
>    [junit4]   2> 1891683 T6117 oascc.SolrZkClient.makePath makePath:
> /live_nodes
>    [junit4]   2> 1891686 T6117 oasc.ZkController.createEphemeralLiveNode
> Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47474_
>    [junit4]   2> 1891687 T6117 oascc.SolrZkClient.makePath makePath:
> /live_nodes/127.0.0.1:47474_
>    [junit4]   2> 1891692 T6117 oascc.SolrZkClient.makePath makePath:
> /overseer_elect
>    [junit4]   2> 1891695 T6117 oascc.SolrZkClient.makePath makePath:
> /overseer_elect/election
>    [junit4]   2> 1891699 T6117 oasc.Overseer.close Overseer (id=null)
> closing
>    [junit4]   2> 1891703 T6117
> oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader
> 127.0.0.1:47474_
>    [junit4]   2> 1891704 T6117 oascc.SolrZkClient.makePath makePath:
> /overseer_elect/leader
>    [junit4]   2> 1891708 T6117 oasc.Overseer.start Overseer
> (id=92989978420707331-127.0.0.1:47474_-n_0000000000) starting
>    [junit4]   2> 1891710 T6117 oascc.SolrZkClient.makePath makePath:
> /overseer/queue-work
>    [junit4]   2> 1891717 T6117
> oasc.OverseerAutoReplicaFailoverThread.<init> Starting
> OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000
> autoReplicaFailoverWaitAfterExpiration=30000
> autoReplicaFailoverBadNodeExpiration=60000
>    [junit4]   2> 1891718 T6145 oasc.OverseerCollectionProcessor.run
> Process current queue of collection creations
>    [junit4]   2> 1891719 T6117 oascc.SolrZkClient.makePath makePath:
> /clusterstate.json
>    [junit4]   2> 1891722 T6117 oascc.SolrZkClient.makePath makePath:
> /aliases.json
>    [junit4]   2> 1891725 T6117
> oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster
> state from ZooKeeper...
>    [junit4]   2> 1891731 T6144 oasc.Overseer$ClusterStateUpdater.run
> Starting to work on the main queue
>    [junit4]   2> 1891734 T6117 oass.SolrDispatchFilter.init
> user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
>    [junit4]   2> 1891735 T6117 oass.SolrDispatchFilter.init
> SolrDispatchFilter.init() done
>    [junit4]   2> 1891736 T6117
> oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
> ZkCredentialsProvider
>    [junit4]   2> 1891738 T6117 oascc.ConnectionManager.waitForConnected
> Waiting for client to connect to ZooKeeper
>    [junit4]   2> 1891739 T6150 oascc.ConnectionManager.process Watcher
> org.apache.solr.common.cloud.ConnectionManager@6e2f6f
> name:ZooKeeperConnection Watcher:127.0.0.1:50799/solr got event
> WatchedEvent state:SyncConnected type:None path:null path:null type:None
>    [junit4]   2> 1891740 T6117 oascc.ConnectionManager.waitForConnected
> Client is connected to ZooKeeper
>    [junit4]   2> 1891740 T6117 oascc.SolrZkClient.createZkACLProvider
> Using default ZkACLProvider
>    [junit4]   2> 1891742 T6117
> oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster
> state from ZooKeeper...
>    [junit4]   2> 1891748 T6117 oasc.ChaosMonkey.monkeyLog monkey: init -
> expire sessions:false cause connection loss:false
>    [junit4]   2> 1891748 T6117
> oasc.AbstractFullDistribZkTestBase.createJettys Creating collection1 with
> stateFormat=2
>    [junit4]   2> 1891749 T6117
> oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
> ZkCredentialsProvider
>    [junit4]   2> 1891750 T6117 oascc.ConnectionManager.waitForConnected
> Waiting for client to connect to ZooKeeper
>    [junit4]   2> 1891752 T6153 oascc.ConnectionManager.process Watcher
> org.apache.solr.common.cloud.ConnectionManager@13b0c23
> name:ZooKeeperConnection Watcher:127.0.0.1:50799/solr got event
> WatchedEvent state:SyncConnected type:None path:null path:null type:None
>    [junit4]   2> 1891753 T6117 oascc.ConnectionManager.waitForConnected
> Client is connected to ZooKeeper
>    [junit4]   2> 1891753 T6117 oascc.SolrZkClient.createZkACLProvider
> Using default ZkACLProvider
>    [junit4]   2> 1891757 T6143 oasc.DistributedQueue$LatchWatcher.process
> NodeChildrenChanged fired on path /overseer/queue state SyncConnected
>    [junit4]   2> 1891764 T6144 oasc.Overseer$ClusterStateUpdater.run
> processMessage: queueSize: 0, message = {
>    [junit4]   2>          "operation":"create",
>    [junit4]   2>          "name":"collection1",
>    [junit4]   2>          "numShards":"2",
>    [junit4]   2>          "stateFormat":2} current state version: 0
>    [junit4]   2> 1891765 T6144 oasco.ClusterStateMutator.createCollection
> building a new cName: collection1
>    [junit4]   2> 1891766 T6144 oasco.ZkStateWriter.writePendingUpdates
> going to create_collection /collections/collection1/state.json
>    [junit4]   2> 1891768 T6143 oascc.ZkStateReader$2.process A cluster
> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
>    [junit4]   2> 1891768 T6150 oascc.ZkStateReader$2.process A cluster
> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
>    [junit4]   2> 1892028 T6117
> oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
>    [junit4]   2> 1892029 T6117 oejs.Server.doStart jetty-8.1.10.v20130312
>    [junit4]   2> 1892030 T6117 oejs.AbstractConnector.doStart Started
> SelectChannelConnector@127.0.0.1:46875
>    [junit4]   2> 1892032 T6117 oass.SolrDispatchFilter.init
> SolrDispatchFilter.init()
>    [junit4]   2> 1892032 T6117 oasc.SolrResourceLoader.locateSolrHome JNDI
> not configured for solr (NoInitialContextEx)
>    [junit4]   2> 1892032 T6117 oasc.SolrResourceLoader.locateSolrHome
> using system property solr.solr.home:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-003
>    [junit4]   2> 1892033 T6117 oasc.SolrResourceLoader.<init> new
> SolrResourceLoader for directory:
> '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-003/'
>    [junit4]   2> 1892049 T6117 oasc.ConfigSolr.fromFile Loading container
> configuration from
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-003/solr.xml
>    [junit4]   2> 1892061 T6117 oasc.CoreContainer.<init> New CoreContainer
> 28548621
>    [junit4]   2> 1892062 T6117 oasc.CoreContainer.load Loading cores into
> CoreContainer
> [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-003/]
>    [junit4]   2> 1892063 T6117 oashc.HttpShardHandlerFactory.getParameter
> Setting socketTimeout to: 120000
>    [junit4]   2> 1892063 T6117 oashc.HttpShardHandlerFactory.getParameter
> Setting urlScheme to: null
>    [junit4]   2> 1892063 T6117 oashc.HttpShardHandlerFactory.getParameter
> Setting connTimeout to: 15000
>    [junit4]   2> 1892064 T6117 oashc.HttpShardHandlerFactory.getParameter
> Setting maxConnectionsPerHost to: 20
>    [junit4]   2> 1892064 T6117 oashc.HttpShardHandlerFactory.getParameter
> Setting maxConnections to: 10000
>    [junit4]   2> 1892064 T6117 oashc.HttpShardHandlerFactory.getParameter
> Setting corePoolSize to: 0
>    [junit4]   2> 1892065 T6117 oashc.HttpShardHandlerFactory.getParameter
> Setting maximumPoolSize to: 2147483647
>    [junit4]   2> 1892065 T6117 oashc.HttpShardHandlerFactory.getParameter
> Setting maxThreadIdleTime to: 5
>    [junit4]   2> 1892066 T6117 oashc.HttpShardHandlerFactory.getParameter
> Setting sizeOfQueue to: -1
>    [junit4]   2> 1892066 T6117 oashc.HttpShardHandlerFactory.getParameter
> Setting fairnessPolicy to: false
>    [junit4]   2> 1892066 T6117 oasu.UpdateShardHandler.<init> Creating
> UpdateShardHandler HTTP client with params:
> socketTimeout=3400000&connTimeout=45000&retry=false
>    [junit4]   2> 1892067 T6117 oasl.LogWatcher.createWatcher SLF4J impl is
> org.slf4j.impl.Log4jLoggerFactory
>    [junit4]   2> 1892067 T6117 oasl.LogWatcher.newRegisteredLogWatcher
> Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
>    [junit4]   2> 1892068 T6117 oasc.CoreContainer.load Host Name: 127.0.0.1
>    [junit4]   2> 1892068 T6117 oasc.ZkContainer.initZooKeeper Zookeeper
> client=127.0.0.1:50799/solr
>    [junit4]   2> 1892069 T6117 oasc.ZkController.checkChrootPath zkHost
> includes chroot
>    [junit4]   2> 1892069 T6117
> oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
> ZkCredentialsProvider
>    [junit4]   2> 1892070 T6117 oascc.ConnectionManager.waitForConnected
> Waiting for client to connect to ZooKeeper
>    [junit4]   2> 1892072 T6165 oascc.ConnectionManager.process Watcher
> org.apache.solr.common.cloud.ConnectionManager@2795f9
> name:ZooKeeperConnection Watcher:127.0.0.1:50799 got event WatchedEvent
> state:SyncConnected type:None path:null path:null type:None
>    [junit4]   2> 1892073 T6117 oascc.ConnectionManager.waitForConnected
> Client is connected to ZooKeeper
>    [junit4]   2> 1892074 T6117 oascc.SolrZkClient.createZkACLProvider
> Using default ZkACLProvider
>    [junit4]   2> 1892076 T6117 oascc.ConnectionManager.waitForConnected
> Waiting for client to connect to ZooKeeper
>    [junit4]   2> 1892078 T6168 oascc.ConnectionManager.process Watcher
> org.apache.solr.common.cloud.ConnectionManager@ab6a13
> name:ZooKeeperConnection Watcher:127.0.0.1:50799/solr got event
> WatchedEvent state:SyncConnected type:None path:null path:null type:None
>    [junit4]   2> 1892078 T6117 oascc.ConnectionManager.waitForConnected
> Client is connected to ZooKeeper
>    [junit4]   2> 1892084 T6117
> oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster
> state from ZooKeeper...
>    [junit4]   2> 1893091 T6117 oasc.ZkController.createEphemeralLiveNode
> Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46875_
>    [junit4]   2> 1893093 T6117 oascc.SolrZkClient.makePath makePath:
> /live_nodes/127.0.0.1:46875_
>    [junit4]   2> 1893098 T6117 oasc.Overseer.close Overseer (id=null)
> closing
>    [junit4]   2> 1893104 T6117 oass.SolrDispatchFilter.init
> user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
>    [junit4]   2> 1893106 T6117 oass.SolrDispatchFilter.init
> SolrDispatchFilter.init() done
>    [junit4]   2> 1893374 T6117
> oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
>    [junit4]   2> 1893375 T6117 oejs.Server.doStart jetty-8.1.10.v20130312
>    [junit4]   2> 1893377 T6117 oejs.AbstractConnector.doStart Started
> SelectChannelConnector@127.0.0.1:57048
>    [junit4]   2> 1893377 T6117 oass.SolrDispatchFilter.init
> SolrDispatchFilter.init()
>    [junit4]   2> 1893378 T6117 oasc.SolrResourceLoader.locateSolrHome JNDI
> not configured for solr (NoInitialContextEx)
>    [junit4]   2> 1893378 T6117 oasc.SolrResourceLoader.locateSolrHome
> using system property solr.solr.home:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-004
>    [junit4]   2> 1893379 T6117 oasc.SolrResourceLoader.<init> new
> SolrResourceLoader for directory:
> '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-004/'
>    [junit4]   2> 1893406 T6117 oasc.ConfigSolr.fromFile Loading container
> configuration from
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-004/solr.xml
>    [junit4]   2> 1893423 T6117 oasc.CoreContainer.<init> New CoreContainer
> 21716652
>    [junit4]   2> 1893424 T6117 oasc.CoreContainer.load Loading cores into
> CoreContainer
> [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-004/]
>    [junit4]   2> 1893425 T6117 oashc.HttpShardHandlerFactory.getParameter
> Setting socketTimeout to: 120000
>    [junit4]   2> 1893425 T6117 oashc.HttpShardHandlerFactory.getParameter
> Setting urlScheme to: null
>    [junit4]   2> 1893426 T6117 oashc.HttpShardHandlerFactory.getParameter
> Setting connTimeout to: 15000
>    [junit4]   2> 1893426 T6117 oashc.HttpShardHandlerFactory.getParameter
> Setting maxConnectionsPerHost to: 20
>    [junit4]   2> 1893427 T6117 oashc.HttpShardHandlerFactory.getParameter
> Setting maxConnections to: 10000
>    [junit4]   2> 1893427 T6117 oashc.HttpShardHandlerFactory.getParameter
> Setting corePoolSize to: 0
>    [junit4]   2> 1893427 T6117 oashc.HttpShardHandlerFactory.getParameter
> Setting maximumPoolSize to: 2147483647
>    [junit4]   2> 1893428 T6117 oashc.HttpShardHandlerFactory.getParameter
> Setting maxThreadIdleTime to: 5
>    [junit4]   2> 1893428 T6117 oashc.HttpShardHandlerFactory.getParameter
> Setting sizeOfQueue to: -1
>    [junit4]   2> 1893429 T6117 oashc.HttpShardHandlerFactory.getParameter
> Setting fairnessPolicy to: false
>    [junit4]   2> 1893429 T6117 oasu.UpdateShardHandler.<init> Creating
> UpdateShardHandler HTTP client with params:
> socketTimeout=3400000&connTimeout=45000&retry=false
>    [junit4]   2> 1893430 T6117 oasl.LogWatcher.createWatcher SLF4J impl is
> org.slf4j.impl.Log4jLoggerFactory
>    [junit4]   2> 1893430 T6117 oasl.LogWatcher.newRegisteredLogWatcher
> Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
>    [junit4]   2> 1893431 T6117 oasc.CoreContainer.load Host Name: 127.0.0.1
>    [junit4]   2> 1893431 T6117 oasc.ZkContainer.initZooKeeper Zookeeper
> client=127.0.0.1:50799/solr
>    [junit4]   2> 1893432 T6117 oasc.ZkController.checkChrootPath zkHost
> includes chroot
>    [junit4]   2> 1893432 T6117
> oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
> ZkCredentialsProvider
>    [junit4]   2> 1893433 T6117 oascc.ConnectionManager.waitForConnected
> Waiting for client to connect to ZooKeeper
>    [junit4]   2> 1893436 T6181 oascc.ConnectionManager.process Watcher
> org.apache.solr.common.cloud.ConnectionManager@c50527
> name:ZooKeeperConnection Watcher:127.0.0.1:50799 got event WatchedEvent
> state:SyncConnected type:None path:null path:null type:None
>    [junit4]   2> 1893437 T6117 oascc.ConnectionManager.waitForConnected
> Client is connected to ZooKeeper
>    [junit4]   2> 1893437 T6117 oascc.SolrZkClient.createZkACLProvider
> Using default ZkACLProvider
>    [junit4]   2> 1893439 T6117 oascc.ConnectionManager.waitForConnected
> Waiting for client to connect to ZooKeeper
>    [junit4]   2> 1893441 T6184 oascc.ConnectionManager.process Watcher
> org.apache.solr.common.cloud.ConnectionManager@17991b7
> name:ZooKeeperConnection Watcher:127.0.0.1:50799/solr got event
> WatchedEvent state:SyncConnected type:None path:null path:null type:None
>    [junit4]   2> 1893442 T6117 oascc.ConnectionManager.waitForConnected
> Client is connected to ZooKeeper
>    [junit4]   2> 1893450 T6117
> oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster
> state from ZooKeeper...
>    [junit4]   2> 1894458 T6117 oasc.ZkController.createEphemeralLiveNode
> Register node as live in ZooKeeper:/live_nodes/127.0.0.1:57048_
>    [junit4]   2> 1894460 T6117 oascc.SolrZkClient.makePath makePath:
> /live_nodes/127.0.0.1:57048_
>    [junit4]   2> 1894464 T6117 oasc.Overseer.close Overseer (id=null)
> closing
>    [junit4]   2> 1894466 T6117 oass.SolrDispatchFilter.init
> user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
>    [junit4]   2> 1894466 T6117 oass.SolrDispatchFilter.init
> SolrDispatchFilter.init() done
>    [junit4]   2> 1894728 T6117
> oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
>    [junit4]   2> 1894728 T6117 oejs.Server.doStart jetty-8.1.10.v20130312
>    [junit4]   2> 1894730 T6117 oejs.AbstractConnector.doStart Started
> SelectChannelConnector@127.0.0.1:34745
>    [junit4]   2> 1894731 T6117 oass.SolrDispatchFilter.init
> SolrDispatchFilter.init()
>    [junit4]   2> 1894731 T6117 oasc.SolrResourceLoader.locateSolrHome JNDI
> not configured for solr (NoInitialContextEx)
>    [junit4]   2> 1894732 T6117 oasc.SolrResourceLoader.locateSolrHome
> using system property solr.solr.home:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-005
>    [junit4]   2> 1894732 T6117 oasc.SolrResourceLoader.<init> new
> SolrResourceLoader for directory:
> '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-005/'
>    [junit4]   2> 1894747 T6117 oasc.ConfigSolr.fromFile Loading container
> configuration from
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-005/solr.xml
>    [junit4]   2> 1894761 T6117 oasc.CoreContainer.<init> New CoreContainer
> 1265021
>    [junit4]   2> 1894762 T6117 oasc.CoreContainer.load Loading cores into
> CoreContainer
> [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-005/]
>    [junit4]   2> 1894762 T6117 oashc.HttpShardHandlerFactory.getParameter
> Setting socketTimeout to: 120000
>    [junit4]   2> 1894763 T6117 oashc.HttpShardHandlerFactory.getParameter
> Setting urlScheme to: null
>    [junit4]   2> 1894763 T6117 oashc.HttpShardHandlerFactory.getParameter
> Setting connTimeout to: 15000
>    [junit4]   2> 1894763 T6117 oashc.HttpShardHandlerFactory.getParameter
> Setting maxConnectionsPerHost to: 20
>    [junit4]   2> 1894764 T6117 oashc.HttpShardHandlerFactory.getParameter
> Setting maxConnections to: 10000
>    [junit4]   2> 1894764 T6117 oashc.HttpShardHandlerFactory.getParameter
> Setting corePoolSize to: 0
>    [junit4]   2> 1894764 T6117 oashc.HttpShardHandlerFactory.getParameter
> Setting maximumPoolSize to: 2147483647
>    [junit4]   2> 1894765 T6117 oashc.HttpShardHandlerFactory.getParameter
> Setting maxThreadIdleTime to: 5
>    [junit4]   2> 1894765 T6117 oashc.HttpShardHandlerFactory.getParameter
> Setting sizeOfQueue to: -1
>    [junit4]   2> 1894765 T6117 oashc.HttpShardHandlerFactory.getParameter
> Setting fairnessPolicy to: false
>    [junit4]   2> 1894766 T6117 oasu.UpdateShardHandler.<init> Creating
> UpdateShardHandler HTTP client with params:
> socketTimeout=3400000&connTimeout=45000&retry=false
>    [junit4]   2> 1894766 T6117 oasl.LogWatcher.createWatcher SLF4J impl is
> org.slf4j.impl.Log4jLoggerFactory
>    [junit4]   2> 1894767 T6117 oasl.LogWatcher.newRegisteredLogWatcher
> Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
>    [junit4]   2> 1894767 T6117 oasc.CoreContainer.load Host Name: 127.0.0.1
>    [junit4]   2> 1894767 T6117 oasc.ZkContainer.initZooKeeper Zookeeper
> client=127.0.0.1:50799/solr
>    [junit4]   2> 1894768 T6117 oasc.ZkController.checkChrootPath zkHost
> includes chroot
>    [junit4]   2> 1894768 T6117
> oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
> ZkCredentialsProvider
>    [junit4]   2> 1894769 T6117 oascc.ConnectionManager.waitForConnected
> Waiting for client to connect to ZooKeeper
>    [junit4]   2> 1894770 T6197 oascc.ConnectionManager.process Watcher
> org.apache.solr.common.cloud.ConnectionManager@1eadb73
> name:ZooKeeperConnection Watcher:127.0.0.1:50799 got event WatchedEvent
> state:SyncConnected type:None path:null path:null type:None
>    [junit4]   2> 1894771 T6117 oascc.ConnectionManager.waitForConnected
> Client is connected to ZooKeeper
>    [junit4]   2> 1894771 T6117 oascc.SolrZkClient.createZkACLProvider
> Using default ZkACLProvider
>    [junit4]   2> 1894773 T6117 oascc.ConnectionManager.waitForConnected
> Waiting for client to connect to ZooKeeper
>    [junit4]   2> 1894775 T6200 oascc.ConnectionManager.process Watcher
> org.apache.solr.common.cloud.ConnectionManager@15e15bb
> name:ZooKeeperConnection Watcher:127.0.0.1:50799/solr got event
> WatchedEvent state:SyncConnected type:None path:null path:null type:None
>    [junit4]   2> 1894775 T6117 oascc.ConnectionManager.waitForConnected
> Client is connected to ZooKeeper
>    [junit4]   2> 1894784 T6117
> oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster
> state from ZooKeeper...
>    [junit4]   2> 1895789 T6117 oasc.ZkController.createEphemeralLiveNode
> Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34745_
>    [junit4]   2> 1895791 T6117 oascc.SolrZkClient.makePath makePath:
> /live_nodes/127.0.0.1:34745_
>    [junit4]   2> 1895796 T6117 oasc.Overseer.close Overseer (id=null)
> closing
>    [junit4]   2> 1895800 T6117 oass.SolrDispatchFilter.init
> user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
>    [junit4]   2> 1895801 T6117 oass.SolrDispatchFilter.init
> SolrDispatchFilter.init() done
>    [junit4]   2> 1896155 T6117
> oasc.AbstractFullDistribZkTestBase.createJettys create jetty 4
>    [junit4]   2> 1896156 T6117 oejs.Server.doStart jetty-8.1.10.v20130312
>    [junit4]   2> 1896159 T6117 oejs.AbstractConnector.doStart Started
> SelectChannelConnector@127.0.0.1:50450
>    [junit4]   2> 1896160 T6117 oass.SolrDispatchFilter.init
> SolrDispatchFilter.init()
>    [junit4]   2> 1896160 T6117 oasc.SolrResourceLoader.locateSolrHome JNDI
> not configured for solr (NoInitialContextEx)
>    [junit4]   2> 1896161 T6117 oasc.SolrResourceLoader.locateSolrHome
> using system property solr.solr.home:
> ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-006
>    [junit4]   2> 1896161 T6117 oasc.SolrResourceLoader.<init> new
> SolrResourceLoader for directory:
> '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-006/'
>    [junit4]   2> 1896183 T6117 oasc.ConfigSolr.fromFile Loading container
> configuration from
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-006/solr.xml
>    [junit4]   2> 1896199 T6117 oasc.CoreContainer.<init> New CoreContainer
> 1095776
>    [junit4]   2> 1896199 T6117 oasc.CoreContainer.load Loading cores into
> CoreContainer
> [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-006/]
>    [junit4]   2> 1896200 T6117 oashc.HttpShardHandlerFactory.getParameter
> Setting socketTimeout to: 120000
>    [junit4]   2> 1896200 T6117 oashc.HttpShardHandlerFactory.getParameter
> Setting urlScheme to: null
>    [junit4]   2> 1896200 T6117 oashc.HttpShardHandlerFactory.getParameter
> Setting connTimeout to: 15000
>    [junit4]   2> 1896201 T6117 oashc.HttpShardHandlerFactory.getParameter
> Setting maxConnectionsPerHost to: 20
>    [junit4]   2> 1896201 T6117 oashc.HttpShardHandlerFactory.getParameter
> Setting maxConnections to: 10000
>    [junit4]   2> 1896201 T6117 oashc.HttpShardHandlerFactory.getParameter
> Setting corePoolSize to: 0
>    [junit4]   2> 1896202 T6117 oashc.HttpShardHandlerFactory.getParameter
> Setting maximumPoolSize to: 2147483647
>    [junit4]   2> 1896202 T6117 oashc.HttpShardHandlerFactory.getParameter
> Setting maxThreadIdleTime to: 5
>    [junit4]   2> 1896202 T6117 oashc.HttpShardHandlerFactory.getParameter
> Setting sizeOfQueue to: -1
>    [junit4]   2> 1896203 T6117 oashc.HttpShardHandlerFactory.getParameter
> Setting fairnessPolicy to: false
>    [junit4]   2> 1896203 T6117 oasu.UpdateShardHandler.<init> Creating
> UpdateShardHandler HTTP client with params:
> socketTimeout=3400000&connTimeout=45000&retry=false
>    [junit4]   2> 1896204 T6117 oasl.LogWatcher.createWatcher SLF4J impl is
> org.slf4j.impl.Log4jLoggerFactory
>    [junit4]   2> 1896204 T6117 oasl.LogWatcher.newRegisteredLogWatcher
> Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
>    [junit4]   2> 1896204 T6117 oasc.CoreContainer.load Host Name: 127.0.0.1
>    [junit4]   2> 1896205 T6117 oasc.ZkContainer.initZooKeeper Zookeeper
> client=127.0.0.1:50799/solr
>    [junit4]   2> 1896205 T6117 oasc.ZkController.checkChrootPath zkHost
> includes chroot
>    [junit4]   2> 1896205 T6117
> oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
> ZkCredentialsProvider
>    [junit4]   2> 1896206 T6117 oascc.ConnectionManager.waitForConnected
> Waiting for client to connect to ZooKeeper
>    [junit4]   2> 1896208 T6213 oascc.ConnectionManager.process Watcher
> org.apache.solr.common.cloud.ConnectionManager@16e3e33
> name:ZooKeeperConnection Watcher:127.0.0.1:50799 got event WatchedEvent
> state:SyncConnected type:None path:null path:null type:None
>    [junit4]   2> 1896208 T6117 oascc.ConnectionManager.waitForConnected
> Client is connected to ZooKeeper
>    [junit4]   2> 1896209 T6117 oascc.SolrZkClient.createZkACLProvider
> Using default ZkACLProvider
>    [junit4]   2> 1896210 T6117 oascc.ConnectionManager.waitForConnected
> Waiting for client to connect to ZooKeeper
>    [junit4]   2> 1896211 T6216 oascc.ConnectionManager.process Watcher
> org.apache.solr.common.cloud.ConnectionManager@bf72cd
> name:ZooKeeperConnection Watcher:127.0.0.1:50799/solr got event
> WatchedEvent state:SyncConnected type:None path:null path:null type:None
>    [junit4]   2> 1896211 T6117 oascc.ConnectionManager.waitForConnected
> Client is connected to ZooKeeper
>    [junit4]   2> 1896216 T6117
> oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster
> state from ZooKeeper...
>    [junit4]   2> 1897220 T6117 oasc.ZkController.createEphemeralLiveNode
> Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50450_
>    [junit4]   2> 1897222 T6117 oascc.SolrZkClient.makePath makePath:
> /live_nodes/127.0.0.1:50450_
>    [junit4]   2> 1897226 T6117 oasc.Overseer.close Overseer (id=null)
> closing
>    [junit4]   2> 1897229 T6117 oass.SolrDispatchFilter.init
> user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
>    [junit4]   2> 1897229 T6117 oass.SolrDispatchFilter.init
> SolrDispatchFilter.init() done
>    [junit4]   2> 1897237 T6160 oasha.CollectionsHandler.handleCreateAction
> Creating Collection :
> replicationFactor=2&collection.configName=conf1&router.field=myOwnField&name=solrj_collection&action=CREATE&numShards=2&wt=javabin&version=2
>    [junit4]   2> 1897239 T6143 oasc.DistributedQueue$LatchWatcher.process
> NodeChildrenChanged fired on path /overseer/collection-queue-work state
> SyncConnected
>    [junit4]   2> 1897244 T6145 oasc.OverseerCollectionProcessor.run
> Overseer Collection Processor: Get the message
> id:/overseer/collection-queue-work/qn-0000000000 message:{
>    [junit4]   2>          "operation":"create",
>    [junit4]   2>          "fromApi":"true",
>    [junit4]   2>          "name":"solrj_collection",
>    [junit4]   2>          "replicationFactor":"2",
>    [junit4]   2>          "collection.configName":"conf1",
>    [junit4]   2>          "numShards":"2",
>    [junit4]   2>          "router.field":"myOwnField"}
>    [junit4]   2> 1897245 T6218
> oasc.OverseerCollectionProcessor.processMessage WARN
> OverseerCollectionProcessor.processMessage : create , {
>    [junit4]   2>          "operation":"create",
>    [junit4]   2>          "fromApi":"true",
>    [junit4]   2>          "name":"solrj_collection",
>    [junit4]   2>          "replicationFactor":"2",
>    [junit4]   2>          "collection.configName":"conf1",
>    [junit4]   2>          "numShards":"2",
>    [junit4]   2>          "router.field":"myOwnField"}
>    [junit4]   2> 1897245 T6218
> oasc.OverseerCollectionProcessor.createConfNode creating collections conf
> node /collections/solrj_collection
>    [junit4]   2> 1897246 T6218 oascc.SolrZkClient.makePath makePath:
> /collections/solrj_collection
>    [junit4]   2> 1897248 T6143 oasc.DistributedQueue$LatchWatcher.process
> NodeChildrenChanged fired on path /overseer/queue state SyncConnected
>    [junit4]   2> 1897249 T6144 oasc.Overseer$ClusterStateUpdater.run
> processMessage: queueSize: 1, message = {
>    [junit4]   2>          "operation":"create",
>    [junit4]   2>          "fromApi":"true",
>    [junit4]   2>          "name":"solrj_collection",
>    [junit4]   2>          "replicationFactor":"2",
>    [junit4]   2>          "collection.configName":"conf1",
>    [junit4]   2>          "numShards":"2",
>    [junit4]   2>          "router.field":"myOwnField"} current state
> version: 1
>    [junit4]   2> 1897250 T6144 oasco.ClusterStateMutator.createCollection
> building a new cName: solrj_collection
>    [junit4]   2> 1897250 T6200 oascc.ZkStateReader$2.process A cluster
> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
>    [junit4]   2> 1897251 T6143 oascc.ZkStateReader$2.process A cluster
> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
>    [junit4]   2> 1897251 T6168 oascc.ZkStateReader$2.process A cluster
> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
>    [junit4]   2> 1897250 T6216 oascc.ZkStateReader$2.process A cluster
> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
>    [junit4]   2> 1897250 T6184 oascc.ZkStateReader$2.process A cluster
> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
>    [junit4]   2> 1897250 T6150 oascc.ZkStateReader$2.process A cluster
> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
>    [junit4]   2> 1897449 T6218
> oasc.OverseerCollectionProcessor.createCollection Creating SolrCores for
> new collection solrj_collection, shardNames [shard1, shard2] ,
> replicationFactor : 2
>    [junit4]   2> 1897449 T6218
> oasc.OverseerCollectionProcessor.createCollection Creating shard
> solrj_collection_shard1_replica1 as part of slice shard1 of collection
> solrj_collection on 127.0.0.1:34745_
>    [junit4]   2> 1897450 T6218
> oasc.OverseerCollectionProcessor.createCollection Creating shard
> solrj_collection_shard1_replica2 as part of slice shard1 of collection
> solrj_collection on 127.0.0.1:46875_
>    [junit4]   2> 1897450 T6218
> oasc.OverseerCollectionProcessor.createCollection Creating shard
> solrj_collection_shard2_replica1 as part of slice shard2 of collection
> solrj_collection on 127.0.0.1:57048_
>    [junit4]   2> 1897452 T6218
> oasc.OverseerCollectionProcessor.createCollection Creating shard
> solrj_collection_shard2_replica2 as part of slice shard2 of collection
> solrj_collection on 127.0.0.1:50450_
>    [junit4]   2> 1897452 T6191 oasha.CoreAdminHandler.handleCreateAction
> core create command
> qt=/admin/cores&collection.configName=conf1&name=solrj_collection_shard1_replica1&action=CREATE&numShards=2&collection=solrj_collection&shard=shard1&wt=javabin&version=2
>    [junit4]   2> 1897452 T6162 oasha.CoreAdminHandler.handleCreateAction
> core create command
> qt=/admin/cores&collection.configName=conf1&name=solrj_collection_shard1_replica2&action=CREATE&numShards=2&collection=solrj_collection&shard=shard1&wt=javabin&version=2
>    [junit4]   2> 1897452 T6175 oasha.CoreAdminHandler.handleCreateAction
> core create command
> qt=/admin/cores&collection.configName=conf1&name=solrj_collection_shard2_replica1&action=CREATE&numShards=2&collection=solrj_collection&shard=shard2&wt=javabin&version=2
>    [junit4]   2> 1897454 T6191 oasc.ZkController.publish publishing
> core=solrj_collection_shard1_replica1 state=down collection=solrj_collection
>    [junit4]   2> 1897454 T6207 oasha.CoreAdminHandler.handleCreateAction
> core create command
> qt=/admin/cores&collection.configName=conf1&name=solrj_collection_shard2_replica2&action=CREATE&numShards=2&collection=solrj_collection&shard=shard2&wt=javabin&version=2
>    [junit4]   2> 1897455 T6162 oasc.ZkController.publish publishing
> core=solrj_collection_shard1_replica2 state=down collection=solrj_collection
>    [junit4]   2> 1897456 T6143 oasc.DistributedQueue$LatchWatcher.process
> NodeChildrenChanged fired on path /overseer/queue state SyncConnected
>    [junit4]   2> 1897455 T6191 oasc.ZkController.waitForCoreNodeName look
> for our core node name
>    [junit4]   2> 1897455 T6175 oasc.ZkController.publish publishing
> core=solrj_collection_shard2_replica1 state=down collection=solrj_collection
>    [junit4]   2> 1897456 T6207 oasc.ZkController.publish publishing
> core=solrj_collection_shard2_replica2 state=down collection=solrj_collection
>    [junit4]   2> 1897457 T6144 oasc.Overseer$ClusterStateUpdater.run
> processMessage: queueSize: 2, message = {
>    [junit4]   2>          "core":"solrj_collection_shard1_replica1",
>    [junit4]   2>          "roles":null,
>    [junit4]   2>          "base_url":"http://127.0.0.1:34745",
>    [junit4]   2>          "node_name":"127.0.0.1:34745_",
>    [junit4]   2>          "numShards":"2",
>    [junit4]   2>          "state":"down",
>    [junit4]   2>          "shard":"shard1",
>    [junit4]   2>          "collection":"solrj_collection",
>    [junit4]   2>          "operation":"state"} current state version: 2
>    [junit4]   2> 1897456 T6162 oasc.ZkController.waitForCoreNodeName look
> for our core node name
>    [junit4]   2> 1897458 T6144 oasco.ReplicaMutator.updateState Update
> state numShards=2 message={
>    [junit4]   2>          "core":"solrj_collection_shard1_replica1",
>    [junit4]   2>          "roles":null,
>    [junit4]   2>          "base_url":"http://127.0.0.1:34745",
>    [junit4]   2>          "node_name":"127.0.0.1:34745_",
>    [junit4]   2>          "numShards":"2",
>    [junit4]   2>          "state":"down",
>    [junit4]   2>          "shard":"shard1",
>    [junit4]   2>          "collection":"solrj_collection",
>    [junit4]   2>          "operation":"state"}
>    [junit4]   2> 1897458 T6207 oasc.ZkController.waitForCoreNodeName look
> for our core node name
>    [junit4]   2> 1897457 T6175 oasc.ZkController.waitForCoreNodeName look
> for our core node name
>    [junit4]   2> 1897461 T6144 oasc.Overseer$ClusterStateUpdater.run
> processMessage: queueSize: 3, message = {
>    [junit4]   2>          "core":"solrj_collection_shard1_replica2",
>    [junit4]   2>          "roles":null,
>    [junit4]   2>          "base_url":"http://127.0.0.1:46875",
>    [junit4]   2>          "node_name":"127.0.0.1:46875_",
>    [junit4]   2>          "numShards":"2",
>    [junit4]   2>          "state":"down",
>    [junit4]   2>          "shard":"shard1",
>    [junit4]   2>          "collection":"solrj_collection",
>    [junit4]   2>          "operation":"state"} current state version: 2
>    [junit4]   2> 1897462 T6144 oasco.ReplicaMutator.updateState Update
> state numShards=2 message={
>    [junit4]   2>          "core":"solrj_collection_shard1_replica2",
>    [junit4]   2>          "roles":null,
>    [junit4]   2>          "base_url":"http://127.0.0.1:46875",
>    [junit4]   2>          "node_name":"127.0.0.1:46875_",
>    [junit4]   2>          "numShards":"2",
>    [junit4]   2>          "state":"down",
>    [junit4]   2>          "shard":"shard1",
>    [junit4]   2>          "collection":"solrj_collection",
>    [junit4]   2>          "operation":"state"}
>    [junit4]   2> 1897463 T6143 oasc.DistributedQueue$LatchWatcher.process
> NodeChildrenChanged fired on path /overseer/queue state SyncConnected
>    [junit4]   2> 1897464 T6144 oasc.Overseer$ClusterStateUpdater.run
> processMessage: queueSize: 2, message = {
>    [junit4]   2>          "core":"solrj_collection_shard2_replica1",
>    [junit4]   2>          "roles":null,
>    [junit4]   2>          "base_url":"http://127.0.0.1:57048",
>    [junit4]   2>          "node_name":"127.0.0.1:57048_",
>    [junit4]   2>          "numShards":"2",
>    [junit4]   2>          "state":"down",
>    [junit4]   2>          "shard":"shard2",
>    [junit4]   2>          "collection":"solrj_collection",
>    [junit4]   2>          "operation":"state"} current state version: 2
>    [junit4]   2> 1897465 T6144 oasco.ReplicaMutator.updateState Update
> state numShards=2 message={
>    [junit4]   2>          "core":"solrj_collection_shard2_replica1",
>    [junit4]   2>          "roles":null,
>    [junit4]   2>          "base_url":"http://127.0.0.1:57048",
>    [junit4]   2>          "node_name":"127.0.0.1:57048_",
>    [junit4]   2>          "numShards":"2",
>    [junit4]   2>          "state":"down",
>    [junit4]   2>          "shard":"shard2",
>    [junit4]   2>          "collection":"solrj_collection",
>    [junit4]   2>          "operation":"state"}
>    [junit4]   2> 1897467 T6143 oasc.DistributedQueue$LatchWatcher.process
> NodeChildrenChanged fired on path /overseer/queue state SyncConnected
>    [junit4]   2> 1897468 T6144 oasc.Overseer$ClusterStateUpdater.run
> processMessage: queueSize: 2, message = {
>    [junit4]   2>          "core":"solrj_collection_shard2_replica2",
>    [junit4]   2>          "roles":null,
>    [junit4]   2>          "base_url":"http://127.0.0.1:50450",
>    [junit4]   2>          "node_name":"127.0.0.1:50450_",
>    [junit4]   2>          "numShards":"2",
>    [junit4]   2>          "state":"down",
>    [junit4]   2>          "shard":"shard2",
>    [junit4]   2>          "collection":"solrj_collection",
>    [junit4]   2>          "operation":"state"} current state version: 2
>    [junit4]   2> 1897468 T6144 oasco.ReplicaMutator.updateState Update
> state numShards=2 message={
>    [junit4]   2>          "core":"solrj_collection_shard2_replica2",
>    [junit4]   2>          "roles":null,
>    [junit4]   2>          "base_url":"http://127.0.0.1:50450",
>    [junit4]   2>          "node_name":"127.0.0.1:50450_",
>    [junit4]   2>          "numShards":"2",
>    [junit4]   2>          "state":"down",
>    [junit4]   2>          "shard":"shard2",
>    [junit4]   2>          "collection":"solrj_collection",
>    [junit4]   2>          "operation":"state"}
>    [junit4]   2> 1897570 T6200 oascc.ZkStateReader$2.process A cluster
> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
>    [junit4]   2> 1897571 T6184 oascc.ZkStateReader$2.process A cluster
> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
>    [junit4]   2> 1897571 T6168 oascc.ZkStateReader$2.process A cluster
> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
>    [junit4]   2> 1897570 T6150 oascc.ZkStateReader$2.process A cluster
> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
>    [junit4]   2> 1897570 T6143 oascc.ZkStateReader$2.process A cluster
> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
>    [junit4]   2> 1897570 T6216 oascc.ZkStateReader$2.process A cluster
> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
>    [junit4]   2> 1898456 T6191 oasc.ZkController.waitForShardId waiting to
> find shard id in clusterstate for solrj_collection_shard1_replica1
>    [junit4]   2> 1898457 T6191 oasc.ZkController.createCollectionZkNode
> Check for collection zkNode:solrj_collection
>    [junit4]   2> 1898458 T6191 oasc.ZkController.createCollectionZkNode
> Collection zkNode exists
>    [junit4]   2> 1898458 T6162 oasc.ZkController.waitForShardId waiting to
> find shard id in clusterstate for solrj_collection_shard1_replica2
>    [junit4]   2> 1898458 T6191 oascc.ZkStateReader.readConfigName Load
> collection config from:/collections/solrj_collection
>    [junit4]   2> 1898459 T6207 oasc.ZkController.waitForShardId waiting to
> find shard id in clusterstate for solrj_collection_shard2_replica2
>    [junit4]   2> 1898459 T6162 oasc.ZkController.createCollectionZkNode
> Check for collection zkNode:solrj_collection
>    [junit4]   2> 1898459 T6207 oasc.ZkController.createCollectionZkNode
> Check for collection zkNode:solrj_collection
>    [junit4]   2> 1898459 T6175 oasc.ZkController.waitForShardId waiting to
> find shard id in clusterstate for solrj_collection_shard2_replica1
>    [junit4]   2> 1898461 T6175 oasc.ZkController.createCollectionZkNode
> Check for collection zkNode:solrj_collection
>    [junit4]   2> 1898461 T6207 oasc.ZkController.createCollectionZkNode
> Collection zkNode exists
>    [junit4]   2> 1898461 T6191 oascc.ZkStateReader.readConfigName
> path=/collections/solrj_collection configName=conf1 specified config exists
> in ZooKeeper
>    [junit4]   2> 1898462 T6162 oasc.ZkController.createCollectionZkNode
> Collection zkNode exists
>    [junit4]   2> 1898462 T6175 oasc.ZkController.createCollectionZkNode
> Collection zkNode exists
>    [junit4]   2> 1898463 T6175 oascc.ZkStateReader.readConfigName Load
> collection config from:/collections/solrj_collection
>    [junit4]   2> 1898462 T6207 oascc.ZkStateReader.readConfigName Load
> collection config from:/collections/solrj_collection
>    [junit4]   2> 1898464 T6175 oascc.ZkStateReader.readConfigName
> path=/collections/solrj_collection configName=conf1 specified config exists
> in ZooKeeper
>    [junit4]   2> 1898463 T6162 oascc.ZkStateReader.readConfigName Load
> collection config from:/collections/solrj_collection
>    [junit4]   2> 1898462 T6191 oasc.SolrResourceLoader.<init> new
> SolrResourceLoader for directory:
> '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-005/solrj_collection_shard1_replica1/'
>    [junit4]   2> 1898464 T6207 oascc.ZkStateReader.readConfigName
> path=/collections/solrj_collection configName=conf1 specified config exists
> in ZooKeeper
>    [junit4]   2> 1898464 T6175 oasc.SolrResourceLoader.<init> new
> SolrResourceLoader for directory:
> '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-004/solrj_collection_shard2_replica1/'
>    [junit4]   2> 1898466 T6207 oasc.SolrResourceLoader.<init> new
> SolrResourceLoader for directory:
> '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-006/solrj_collection_shard2_replica2/'
>    [junit4]   2> 1898465 T6162 oascc.ZkStateReader.readConfigName
> path=/collections/solrj_collection configName=conf1 specified config exists
> in ZooKeeper
>    [junit4]   2> 1898467 T6162 oasc.SolrResourceLoader.<init> new
> SolrResourceLoader for directory:
> '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-003/solrj_collection_shard1_replica2/'
>    [junit4]   2> 1898492 T6191 oasc.ZkController.watchZKConfDir watch
> zkdir /configs/conf1
>    [junit4]   2> 1898495 T6191 oasc.Config.<init> loaded config
> solrconfig.xml with version 0
>    [junit4]   2> 1898497 T6162 oasc.ZkController.watchZKConfDir watch
> zkdir /configs/conf1
>    [junit4]   2> 1898501 T6162 oasc.Config.<init> loaded config
> solrconfig.xml with version 0
>    [junit4]   2> 1898505 T6175 oasc.ZkController.watchZKConfDir watch
> zkdir /configs/conf1
>    [junit4]   2> 1898507 T6175 oasc.Config.<init> loaded config
> solrconfig.xml with version 0
>    [junit4]   2> 1898516 T6207 oasc.ZkController.watchZKConfDir watch
> zkdir /configs/conf1
>    [junit4]   2> 1898519 T6207 oasc.Config.<init> loaded config
> solrconfig.xml with version 0
>    [junit4]   2> 1898522 T6162 oasc.SolrConfig.<init> Using Lucene
> MatchVersion: 6.0.0
>    [junit4]   2> 1898524 T6191 oasc.SolrConfig.<init> Using Lucene
> MatchVersion: 6.0.0
>    [junit4]   2> 1898541 T6175 oasc.SolrConfig.<init> Using Lucene
> MatchVersion: 6.0.0
>    [junit4]   2> 1898554 T6162 oasc.SolrConfig.<init> Loaded SolrConfig:
> solrconfig.xml
>    [junit4]   2> 1898554 T6207 oasc.SolrConfig.<init> Using Lucene
> MatchVersion: 6.0.0
>    [junit4]   2> 1898554 T6191 oasc.SolrConfig.<init> Loaded SolrConfig:
> solrconfig.xml
>    [junit4]   2> 1898555 T6162 oass.IndexSchema.readSchema Reading Solr
> Schema from /configs/conf1/schema.xml
>    [junit4]   2> 1898556 T6191 oass.IndexSchema.readSchema Reading Solr
> Schema from /configs/conf1/schema.xml
>    [junit4]   2> 1898581 T6175 oasc.SolrConfig.<init> Loaded SolrConfig:
> solrconfig.xml
>    [junit4]   2> 1898584 T6207 oasc.SolrConfig.<init> Loaded SolrConfig:
> solrconfig.xml
>    [junit4]   2> 1898585 T6175 oass.IndexSchema.readSchema Reading Solr
> Schema from /configs/conf1/schema.xml
>    [junit4]   2> 1898586 T6207 oass.IndexSchema.readSchema Reading Solr
> Schema from /configs/conf1/schema.xml
>    [junit4]   2> 1898603 T6191 oass.IndexSchema.readSchema
> [solrj_collection_shard1_replica1] Schema name=test
>    [junit4]   2> 1898603 T6162 oass.IndexSchema.readSchema
> [solrj_collection_shard1_replica2] Schema name=test
>    [junit4]   2> 1898610 T6207 oass.IndexSchema.readSchema
> [solrj_collection_shard2_replica2] Schema name=test
>    [junit4]   2> 1898615 T6175 oass.IndexSchema.readSchema
> [solrj_collection_shard2_replica1] Schema name=test
>    [junit4]   2> 1898843 T6207 oass.OpenExchangeRatesOrgProvider.init
> Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
>    [junit4]   2> 1898843 T6191 oass.OpenExchangeRatesOrgProvider.init
> Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
>    [junit4]   2> 1898846 T6162 oass.OpenExchangeRatesOrgProvider.init
> Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
>    [junit4]   2> 1898852 T6207 oass.IndexSchema.readSchema default search
> field in schema is text
>    [junit4]   2> 1898854 T6162 oass.IndexSchema.readSchema default search
> field in schema is text
>    [junit4]   2> 1898855 T6207 oass.IndexSchema.readSchema unique key
> field: id
>    [junit4]   2> 1898856 T6191 oass.IndexSchema.readSchema default search
> field in schema is text
>    [junit4]   2> 1898856 T6162 oass.IndexSchema.readSchema unique key
> field: id
>    [junit4]   2> 1898868 T6191 oass.IndexSchema.readSchema unique key
> field: id
>    [junit4]   2> 1898874 T6175 oass.OpenExchangeRatesOrgProvider.init
> Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
>    [junit4]   2> 1898880 T6175 oass.IndexSchema.readSchema default search
> field in schema is text
>    [junit4]   2> 1898883 T6175 oass.IndexSchema.readSchema unique key
> field: id
>    [junit4]   2> 1898886 T6162 oass.FileExchangeRateProvider.reload
> Reloading exchange rates from file currency.xml
>    [junit4]   2> 1898887 T6207 oass.FileExchangeRateProvider.reload
> Reloading exchange rates from file currency.xml
>    [junit4]   2> 1898887 T6191 oass.FileExchangeRateProvider.reload
> Reloading exchange rates from file currency.xml
>    [junit4]   2> 1898892 T6207 oass.FileExchangeRateProvider.reload
> Reloading exchange rates from file currency.xml
>    [junit4]   2> 1898892 T6191 oass.FileExchangeRateProvider.reload
> Reloading exchange rates from file currency.xml
>    [junit4]   2> 1898892 T6162 oass.FileExchangeRateProvider.reload
> Reloading exchange rates from file currency.xml
>    [junit4]   2> 1898896 T6191 oass.OpenExchangeRatesOrgProvider.reload
> Reloading exchange rates from open-exchange-rates.json
>    [junit4]   2> 1898897 T6207 oass.OpenExchangeRatesOrgProvider.reload
> Reloading exchange rates from open-exchange-rates.json
>    [junit4]   2> 1898898 T6207
> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key
> IMPORTANT NOTE
>    [junit4]   2> 1898900 T6207
> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected
> key, got STRING
>    [junit4]   2> 1898898 T6162 oass.OpenExchangeRatesOrgProvider.reload
> Reloading exchange rates from open-exchange-rates.json
>    [junit4]   2> 1898898 T6191
> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key
> IMPORTANT NOTE
>    [junit4]   2> 1898901 T6207 oass.OpenExchangeRatesOrgProvider.reload
> Reloading exchange rates from open-exchange-rates.json
>    [junit4]   2> 1898908 T6162
> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key
> IMPORTANT NOTE
>    [junit4]   2> 1898909 T6162
> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected
> key, got STRING
>    [junit4]   2> 1898909 T6162 oass.OpenExchangeRatesOrgProvider.reload
> Reloading exchange rates from open-exchange-rates.json
>    [junit4]   2> 1898908 T6191
> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected
> key, got STRING
>    [junit4]   2> 1898910 T6191 oass.OpenExchangeRatesOrgProvider.reload
> Reloading exchange rates from open-exchange-rates.json
>    [junit4]   2> 1898909 T6207
> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key
> IMPORTANT NOTE
>    [junit4]   2> 1898911 T6207
> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected
> key, got STRING
>    [junit4]   2> 1898911 T6162
> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key
> IMPORTANT NOTE
>    [junit4]   2> 1898912 T6162
> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected
> key, got STRING
>    [junit4]   2> 1898912 T6207 oasc.CoreContainer.create Creating SolrCore
> 'solrj_collection_shard2_replica2' using configuration from collection
> solrj_collection
>    [junit4]   2> 1898911 T6191
> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key
> IMPORTANT NOTE
>    [junit4]   2> 1898913 T6191
> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected
> key, got STRING
>    [junit4]   2> 1898913 T6175 oass.FileExchangeRateProvider.reload
> Reloading exchange rates from file currency.xml
>    [junit4]   2> 1898912 T6162 oasc.CoreContainer.create Creating SolrCore
> 'solrj_collection_shard1_replica2' using configuration from collection
> solrj_collection
>    [junit4]   2> 1898914 T6191 oasc.CoreContainer.create Creating SolrCore
> 'solrj_collection_shard1_replica1' using configuration from collection
> solrj_collection
>    [junit4]   2> 1898913 T6207 oasc.SolrCore.initDirectoryFactory
> org.apache.solr.core.MockDirectoryFactory
>    [junit4]   2> 1898915 T6191 oasc.SolrCore.initDirectoryFactory
> org.apache.solr.core.MockDirectoryFactory
>    [junit4]   2> 1898915 T6162 oasc.SolrCore.initDirectoryFactory
> org.apache.solr.core.MockDirectoryFactory
>    [junit4]   2> 1898917 T6191 oasc.SolrCore.<init>
> [solrj_collection_shard1_replica1] Opening new SolrCore at
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-005/solrj_collection_shard1_replica1/,
> dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-005/solrj_collection_shard1_replica1/data/
>    [junit4]   2> 1898916 T6207 oasc.SolrCore.<init>
> [solrj_collection_shard2_replica2] Opening new SolrCore at
> ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-006/solrj_collection_shard2_replica2/,
> dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-006/solrj_collection_shard2_replica2/data/
>    [junit4]   2> 1898918 T6175 oass.FileExchangeRateProvider.reload
> Reloading exchange rates from file currency.xml
>    [junit4]   2> 1898917 T6162 oasc.SolrCore.<init>
> [solrj_collection_shard1_replica2] Opening new SolrCore at
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-003/solrj_collection_shard1_replica2/,
> dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-003/solrj_collection_shard1_replica2/data/
>    [junit4]   2> 1898918 T6191 oasc.JmxMonitoredMap.<init> JMX monitoring
> is enabled. Adding Solr mbeans to JMX Server:
> com.sun.jmx.mbeanserver.JmxMBeanServer@1be2f3e
>    [junit4]   2> 1898919 T6162 oasc.JmxMonitoredMap.<init> JMX monitoring
> is enabled. Adding Solr mbeans to JMX Server:
> com.sun.jmx.mbeanserver.JmxMBeanServer@1be2f3e
>    [junit4]   2> 1898920 T6207 oasc.JmxMonitoredMap.<init> JMX monitoring
> is enabled. Adding Solr mbeans to JMX Server:
> com.sun.jmx.mbeanserver.JmxMBeanServer@1be2f3e
>    [junit4]   2> 1898921 T6175 oass.OpenExchangeRatesOrgProvider.reload
> Reloading exchange rates from open-exchange-rates.json
>    [junit4]   2> 1898922 T6191 oasc.CachingDirectoryFactory.get return new
> directory for
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-005/solrj_collection_shard1_replica1/data
>    [junit4]   2> 1898922 T6207 oasc.CachingDirectoryFactory.get return new
> directory for
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-006/solrj_collection_shard2_replica2/data
>    [junit4]   2> 1898922 T6175
> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key
> IMPORTANT NOTE
>    [junit4]   2> 1898923 T6175
> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected
> key, got STRING
>    [junit4]   2> 1898923 T6207 oasc.SolrCore.getNewIndexDir New index
> directory detected: old=null
> new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-006/solrj_collection_shard2_replica2/data/index/
>    [junit4]   2> 1898923 T6191 oasc.SolrCore.getNewIndexDir New index
> directory detected: old=null
> new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-005/solrj_collection_shard1_replica1/data/index/
>    [junit4]   2> 1898923 T6162 oasc.CachingDirectoryFactory.get return new
> directory for
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-003/solrj_collection_shard1_replica2/data
>    [junit4]   2> 1898925 T6191 oasc.SolrCore.initIndex WARN
> [solrj_collection_shard1_replica1] Solr index directory
> '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-005/solrj_collection_shard1_replica1/data/index'
> doesn't exist. Creating new index...
>    [junit4]   2> 1898924 T6207 oasc.SolrCore.initIndex WARN
> [solrj_collection_shard2_replica2] Solr index directory
> '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-006/solrj_collection_shard2_replica2/data/index'
> doesn't exist. Creating new index...
>    [junit4]   2> 1898924 T6175 oass.OpenExchangeRatesOrgProvider.reload
> Reloading exchange rates from open-exchange-rates.json
>    [junit4]   2> 1898926 T6191 oasc.CachingDirectoryFactory.get return new
> directory for
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-005/solrj_collection_shard1_replica1/data/index
>    [junit4]   2> 1898927 T6175
> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key
> IMPORTANT NOTE
>    [junit4]   2> 1898928 T6175
> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected
> key, got STRING
>    [junit4]   2> 1898928 T6175 oasc.CoreContainer.create Creating SolrCore
> 'solrj_collection_shard2_replica1' using configuration from collection
> solrj_collection
>    [junit4]   2> 1898929 T6175 oasc.SolrCore.initDirectoryFactory
> org.apache.solr.core.MockDirectoryFactory
>    [junit4]   2> 1898929 T6175 oasc.SolrCore.<init>
> [solrj_collection_shard2_replica1] Opening new SolrCore at
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-004/solrj_collection_shard2_replica1/,
> dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-004/solrj_collection_shard2_replica1/data/
>    [junit4]   2> 1898930 T6175 oasc.JmxMonitoredMap.<init> JMX monitoring
> is enabled. Adding Solr mbeans to JMX Server:
> com.sun.jmx.mbeanserver.JmxMBeanServer@1be2f3e
>    [junit4]   2> 1898931 T6175 oasc.CachingDirectoryFactory.get return new
> directory for
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-004/solrj_collection_shard2_replica1/data
>    [junit4]   2> 1898931 T6175 oasc.SolrCore.getNewIndexDir New index
> directory detected: old=null
> new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-004/solrj_collection_shard2_replica1/data/index/
>    [junit4]   2> 1898932 T6175 oasc.SolrCore.initIndex WARN
> [solrj_collection_shard2_replica1] Solr index directory
> '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-004/solrj_collection_shard2_replica1/data/index'
> doesn't exist. Creating new index...
>    [junit4]   2> 1898933 T6175 oasc.CachingDirectoryFactory.get return new
> directory for
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-004/solrj_collection_shard2_replica1/data/index
>    [junit4]   2> 1898933 T6175 oasu.RandomMergePolicy.<init>
> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy:
> [TieredMergePolicy: maxMergeAtOnce=19, maxMergeAtOnceExplicit=49,
> maxMergedSegmentMB=77.87890625, floorSegmentMB=1.6240234375,
> forceMergeDeletesPctAllowed=18.87818731910226, segmentsPerTier=20.0,
> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
>    [junit4]   2> 1898925 T6162 oasc.SolrCore.getNewIndexDir New index
> directory detected: old=null
> new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-003/solrj_collection_shard1_replica2/data/index/
>    [junit4]   2> 1898927 T6191 oasu.RandomMergePolicy.<init>
> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy:
> [TieredMergePolicy: maxMergeAtOnce=19, maxMergeAtOnceExplicit=49,
> maxMergedSegmentMB=77.87890625, floorSegmentMB=1.6240234375,
> forceMergeDeletesPctAllowed=18.87818731910226, segmentsPerTier=20.0,
> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
>    [junit4]   2> 1898935 T6175 oasc.SolrDeletionPolicy.onCommit
> SolrDeletionPolicy.onCommit: commits: num=1
>    [junit4]   2>
> commit{dir=MockDirectoryWrapper(RAMDirectory@187f848
> lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1ef0897
> ),segFN=segments_1,generation=1}
>    [junit4]   2> 1898936 T6191 oasc.SolrDeletionPolicy.onCommit
> SolrDeletionPolicy.onCommit: commits: num=1
>    [junit4]   2>
> commit{dir=MockDirectoryWrapper(RAMDirectory@dc31bf
> lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@afcfe4
> ),segFN=segments_1,generation=1}
>    [junit4]   2> 1898936 T6191 oasc.SolrDeletionPolicy.updateCommits
> newest commit generation = 1
>    [junit4]   2> 1898927 T6207 oasc.CachingDirectoryFactory.get return new
> directory for
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-006/solrj_collection_shard2_replica2/data/index
>    [junit4]   2> 1898936 T6175 oasc.SolrDeletionPolicy.updateCommits
> newest commit generation = 1
>    [junit4]   2> 1898935 T6162 oasc.SolrCore.initIndex WARN
> [solrj_collection_shard1_replica2] Solr index directory
> '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-003/solrj_collection_shard1_replica2/data/index'
> doesn't exist. Creating new index...
>    [junit4]   2> 1898937 T6207 oasu.RandomMergePolicy.<init>
> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy:
> [TieredMergePolicy: maxMergeAtOnce=19, maxMergeAtOnceExplicit=49,
> maxMergedSegmentMB=77.87890625, floorSegmentMB=1.6240234375,
> forceMergeDeletesPctAllowed=18.87818731910226, segmentsPerTier=20.0,
> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
>    [junit4]   2> 1898938 T6162 oasc.CachingDirectoryFactory.get return new
> directory for
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-003/solrj_collection_shard1_replica2/data/index
>    [junit4]   2> 1898939 T6162 oasu.RandomMergePolicy.<init>
> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy:
> [TieredMergePolicy: maxMergeAtOnce=19, maxMergeAtOnceExplicit=49,
> maxMergedSegmentMB=77.87890625, floorSegmentMB=1.6240234375,
> forceMergeDeletesPctAllowed=18.87818731910226, segmentsPerTier=20.0,
> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
>    [junit4]   2> 1898940 T6162 oasc.SolrDeletionPolicy.onCommit
> SolrDeletionPolicy.onCommit: commits: num=1
>    [junit4]   2>
> commit{dir=MockDirectoryWrapper(RAMDirectory@15afcaa
> lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@14a30cc
> ),segFN=segments_1,generation=1}
>    [junit4]   2> 1898941 T6162 oasc.SolrDeletionPolicy.updateCommits
> newest commit generation = 1
>    [junit4]   2> 1898943 T6191 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "nodistrib"
>    [junit4]   2> 1898944 T6191 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "dedupe"
>    [junit4]   2> 1898944 T6175 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "nodistrib"
>    [junit4]   2> 1898945 T6191 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "dedupe"
>    [junit4]   2> 1898945 T6175 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "dedupe"
>    [junit4]   2> 1898945 T6191 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "stored_sig"
>    [junit4]   2> 1898946 T6175 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "dedupe"
>    [junit4]   2> 1898946 T6191 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "stored_sig"
>    [junit4]   2> 1898947 T6162 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "nodistrib"
>    [junit4]   2> 1898947 T6175 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "stored_sig"
>    [junit4]   2> 1898948 T6162 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "dedupe"
>    [junit4]   2> 1898947 T6207 oasc.SolrDeletionPolicy.onCommit
> SolrDeletionPolicy.onCommit: commits: num=1
>    [junit4]   2>
> commit{dir=MockDirectoryWrapper(RAMDirectory@1a8592a
> lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@ff84d
> ),segFN=segments_1,generation=1}
>    [junit4]   2> 1898949 T6207 oasc.SolrDeletionPolicy.updateCommits
> newest commit generation = 1
>    [junit4]   2> 1898947 T6191 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
>    [junit4]   2> 1898948 T6162 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "dedupe"
>    [junit4]   2> 1898948 T6175 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "stored_sig"
>    [junit4]   2> 1898950 T6191 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>    [junit4]   2> 1898950 T6162 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "stored_sig"
>    [junit4]   2> 1898951 T6191 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>    [junit4]   2> 1898951 T6175 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
>    [junit4]   2> 1898952 T6191 oasc.SolrCore.loadUpdateProcessorChains no
> updateRequestProcessorChain defined as default, creating implicit default
>    [junit4]   2> 1898951 T6162 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "stored_sig"
>    [junit4]   2> 1898953 T6162 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
>    [junit4]   2> 1898954 T6162 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>    [junit4]   2> 1898954 T6162 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>    [junit4]   2> 1898954 T6162 oasc.SolrCore.loadUpdateProcessorChains no
> updateRequestProcessorChain defined as default, creating implicit default
>    [junit4]   2> 1898955 T6162 oasc.RequestHandlers.initHandlersFromConfig
> created /update: org.apache.solr.handler.UpdateRequestHandler
>    [junit4]   2> 1898956 T6175 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>    [junit4]   2> 1898956 T6191 oasc.RequestHandlers.initHandlersFromConfig
> created /update: org.apache.solr.handler.UpdateRequestHandler
>    [junit4]   2> 1898956 T6175 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>    [junit4]   2> 1898956 T6162 oasc.RequestHandlers.initHandlersFromConfig
> created /update/json: org.apache.solr.handler.UpdateRequestHandler
>    [junit4]   2> 1898957 T6207 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "nodistrib"
>    [junit4]   2> 1898958 T6162 oasc.RequestHandlers.initHandlersFromConfig
> created /update/csv: org.apache.solr.handler.UpdateRequestHandler
>    [junit4]   2> 1898957 T6191 oasc.RequestHandlers.initHandlersFromConfig
> created /update/json: org.apache.solr.handler.UpdateRequestHandler
>    [junit4]   2> 1898957 T6175 oasc.SolrCore.loadUpdateProcessorChains no
> updateRequestProcessorChain defined as default, creating implicit default
>    [junit4]   2> 1898958 T6162 oasc.RequestHandlers.initHandlersFromConfig
> created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
>    [junit4]   2> 1898958 T6207 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "dedupe"
>    [junit4]   2> 1898959 T6175 oasc.RequestHandlers.initHandlersFromConfig
> created /update: org.apache.solr.handler.UpdateRequestHandler
>    [junit4]   2> 1898959 T6191 oasc.RequestHandlers.initHandlersFromConfig
> created /update/csv: org.apache.solr.handler.UpdateRequestHandler
>    [junit4]   2> 1898960 T6207 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "dedupe"
>    [junit4]   2> 1898960 T6162 oasc.RequestHandlers.initHandlersFromConfig
> created /config: org.apache.solr.handler.SolrConfigHandler
>    [junit4]   2> 1898961 T6207 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "stored_sig"
>    [junit4]   2> 1898961 T6191 oasc.RequestHandlers.initHandlersFromConfig
> created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
>    [junit4]   2> 1898960 T6175 oasc.RequestHandlers.initHandlersFromConfig
> created /update/json: org.apache.solr.handler.UpdateRequestHandler
>    [junit4]   2> 1898962 T6162 oasc.RequestHandlers.initHandlersFromConfig
> created /schema: org.apache.solr.handler.SchemaHandler
>    [junit4]   2> 1898962 T6175 oasc.RequestHandlers.initHandlersFromConfig
> created /update/csv: org.apache.solr.handler.UpdateRequestHandler
>    [junit4]   2> 1898962 T6207 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "stored_sig"
>    [junit4]   2> 1898963 T6175 oasc.RequestHandlers.initHandlersFromConfig
> created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
>    [junit4]   2> 1898963 T6207 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
>    [junit4]   2> 1898964 T6175 oasc.RequestHandlers.initHandlersFromConfig
> created /config: org.apache.solr.handler.SolrConfigHandler
>    [junit4]   2> 1898963 T6162 oasc.RequestHandlers.initHandlersFromConfig
> created /replication: org.apache.solr.handler.ReplicationHandler
>    [junit4]   2> 1898962 T6191 oasc.RequestHandlers.initHandlersFromConfig
> created /config: org.apache.solr.handler.SolrConfigHandler
>    [junit4]   2> 1898965 T6162 oasc.RequestHandlers.initHandlersFromConfig
> created /get: org.apache.solr.handler.RealTimeGetHandler
>    [junit4]   2> 1898964 T6175 oasc.RequestHandlers.initHandlersFromConfig
> created /schema: org.apache.solr.handler.SchemaHandler
>    [junit4]   2> 1898964 T6207 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>    [junit4]   2> 1898965 T6162 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
>    [junit4]   2> 1898965 T6191 oasc.RequestHandlers.initHandlersFromConfig
> created /schema: org.apache.solr.handler.SchemaHandler
>    [junit4]   2> 1898966 T6175 oasc.RequestHandlers.initHandlersFromConfig
> created /replication: org.apache.solr.handler.ReplicationHandler
>    [junit4]   2> 1898966 T6207 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>    [junit4]   2> 1898967 T6207 oasc.SolrCore.loadUpdateProcessorChains no
> updateRequestProcessorChain defined as default, creating implicit default
>    [junit4]   2> 1898967 T6191 oasc.RequestHandlers.initHandlersFromConfig
> created /replication: org.apache.solr.handler.ReplicationHandler
>    [junit4]   2> 1898967 T6162 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
>    [junit4]   2> 1898968 T6207 oasc.RequestHandlers.initHandlersFromConfig
> created /update: org.apache.solr.handler.UpdateRequestHandler
>    [junit4]   2> 1898967 T6175 oasc.RequestHandlers.initHandlersFromConfig
> created /get: org.apache.solr.handler.RealTimeGetHandler
>    [junit4]   2> 1898969 T6207 oasc.RequestHandlers.initHandlersFromConfig
> created /update/json: org.apache.solr.handler.UpdateRequestHandler
>    [junit4]   2> 1898969 T6162 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
>    [junit4]   2> 1898969 T6191 oasc.RequestHandlers.initHandlersFromConfig
> created /get: org.apache.solr.handler.RealTimeGetHandler
>    [junit4]   2> 1898970 T6207 oasc.RequestHandlers.initHandlersFromConfig
> created /update/csv: org.apache.solr.handler.UpdateRequestHandler
>    [junit4]   2> 1898970 T6175 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
>    [junit4]   2> 1898971 T6207 oasc.RequestHandlers.initHandlersFromConfig
> created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
>    [junit4]   2> 1898971 T6191 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
>    [junit4]   2> 1898971 T6162 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
>    [junit4]   2> 1898972 T6207 oasc.RequestHandlers.initHandlersFromConfig
> created /config: org.apache.solr.handler.SolrConfigHandler
>    [junit4]   2> 1898972 T6175 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
>    [junit4]   2> 1898973 T6162 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
>    [junit4]   2> 1898973 T6191 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
>    [junit4]   2> 1898974 T6162 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/properties:
> org.apache.solr.handler.admin.PropertiesRequestHandler
>    [junit4]   2> 1898974 T6175 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
>    [junit4]   2> 1898975 T6162 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
>    [junit4]   2> 1898974 T6207 oasc.RequestHandlers.initHandlersFromConfig
> created /schema: org.apache.solr.handler.SchemaHandler
>    [junit4]   2> 1898976 T6175 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
>    [junit4]   2> 1898975 T6191 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/mbeans: org.apache.solr
>
> [...truncated too long message...]
>
> ementAdapter.evaluate(StatementAdapter.java:36)
>    [junit4]   2>        at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
>    [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
>    [junit4]   2>
>    [junit4]   2> 1952205 T6117 oasc.CachingDirectoryFactory.close Closing
> MockDirectoryFactory - 2 directories currently being tracked
>    [junit4]   2> 1952205 T6117
> oasc.CachingDirectoryFactory.closeCacheValue looking to close
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-006/awholynewcollection_0_shard1_replica1/data
> [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-006/awholynewcollection_0_shard1_replica1/data;done=false>>]
>    [junit4]   2> 1952205 T6117 oasc.CachingDirectoryFactory.close Closing
> directory:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-006/awholynewcollection_0_shard1_replica1/data
>    [junit4]   2> 1952206 T6117
> oasc.CachingDirectoryFactory.closeCacheValue looking to close
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-006/awholynewcollection_0_shard1_replica1/data/index
> [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-006/awholynewcollection_0_shard1_replica1/data/index;done=false>>]
>    [junit4]   2> 1952206 T6117 oasc.CachingDirectoryFactory.close Closing
> directory:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001/tempDir-006/awholynewcollection_0_shard1_replica1/data/index
>    [junit4]   2> 1952207 T6117 oasc.Overseer.close Overseer
> (id=92989978420707341-127.0.0.1:50450_-n_0000000004) closing
>    [junit4]   2> 1952207 T6386 oasc.Overseer$ClusterStateUpdater.run
> Overseer Loop exiting : 127.0.0.1:50450_
>    [junit4]   2> 1953709 T6323 oascc.ZkStateReader$3.process WARN
> ZooKeeper watch triggered, but Solr cannot talk to ZK
>    [junit4]   2> 1953732 T6117 oejsh.ContextHandler.doStop stopped
> o.e.j.s.ServletContextHandler{/,null}
>    [junit4]   2> 1958721 T6117 oas.SolrTestCaseJ4.tearDown ###Ending
> testDistribSearch
>    [junit4]   2> 1958724 T6117 oasc.ZkTestServer.send4LetterWord
> connecting to 127.0.0.1:50799 50799
>    [junit4]   2> 1959292 T6317 oasc.ZkTestServer.send4LetterWord
> connecting to 127.0.0.1:50799 50799
>    [junit4]   2> 1959295 T6317
> oasc.ZkTestServer$ZKServerMain.runFromConfig WARN Watch limit violations:
>    [junit4]   2>        Maximum concurrent children watches above limit:
>    [junit4]   2>
>    [junit4]   2>                4       /solr/overseer/queue
>    [junit4]   2>                4
>  /solr/overseer/collection-queue-work
>    [junit4]   2>
>    [junit4]   2> NOTE: reproduce with: ant test
> -Dtestcase=CollectionsAPIDistributedZkTest -Dtests.method=testDistribSearch
> -Dtests.seed=8219942E65A94EC1 -Dtests.multiplier=3 -Dtests.slow=true
> -Dtests.locale=nl -Dtests.timezone=America/Halifax -Dtests.asserts=false
> -Dtests.file.encoding=ISO-8859-1
>    [junit4] FAILURE 68.2s J0 |
> CollectionsAPIDistributedZkTest.testDistribSearch <<<
>    [junit4]    > Throwable #1: org.junit.ComparisonFailure:
> expected:<...9942E65A94EC1-001/te[mpDir-003/solrj_test_core_props_shard1_replica1]>
> but
> was:<...9942E65A94EC1-001/te[stPropertyParamsForCreate-001/instanceDir-fmchl]>
>    [junit4]    >        at
> __randomizedtesting.SeedInfo.seed([8219942E65A94EC1:3FF1A3612F62EFD]:0)
>    [junit4]    >        at
> org.apache.solr.cloud.CollectionsAPIDistributedZkTest.checkInstanceDirs(CollectionsAPIDistributedZkTest.java:1135)
>    [junit4]    >        at
> org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:883)
>    [junit4]    >        at
> org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:204)
>    [junit4]    >        at
> org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
>    [junit4]    >        at java.lang.Thread.run(Thread.java:745)
>    [junit4]   2> 1959323 T6117 oas.SolrTestCaseJ4.deleteCore ###deleteCore
>    [junit4]   2> NOTE: leaving temporary files on disk at:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest-8219942E65A94EC1-001
>    [junit4]   2> 68234 T6116 ccr.ThreadLeakControl.checkThreadLeaks
> WARNING Will linger awaiting termination of 1 leaked thread(s).
>    [junit4]   2> NOTE: test params are: codec=Asserting(Lucene50): {},
> docValues:{}, sim=DefaultSimilarity, locale=nl, timezone=America/Halifax
>    [junit4]   2> NOTE: Linux 3.13.0-43-generic i386/Oracle Corporation
> 1.8.0_20 (32-bit)/cpus=8,threads=1,free=59152008,total=265080832
>    [junit4]   2> NOTE: All tests run in this JVM: [TestCollectionAPI,
> TestModifyConfFiles, SuggesterFSTTest, AssignTest, UUIDFieldTest,
> DocValuesTest, HdfsChaosMonkeySafeLeaderTest, EnumFieldTest, TestLazyCores,
> AliasIntegrationTest, HdfsDirectoryTest, TestShortCircuitedRequests,
> TestNoOpRegenerator, TestCustomSort, TestFunctionQuery,
> TestCursorMarkWithoutUniqueKey, TestRawResponseWriter, TestInitParams,
> TestDefaultSearchFieldResource, TestArbitraryIndexDir,
> CoreContainerCoreInitFailuresTest, RequestHandlersTest,
> LeaderInitiatedRecoveryOnCommitTest, TestBulkSchemaConcurrent,
> DirectUpdateHandlerTest, SimpleFacetsTest,
> OpenExchangeRatesOrgProviderTest, TestFileDictionaryLookup,
> SoftAutoCommitTest, TestManagedSchemaDynamicFieldResource, PeerSyncTest,
> XmlUpdateRequestHandlerTest, OverseerTest, PluginInfoTest,
> AddSchemaFieldsUpdateProcessorFactoryTest, DistributedIntervalFacetingTest,
> TestStressVersions, TestDFRSimilarityFactory,
> SolrCoreCheckLockOnStartupTest, NumericFieldsTest,
> AnalysisAfterCoreReloadTest, TestCoreContainer,
> TestLMDirichletSimilarityFactory, HdfsUnloadDistributedZkTest,
> DistributedQueueTest, TestTolerantSearch, TestClusterStateMutator,
> ModifyConfFileTest, TestBinaryField,
> VMParamsZkACLAndCredentialsProvidersTest, LegacyHTMLStripCharFilterTest,
> QueryElevationComponentTest, TestSolr4Spatial2, TestConfigOverlay,
> CustomCollectionTest, TestQueryUtils, TestRequestStatusCollectionAPI,
> TestRandomDVFaceting, SolrIndexConfigTest,
> TestHighFrequencyDictionaryFactory, FacetPivotSmallTest, SliceStateTest,
> DistributedSpellCheckComponentTest, TestAnalyzedSuggestions,
> OutOfBoxZkACLAndCredentialsProvidersTest, TestSweetSpotSimilarityFactory,
> UniqFieldsUpdateProcessorFactoryTest, ParsingFieldUpdateProcessorsTest,
> CoreAdminHandlerTest, TestImplicitCoreProperties, TestSearcherReuse,
> DistributedFacetPivotWhiteBoxTest, CacheHeaderTest, ZkStateWriterTest,
> PreAnalyzedUpdateProcessorTest, HdfsLockFactoryTest, TestSchemaResource,
> MultiThreadedOCPTest, TestCSVLoader, TestPartialUpdateDeduplication,
> MinimalSchemaTest, TestManagedSynonymFilterFactory, TestIndexSearcher,
> RecoveryZkTest, TestWriterPerf, MergeStrategyTest, SortByFunctionTest,
> TestIntervalFaceting, TestMissingGroups, CloudMLTQParserTest,
> TestFuzzyAnalyzedSuggestions, ZkControllerTest,
> TestDynamicFieldCollectionResource, TestSort, HttpPartitionTest,
> TestMaxScoreQueryParser, SystemInfoHandlerTest, HighlighterConfigTest,
> DirectSolrConnectionTest, SuggesterWFSTTest, TestSortingResponseWriter,
> TestAtomicUpdateErrorCases, CircularListTest, DistanceFunctionTest,
> TestConfigSets, DistributedFacetPivotSmallTest, ExternalCollectionsTest,
> DistributedQueryElevationComponentTest, NoCacheHeaderTest,
> BasicDistributedZkTest, UnloadDistributedZkTest,
> CollectionsAPIDistributedZkTest]
>    [junit4] Completed on J0 in 68.53s, 1 test, 1 failure <<< FAILURES!
>
> [...truncated 703 lines...]
> BUILD FAILED
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:519: The
> following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:467: The
> following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:61: The
> following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:39:
> The following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:187: The
> following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:510:
> The following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1349:
> The following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:956:
> There were test failures: 452 suites, 1846 tests, 1 failure, 32 ignored (22
> assumptions)
>
> Total time: 85 minutes 3 seconds
> Build step 'Invoke Ant' marked build as failure
> [description-setter] Description set: Java: 32bit/jdk1.8.0_20 -client
> -XX:+UseSerialGC (asserts: false)
> Archiving artifacts
> Recording test results
> Email was triggered for: Failure - Any
> Sending email for trigger: Failure - Any
>
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
>


-- 
Regards,
Shalin Shekhar Mangar.