You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2015/03/08 07:12:06 UTC

[JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.9.0-ea-b47) - Build # 11935 - Still Failing!

Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/11935/
Java: 64bit/jdk1.9.0-ea-b47 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC

All tests passed

Build Log:
[...truncated 49960 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:519: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:426: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:105: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:208: Source checkout is dirty after running tests!!! Offending files:
* ./solr/licenses/runtimelibs.jar.sha1
* ./solr/licenses/runtimelibs_v2.jar.sha1

Total time: 76 minutes 55 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 64bit/jdk1.9.0-ea-b47 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



[JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.9.0-ea-b47) - Build # 11938 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/11938/
Java: 64bit/jdk1.9.0-ea-b47 -XX:+UseCompressedOops -XX:+UseParallelGC

1 tests failed.
FAILED:  org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.test

Error Message:
Error from server at http://127.0.0.1:59375/r/implicit_collection_without_routerfield_shard1_replica1: no servers hosting shard: 

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:59375/r/implicit_collection_without_routerfield_shard1_replica1: no servers hosting shard: 
	at __randomizedtesting.SeedInfo.seed([8ECC2C3BD5E2951B:69813E17B1EF8E3]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:555)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:211)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:207)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:135)
	at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:943)
	at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:958)
	at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.testDeleteByIdImplicitRouter(FullSolrCloudDistribCmdsTest.java:225)
	at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.test(FullSolrCloudDistribCmdsTest.java:144)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:958)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:933)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 9814 lines...]
   [junit4] Suite: org.apache.solr.cloud.FullSolrCloudDistribCmdsTest
   [junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/init-core-data-001
   [junit4]   2> 1089846 T7601 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /r/
   [junit4]   2> 1089848 T7601 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1089848 T7602 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 1089948 T7601 oasc.ZkTestServer.run start zk server on port:34497
   [junit4]   2> 1089949 T7601 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 1089949 T7601 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1089953 T7609 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3175884a name:ZooKeeperConnection Watcher:127.0.0.1:34497 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1089954 T7601 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1089954 T7601 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 1089954 T7601 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 1089957 T7601 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 1089957 T7601 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1089959 T7612 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5578aa93 name:ZooKeeperConnection Watcher:127.0.0.1:34497/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1089959 T7601 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1089959 T7601 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 1089959 T7601 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 1089961 T7601 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 1089964 T7601 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 1089965 T7601 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 1089967 T7601 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 1089968 T7601 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 1089971 T7601 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
   [junit4]   2> 1089972 T7601 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 1089974 T7601 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1089975 T7601 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1089977 T7601 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 1089978 T7601 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 1089980 T7601 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 1089980 T7601 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 1089982 T7601 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 1089982 T7601 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 1089983 T7601 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 1089984 T7601 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 1089985 T7601 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1089985 T7601 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1089986 T7601 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1089986 T7601 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1089987 T7601 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 1089987 T7601 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 1089988 T7601 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 1089989 T7601 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 1090225 T7601 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/control-001/cores/collection1
   [junit4]   2> 1090227 T7601 oejs.Server.doStart jetty-9.2.9.v20150224
   [junit4]   2> 1090229 T7601 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@596d83d3{/r,null,AVAILABLE}
   [junit4]   2> 1090230 T7601 oejs.AbstractConnector.doStart Started ServerConnector@7d179253{HTTP/1.1}{127.0.0.1:41769}
   [junit4]   2> 1090230 T7601 oejs.Server.doStart Started @1091387ms
   [junit4]   2> 1090231 T7601 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {solr.data.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/tempDir-001/control/data, hostContext=/r, hostPort=41769, coreRootDirectory=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/control-001/cores}
   [junit4]   2> 1090231 T7601 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@58d25a40
   [junit4]   2> 1090231 T7601 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/control-001/'
   [junit4]   2> 1090241 T7601 oasc.SolrXmlConfig.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/control-001/solr.xml
   [junit4]   2> 1090245 T7601 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/control-001/cores
   [junit4]   2> 1090245 T7601 oasc.CoreContainer.<init> New CoreContainer 1900435078
   [junit4]   2> 1090245 T7601 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/control-001/]
   [junit4]   2> 1090245 T7601 oasc.CoreContainer.load loading shared library: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/control-001/lib
   [junit4]   2> 1090246 T7601 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/control-001/lib).
   [junit4]   2> 1090250 T7601 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1090250 T7601 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1090250 T7601 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1090251 T7601 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1090251 T7601 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
   [junit4]   2> 1090251 T7601 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1090251 T7601 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1090251 T7601 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1090251 T7601 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1090252 T7601 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1090252 T7601 oashc.HttpShardHandlerFactory.getParameter Setting useRetries to: false
   [junit4]   2> 1090252 T7601 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1090252 T7601 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1090253 T7601 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1090253 T7601 oasc.CoreContainer.load Node Name: 127.0.0.1
   [junit4]   2> 1090253 T7601 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:34497/solr
   [junit4]   2> 1090253 T7601 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1090253 T7601 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 1090254 T7601 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1090256 T7626 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3785848d name:ZooKeeperConnection Watcher:127.0.0.1:34497 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1090256 T7601 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1090256 T7601 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 1090258 T7601 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1090259 T7629 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7e16a75b name:ZooKeeperConnection Watcher:127.0.0.1:34497/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1090259 T7601 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1090261 T7601 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 1090263 T7601 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 1090265 T7601 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
   [junit4]   2> 1090266 T7601 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
   [junit4]   2> 1090267 T7601 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
   [junit4]   2> 1090268 T7601 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 1090269 T7601 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41769_r
   [junit4]   2> 1090269 T7601 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:41769_r
   [junit4]   2> 1090270 T7601 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 1090271 T7601 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 1090272 T7601 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 1090272 T7601 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:41769_r
   [junit4]   2> 1090273 T7601 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 1090274 T7601 oasc.Overseer.start Overseer (id=93443917563559939-127.0.0.1:41769_r-n_0000000000) starting
   [junit4]   2> 1090275 T7601 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 1090278 T7601 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 1090278 T7631 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 1090278 T7601 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 1090279 T7630 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 1090280 T7601 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 1090281 T7601 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1090282 T7601 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/control-001/cores
   [junit4]   1> CORE DESCRIPTOR: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/control-001/cores/collection1, collection=control_collection, absoluteInstDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/control-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 1090283 T7601 oasc.CorePropertiesLocator.discoverUnder Found core collection1 in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/control-001/cores/collection1/
   [junit4]   2> 1090283 T7601 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 1090284 T7633 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
   [junit4]   2> 1090284 T7633 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1090284 T7629 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 1090284 T7633 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1090285 T7630 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:41769/r",
   [junit4]   2> 	  "node_name":"127.0.0.1:41769_r",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "operation":"state"} current state version: 0
   [junit4]   2> 1090285 T7630 oasco.ReplicaMutator.updateState Update state numShards=1 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:41769/r",
   [junit4]   2> 	  "node_name":"127.0.0.1:41769_r",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 1090285 T7630 oasco.ClusterStateMutator.createCollection building a new cName: control_collection
   [junit4]   2> 1090285 T7630 oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 1090286 T7629 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1091285 T7633 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1091285 T7633 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
   [junit4]   2> 1091285 T7633 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1091286 T7633 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 1091286 T7633 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1091287 T7633 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/control-001/cores/collection1/'
   [junit4]   2> 1091295 T7633 oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
   [junit4]   2> 1091296 T7633 oasc.Config.<init> loaded config solrconfig.xml with version 0 
   [junit4]   2> 1091301 T7633 oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
   [junit4]   2> 1091304 T7633 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 1091311 T7633 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1091312 T7633 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 1091315 T7633 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1091395 T7633 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1091396 T7633 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1091397 T7633 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1091399 T7633 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1091408 T7633 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 1091408 T7633 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1091409 T7633 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/control-001/cores/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/control-001/cores/collection1/data/
   [junit4]   2> 1091409 T7633 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@a3bc405
   [junit4]   2> 1091409 T7633 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/control-001/cores/collection1/data
   [junit4]   2> 1091409 T7633 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/control-001/cores/collection1/data/index/
   [junit4]   2> 1091409 T7633 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 1091410 T7633 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/control-001/cores/collection1/data/index
   [junit4]   2> 1091410 T7633 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=42, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 1091410 T7633 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@fe99b3 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5fcbcb84),segFN=segments_1,generation=1}
   [junit4]   2> 1091411 T7633 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1091413 T7633 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1091413 T7633 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1091413 T7633 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1091413 T7633 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1091413 T7633 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1091413 T7633 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1091414 T7633 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1091414 T7633 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1091414 T7633 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1091415 T7633 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1091416 T7633 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1091416 T7633 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1091417 T7633 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1091419 T7633 oasc.RequestHandlers.initHandlersFromConfig Registered paths: /admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
   [junit4]   2> 1091419 T7633 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 1091420 T7633 oasu.UpdateHandler.<init> Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1091420 T7633 oasu.UpdateLog.init Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10
   [junit4]   2> 1091420 T7633 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1091420 T7633 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1091421 T7633 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=9, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 1091421 T7633 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@fe99b3 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5fcbcb84),segFN=segments_1,generation=1}
   [junit4]   2> 1091421 T7633 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1091421 T7633 oass.SolrIndexSearcher.<init> Opening Searcher@2a8f4384[collection1] main
   [junit4]   2> 1091421 T7633 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 1091422 T7633 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1091422 T7633 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 1091423 T7633 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1091423 T7633 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 1091423 T7633 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1091423 T7633 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1091423 T7633 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1091423 T7633 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 1091424 T7633 oash.ReplicationHandler.inform Commits will be reserved for  10000
   [junit4]   2> 1091424 T7633 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1091424 T7634 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2a8f4384[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1091424 T7637 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:41769/r collection:control_collection shard:shard1
   [junit4]   2> 1091425 T7601 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 1091425 T7601 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1091425 T7637 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 1091426 T7601 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 1091426 T7601 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1091428 T7640 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@597850ba name:ZooKeeperConnection Watcher:127.0.0.1:34497/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1091428 T7601 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1091429 T7601 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 1091429 T7637 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 1091430 T7601 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1091430 T7629 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 1091431 T7637 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 1091431 T7637 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> 1091431 T7630 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"leader",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection"} current state version: 1
   [junit4]   2> ASYNC  NEW_CORE C3196 name=collection1 org.apache.solr.core.SolrCore@497268ab url=http://127.0.0.1:41769/r/collection1 node=127.0.0.1:41769_r C3196_STATE=coll:control_collection core:collection1 props:{core=collection1, base_url=http://127.0.0.1:41769/r, node_name=127.0.0.1:41769_r, state=down}
   [junit4]   2> 1091431 T7637 C3196 P41769 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:41769/r/collection1/
   [junit4]   2> 1091431 T7637 C3196 P41769 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 1091432 T7637 C3196 P41769 oasc.SyncStrategy.syncToMe http://127.0.0.1:41769/r/collection1/ has no replicas
   [junit4]   2> 1091432 T7637 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:41769/r/collection1/ shard1
   [junit4]   2> 1091432 T7637 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 1091432 T7601 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 1091434 T7629 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 1091434 T7630 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"leader",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:41769/r",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "state":"active"} current state version: 1
   [junit4]   2> 1091536 T7629 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1091536 T7640 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1091585 T7637 oasc.ZkController.register We are http://127.0.0.1:41769/r/collection1/ and leader is http://127.0.0.1:41769/r/collection1/
   [junit4]   2> 1091585 T7637 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:41769/r
   [junit4]   2> 1091585 T7637 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 1091585 T7637 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
   [junit4]   2> 1091585 T7637 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1091586 T7629 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 1091587 T7630 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:41769/r",
   [junit4]   2> 	  "node_name":"127.0.0.1:41769_r",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "operation":"state"} current state version: 2
   [junit4]   2> 1091587 T7630 oasco.ReplicaMutator.updateState Update state numShards=3 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:41769/r",
   [junit4]   2> 	  "node_name":"127.0.0.1:41769_r",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 1091669 T7601 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/shard-1-001/cores/collection1
   [junit4]   2> 1091670 T7601 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1 in directory /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/shard-1-001
   [junit4]   2> 1091671 T7601 oejs.Server.doStart jetty-9.2.9.v20150224
   [junit4]   2> 1091672 T7601 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@ef4dac6{/r,null,AVAILABLE}
   [junit4]   2> 1091672 T7601 oejs.AbstractConnector.doStart Started ServerConnector@29d32013{HTTP/1.1}{127.0.0.1:59375}
   [junit4]   2> 1091673 T7601 oejs.Server.doStart Started @1092829ms
   [junit4]   2> 1091673 T7601 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {solr.data.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/r, hostPort=59375, coreRootDirectory=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/shard-1-001/cores}
   [junit4]   2> 1091673 T7601 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@58d25a40
   [junit4]   2> 1091673 T7601 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/shard-1-001/'
   [junit4]   2> 1091683 T7601 oasc.SolrXmlConfig.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/shard-1-001/solr.xml
   [junit4]   2> 1091687 T7601 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/shard-1-001/cores
   [junit4]   2> 1091687 T7601 oasc.CoreContainer.<init> New CoreContainer 1472380057
   [junit4]   2> 1091687 T7601 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/shard-1-001/]
   [junit4]   2> 1091687 T7601 oasc.CoreContainer.load loading shared library: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/shard-1-001/lib
   [junit4]   2> 1091688 T7601 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/shard-1-001/lib).
   [junit4]   2> 1091689 T7629 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1091689 T7640 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1091693 T7601 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1091693 T7601 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1091693 T7601 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1091693 T7601 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1091694 T7601 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
   [junit4]   2> 1091694 T7601 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1091694 T7601 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1091694 T7601 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1091694 T7601 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1091695 T7601 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1091695 T7601 oashc.HttpShardHandlerFactory.getParameter Setting useRetries to: false
   [junit4]   2> 1091695 T7601 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1091695 T7601 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1091695 T7601 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1091696 T7601 oasc.CoreContainer.load Node Name: 127.0.0.1
   [junit4]   2> 1091696 T7601 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:34497/solr
   [junit4]   2> 1091696 T7601 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1091696 T7601 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 1091697 T7601 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1091699 T7654 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2a453bf5 name:ZooKeeperConnection Watcher:127.0.0.1:34497 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1091699 T7601 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1091699 T7601 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 1091701 T7601 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1091702 T7657 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6aa58b38 name:ZooKeeperConnection Watcher:127.0.0.1:34497/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1091702 T7601 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1091706 T7601 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1092708 T7601 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59375_r
   [junit4]   2> 1092708 T7601 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59375_r
   [junit4]   2> 1092711 T7601 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 1092713 T7601 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/shard-1-001/cores
   [junit4]   1> CORE DESCRIPTOR: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/shard-1-001/cores/collection1, collection=collection1, absoluteInstDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/shard-1-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 1092714 T7601 oasc.CorePropertiesLocator.discoverUnder Found core collection1 in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/shard-1-001/cores/collection1/
   [junit4]   2> 1092714 T7601 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 1092715 T7658 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 1092715 T7658 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1092716 T7629 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 1092716 T7658 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1092716 T7630 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:59375/r",
   [junit4]   2> 	  "node_name":"127.0.0.1:59375_r",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"} current state version: 3
   [junit4]   2> 1092716 T7630 oasco.ReplicaMutator.updateState Update state numShards=3 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:59375/r",
   [junit4]   2> 	  "node_name":"127.0.0.1:59375_r",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 1092717 T7630 oasco.ClusterStateMutator.createCollection building a new cName: collection1
   [junit4]   2> 1092717 T7630 oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard2
   [junit4]   2> 1092819 T7657 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1092819 T7629 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1092819 T7640 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1093716 T7658 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1093716 T7658 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 1093717 T7658 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1093718 T7658 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 1093719 T7658 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1093719 T7658 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/shard-1-001/cores/collection1/'
   [junit4]   2> 1093730 T7658 oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
   [junit4]   2> 1093732 T7658 oasc.Config.<init> loaded config solrconfig.xml with version 0 
   [junit4]   2> 1093737 T7658 oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
   [junit4]   2> 1093741 T7658 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 1093750 T7658 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1093751 T7658 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 1093756 T7658 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1093837 T7658 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1093839 T7658 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1093840 T7658 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1093842 T7658 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1093850 T7658 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 1093850 T7658 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1093851 T7658 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/shard-1-001/cores/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/shard-1-001/cores/collection1/data/
   [junit4]   2> 1093851 T7658 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@a3bc405
   [junit4]   2> 1093851 T7658 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/shard-1-001/cores/collection1/data
   [junit4]   2> 1093852 T7658 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/shard-1-001/cores/collection1/data/index/
   [junit4]   2> 1093852 T7658 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/shard-1-001/cores/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 1093852 T7658 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/shard-1-001/cores/collection1/data/index
   [junit4]   2> 1093852 T7658 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=42, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 1093853 T7658 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@2b93a892 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3ad62a9c),segFN=segments_1,generation=1}
   [junit4]   2> 1093853 T7658 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1093855 T7658 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1093855 T7658 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1093856 T7658 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1093856 T7658 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1093856 T7658 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1093856 T7658 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1093856 T7658 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1093856 T7658 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1093856 T7658 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1093858 T7658 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1093859 T7658 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1093859 T7658 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1093860 T7658 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1093863 T7658 oasc.RequestHandlers.initHandlersFromConfig Registered paths: /admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
   [junit4]   2> 1093863 T7658 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 1093864 T7658 oasu.UpdateHandler.<init> Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1093864 T7658 oasu.UpdateLog.init Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10
   [junit4]   2> 1093864 T7658 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1093864 T7658 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1093865 T7658 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=9, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 1093865 T7658 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@2b93a892 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3ad62a9c),segFN=segments_1,generation=1}
   [junit4]   2> 1093865 T7658 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1093865 T7658 oass.SolrIndexSearcher.<init> Opening Searcher@7c182034[collection1] main
   [junit4]   2> 1093866 T7658 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 1093866 T7658 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1093866 T7658 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 1093867 T7658 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1093867 T7658 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 1093867 T7658 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1093867 T7658 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1093868 T7658 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1093868 T7658 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 1093868 T7658 oash.ReplicationHandler.inform Commits will be reserved for  10000
   [junit4]   2> 1093868 T7658 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1093868 T7659 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7c182034[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1093869 T7662 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:59375/r collection:collection1 shard:shard2
   [junit4]   2> 1093869 T7601 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 1093869 T7601 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1093869 T7662 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
   [junit4]   2> 1093872 T7662 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
   [junit4]   2> 1093873 T7629 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 1093873 T7662 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 1093873 T7662 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C3197 name=collection1 org.apache.solr.core.SolrCore@1a191df6 url=http://127.0.0.1:59375/r/collection1 node=127.0.0.1:59375_r C3197_STATE=coll:collection1 core:collection1 props:{core=collection1, base_url=http://127.0.0.1:59375/r, node_name=127.0.0.1:59375_r, state=down}
   [junit4]   2> 1093873 T7662 C3197 P59375 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:59375/r/collection1/
   [junit4]   2> 1093873 T7630 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"leader",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"collection1"} current state version: 4
   [junit4]   2> 1093873 T7662 C3197 P59375 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 1093874 T7662 C3197 P59375 oasc.SyncStrategy.syncToMe http://127.0.0.1:59375/r/collection1/ has no replicas
   [junit4]   2> 1093874 T7662 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:59375/r/collection1/ shard2
   [junit4]   2> 1093874 T7662 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
   [junit4]   2> 1093876 T7629 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 1093876 T7630 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"leader",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:59375/r",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "state":"active"} current state version: 4
   [junit4]   2> 1093978 T7629 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1093978 T7657 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1093978 T7640 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1094026 T7662 oasc.ZkController.register We are http://127.0.0.1:59375/r/collection1/ and leader is http://127.0.0.1:59375/r/collection1/
   [junit4]   2> 1094027 T7662 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:59375/r
   [junit4]   2> 1094027 T7662 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 1094027 T7662 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
   [junit4]   2> 1094027 T7662 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1094028 T7629 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 1094029 T7630 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:59375/r",
   [junit4]   2> 	  "node_name":"127.0.0.1:59375_r",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"} current state version: 5
   [junit4]   2> 1094029 T7630 oasco.ReplicaMutator.updateState Update state numShards=3 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:59375/r",
   [junit4]   2> 	  "node_name":"127.0.0.1:59375_r",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 1094131 T7629 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1094131 T7657 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1094131 T7640 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1094232 T7601 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/shard-2-001/cores/collection1
   [junit4]   2> 1094233 T7601 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2 in directory /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/shard-2-001
   [junit4]   2> 1094234 T7601 oejs.Server.doStart jetty-9.2.9.v20150224
   [junit4]   2> 1094236 T7601 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@724b3261{/r,null,AVAILABLE}
   [junit4]   2> 1094236 T7601 oejs.AbstractConnector.doStart Started ServerConnector@5ed95302{HTTP/1.1}{127.0.0.1:50437}
   [junit4]   2> 1094236 T7601 oejs.Server.doStart Started @1095393ms
   [junit4]   2> 1094237 T7601 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {solr.data.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/tempDir-001/jetty2, solrconfig=solrconfig.xml, hostContext=/r, hostPort=50437, coreRootDirectory=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/shard-2-001/cores}
   [junit4]   2> 1094237 T7601 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@58d25a40
   [junit4]   2> 1094237 T7601 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/shard-2-001/'
   [junit4]   2> 1094253 T7601 oasc.SolrXmlConfig.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/shard-2-001/solr.xml
   [junit4]   2> 1094258 T7601 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/shard-2-001/cores
   [junit4]   2> 1094258 T7601 oasc.CoreContainer.<init> New CoreContainer 607866611
   [junit4]   2> 1094258 T7601 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/shard-2-001/]
   [junit4]   2> 1094259 T7601 oasc.CoreContainer.load loading shared library: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/shard-2-001/lib
   [junit4]   2> 1094259 T7601 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/shard-2-001/lib).
   [junit4]   2> 1094266 T7601 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1094266 T7601 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1094267 T7601 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1094267 T7601 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1094267 T7601 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
   [junit4]   2> 1094267 T7601 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1094268 T7601 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1094268 T7601 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1094268 T7601 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1094268 T7601 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1094269 T7601 oashc.HttpShardHandlerFactory.getParameter Setting useRetries to: false
   [junit4]   2> 1094269 T7601 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1094270 T7601 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1094270 T7601 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1094270 T7601 oasc.CoreContainer.load Node Name: 127.0.0.1
   [junit4]   2> 1094270 T7601 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:34497/solr
   [junit4]   2> 1094271 T7601 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1094271 T7601 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 1094272 T7601 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1094274 T7676 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3aee5d6 name:ZooKeeperConnection Watcher:127.0.0.1:34497 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1094274 T7601 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1094275 T7601 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 1094277 T7601 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1094279 T7679 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@287ea636 name:ZooKeeperConnection Watcher:127.0.0.1:34497/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1094279 T7601 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1094283 T7601 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1095285 T7601 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50437_r
   [junit4]   2> 1095286 T7601 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50437_r
   [junit4]   2> 1095290 T7601 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 1095291 T7601 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/shard-2-001/cores
   [junit4]   1> CORE DESCRIPTOR: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/shard-2-001/cores/collection1, collection=collection1, absoluteInstDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/shard-2-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 1095293 T7601 oasc.CorePropertiesLocator.discoverUnder Found core collection1 in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/shard-2-001/cores/collection1/
   [junit4]   2> 1095293 T7601 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 1095294 T7680 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 1095294 T7680 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1095294 T7629 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 1095294 T7680 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1095295 T7630 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:50437/r",
   [junit4]   2> 	  "node_name":"127.0.0.1:50437_r",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"} current state version: 6
   [junit4]   2> 1095296 T7630 oasco.ReplicaMutator.updateState Update state numShards=3 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:50437/r",
   [junit4]   2> 	  "node_name":"127.0.0.1:50437_r",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 1095296 T7630 oasco.ReplicaMutator.updateState Collection already exists with numShards=3
   [junit4]   2> 1095296 T7630 oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard3
   [junit4]   2> 1095398 T7640 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1095398 T7629 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1095398 T7657 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1095398 T7679 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1096295 T7680 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1096295 T7680 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 1096296 T7680 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1096296 T7680 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 1096297 T7680 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1096297 T7680 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/shard-2-001/cores/collection1/'
   [junit4]   2> 1096307 T7680 oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
   [junit4]   2> 1096309 T7680 oasc.Config.<init> loaded config solrconfig.xml with version 0 
   [junit4]   2> 1096314 T7680 oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
   [junit4]   2> 1096319 T7680 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 1096327 T7680 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1096328 T7680 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 1096331 T7680 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1096408 T7680 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1096410 T7680 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1096411 T7680 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1096413 T7680 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1096424 T7680 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 1096424 T7680 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1096424 T7680 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/shard-2-001/cores/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/shard-2-001/cores/collection1/data/
   [junit4]   2> 1096424 T7680 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@a3bc405
   [junit4]   2> 1096426 T7680 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/shard-2-001/cores/collection1/data
   [junit4]   2> 1096426 T7680 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/shard-2-001/cores/collection1/data/index/
   [junit4]   2> 1096426 T7680 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/shard-2-001/cores/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 1096426 T7680 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest 8ECC2C3BD5E2951B-001/shard-2-001/cores/collection1/data/index
   [junit4]   2> 1096426 T7680 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=42, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 1096427 T7680 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@41d86df7 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2107f333),segFN=segments_1,generation=1}
   [junit4]   2> 1096427 T7680 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1096429 T7680 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1096429 T7680 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1096430 T7680 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1096430 T7680 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1096430 T7680 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1096430 T7680 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1096430 T7680 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1096430 T7680 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1096431 T7680 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1096432 T7680 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1096433 T7680 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1096433 T7680 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1096434 T7680 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1096436 T7680 oasc.RequestHandlers.initHandlersFromConfig Registered paths: /admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
   [junit4]   2> 1096437 T7680 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 1096437 T7680 oasu.UpdateHandler.<init> Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1096438 T7680 oasu.UpdateLog.init Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10
   [junit4]   2> 1096438 T7680 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1096438 T7680 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1096438 T7680 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=9, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 1096439 T7680 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@41d86df7 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2107f333),segFN=segments_1,generation=1}
   [junit4]   2> 1096439 T7680 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1096439 T7680 oass.SolrIndexSearcher.<init> Opening Searcher@3672cbea[collection1] main
   [junit4]   2> 1096439 T7680 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 1096440 T7680 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1096440 T7680 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 1096440 T7680 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1096441 T7680 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 1096441 T7680 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1096441 T7680 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1096441 T7680 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1096441 T7680 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 1096441 T7680 oash.ReplicationHandler.inform Commits will be reserved for  10000
   [junit4]   2> 1096442 T7680 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1096442 T7681 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3672cbea[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1096442 T7684 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:50437/r collection:collection1 shard:shard3
   [junit4]   2> 1096443 T7601 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 1096443 T7684 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election
   [junit4]   2> 1096443 T7601 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1096445 T7684 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard3
   [junit4]   2> 1096446 T7629 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 1096446 T7684 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 1096446 T7684 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> 1096446 T7630 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"leader",
   [junit4]   2> 	  "shard":"shard3",
   [junit4]   2> 	  "collection":"collection1"} current state version: 7
   [junit4]   2> ASYNC  NEW_CORE C3198 name=collection1 org.apache.solr.core.SolrCore@54908044 url=http://127.0.0.1:50437/r/collection1 node=127.0.0.1:50437_r C3198_STATE=coll:collection1 core:collection1 props:{core=collection1, base_url=http://127.0.0.1:50437/r, node_name=127.0.0.1:50437_r, state=down}
   [junit4]   2> 1096446 T7684 C3198 P50437 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:50437/r/collection1/
   [junit4]   2> 1096447 T7684 C3198 P50437 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 1096447 T7684 C3198 P50437 oasc.SyncStrategy.syncToMe http://127.0.0.1:50437/r/collection1/ has no replicas
   [junit4]   2> 1096447 T7684 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:50437/r/collection1/ shard3
   [junit4]   2> 1096447 T7684 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard3
   [junit4]   2> 1096449 T7629 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 1096449 T7630 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"leader",
   [junit4]   2> 	  "shard":"shard3",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:50437/r",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "state":"active"} current state version: 7
   [junit4]   2> 1096551 

[...truncated too long message...]

ngPostingsFormat(Lucene50(blocksize=128))), 6child0_s=BlockTreeOrds(blocksize=128), 13grand1_s=PostingsFormat(name=LuceneVarGapFixedInterval), 12grand4_s=FST50, 17parent_f1_s=BlockTreeOrds(blocksize=128), _version_=BlockTreeOrds(blocksize=128), 2grand0_s=BlockTreeOrds(blocksize=128), 11grand7_s=PostingsFormat(name=LuceneVarGapFixedInterval), 3child1_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), 7parent_f2_s=BlockTreeOrds(blocksize=128), 26parent_f1_s=BlockTreeOrds(blocksize=128), 10grand2_s=FST50, 3parent_f1_s=FST50, 28parent_f2_s=PostingsFormat(name=LuceneVarGapFixedInterval), 6grand2_s=BlockTreeOrds(blocksize=128), 7grand5_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), 18parent_f2_s=BlockTreeOrds(blocksize=128), 8grand0_s=BlockTreeOrds(blocksize=128), 9grand3_s=BlockTreeOrds(blocksize=128), 3grand1_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), 4parent_f1_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), 19parent_f1_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), 11grand10_s=PostingsFormat(name=LuceneVarGapFixedInterval), 5child3_s=BlockTreeOrds(blocksize=128), 9parent_f2_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), id=PostingsFormat(name=LuceneVarGapFixedInterval), text=FST50, 7child1_s=BlockTreeOrds(blocksize=128), 13parent_f1_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), 7child0_s=PostingsFormat(name=LuceneVarGapFixedInterval), 23parent_f1_s=PostingsFormat(name=LuceneVarGapFixedInterval), 5child2_s=PostingsFormat(name=LuceneVarGapFixedInterval), 13grand4_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), 29parent_f1_s=FST50, 12parent_f1_s=PostingsFormat(name=LuceneVarGapFixedInterval), 22parent_f1_s=BlockTreeOrds(blocksize=128), 12grand1_s=BlockTreeOrds(blocksize=128), 11grand6_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), 2child1_s=PostingsFormat(name=LuceneVarGapFixedInterval), 3parent_f2_s=BlockTreeOrds(blocksize=128), 10grand3_s=BlockTreeOrds(blocksize=128), 6grand3_s=FST50, 31parent_f2_s=PostingsFormat(name=LuceneVarGapFixedInterval), 11parent_f2_s=FST50, 21parent_f2_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), 7grand4_s=PostingsFormat(name=LuceneVarGapFixedInterval), 3grand0_s=PostingsFormat(name=LuceneVarGapFixedInterval), 8grand1_s=FST50, 9grand2_s=PostingsFormat(name=LuceneVarGapFixedInterval), 9parent_f1_s=PostingsFormat(name=LuceneVarGapFixedInterval), 13parent_f2_s=PostingsFormat(name=LuceneVarGapFixedInterval), 23parent_f2_s=BlockTreeOrds(blocksize=128), 5child1_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), 13grand3_s=FST50, 22parent_f2_s=FST50, 4child0_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), 11grand5_s=FST50, 12grand2_s=PostingsFormat(name=LuceneVarGapFixedInterval), 12parent_f2_s=BlockTreeOrds(blocksize=128), 10grand4_s=PostingsFormat(name=LuceneVarGapFixedInterval), 21parent_f1_s=FST50, 8grand2_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), 9grand1_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), 12grand8_s=FST50, 13grand7_s=FST50, 14parent_f1_s=FST50, 20parent_f2_s=PostingsFormat(name=LuceneVarGapFixedInterval), 6child4_s=BlockTreeOrds(blocksize=128), 6grand0_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), 7child3_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), 5child0_s=FST50, 8parent_f1_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), title_lettertok=PostingsFormat(name=LuceneVarGapFixedInterval), 27parent_f2_s=BlockTreeOrds(blocksize=128), 2parent_f2_s=PostingsFormat(name=LuceneVarGapFixedInterval), 4child1_s=FST50, 11grand4_s=BlockTreeOrds(blocksize=128), 16parent_f2_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), 10grand5_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), 13grand10_s=FST50, 7grand6_s=FST50, 18parent_f1_s=FST50, 9grand8_s=FST50, 8grand3_s=PostingsFormat(name=LuceneVarGapFixedInterval), 6parent_f1_s=BlockTreeOrds(blocksize=128), 25parent_f1_s=FST50, 12grand9_s=BlockTreeOrds(blocksize=128), 0parent_f1_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), 3grand2_s=FST50, 9grand0_s=FST50, 4parent_f2_s=FST50, 13grand6_s=BlockTreeOrds(blocksize=128), 6child5_s=PostingsFormat(name=LuceneVarGapFixedInterval), 7child2_s=FST50, 5grand4_s=FST50, 6grand1_s=PostingsFormat(name=LuceneVarGapFixedInterval), 16parent_f1_s=PostingsFormat(name=LuceneVarGapFixedInterval), 8parent_f2_s=FST50, 13grand5_s=PostingsFormat(name=LuceneVarGapFixedInterval), 29parent_f2_s=BlockTreeOrds(blocksize=128), 2parent_f1_s=BlockTreeOrds(blocksize=128), 4child2_s=BlockTreeOrds(blocksize=128), rnd_b=PostingsFormat(name=LuceneVarGapFixedInterval), 11grand3_s=PostingsFormat(name=LuceneVarGapFixedInterval), 27parent_f1_s=PostingsFormat(name=LuceneVarGapFixedInterval), title_stemmed=BlockTreeOrds(blocksize=128), 12grand0_s=FST50, 10grand6_s=FST50, 2child0_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), 13grand11_s=BlockTreeOrds(blocksize=128)}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=true,coord=yes): {}, locale=es_AR, timezone=Poland
   [junit4]   2> NOTE: Linux 3.13.0-46-generic amd64/Oracle Corporation 1.9.0-ea (64-bit)/cpus=8,threads=1,free=250812120,total=415760384
   [junit4]   2> NOTE: All tests run in this JVM: [DistributedQueryComponentCustomSortTest, TestSuggestSpellingConverter, CurrencyFieldXmlFileTest, TestBlendedInfixSuggestions, WordBreakSolrSpellCheckerTest, TestFoldingMultitermQuery, TestJoin, StandardRequestHandlerTest, PolyFieldTest, TestSolrConfigHandlerCloud, TestDFRSimilarityFactory, TestFieldCollectionResource, BadCopyFieldTest, OutOfBoxZkACLAndCredentialsProvidersTest, TestFuzzyAnalyzedSuggestions, DeleteInactiveReplicaTest, TestSearcherReuse, ReturnFieldsTest, HdfsWriteToMultipleCollectionsTest, TestSolrXml, AnalyticsQueryTest, TestInitParams, DebugComponentTest, HdfsDirectoryFactoryTest, CursorPagingTest, DistributedFacetPivotLongTailTest, TermVectorComponentTest, TestHighlightDedupGrouping, TestSchemaResource, StatelessScriptUpdateProcessorFactoryTest, QueryResultKeyTest, DistributedMLTComponentTest, TestExpandComponent, TestChildDocTransformer, InfoHandlerTest, TestMergePolicyConfig, TestFastOutputStream, VMParamsZkACLAndCredentialsProvidersTest, ResourceLoaderTest, ShardSplitTest, TestSolrConfigHandler, SpellCheckCollatorTest, TestDocSet, OpenCloseCoreStressTest, CollectionsAPIDistributedZkTest, TestManagedResource, TestAddFieldRealTimeGet, TestSolrDeletionPolicy1, TestCursorMarkWithoutUniqueKey, ShardRoutingCustomTest, OverseerCollectionProcessorTest, TestCopyFieldCollectionResource, DistributedQueryComponentOptimizationTest, TestSolrDynamicMBean, TestObjectReleaseTracker, TestSimpleTrackingShardHandler, TestCryptoKeys, TestPHPSerializedResponseWriter, ReplicationFactorTest, TestQuerySenderNoQuery, TestHdfsUpdateLog, PluginInfoTest, IndexBasedSpellCheckerTest, EchoParamsTest, TestReversedWildcardFilterFactory, TestSolrJ, BufferStoreTest, DistributedFacetPivotSmallAdvancedTest, LeaderInitiatedRecoveryOnCommitTest, QueryParsingTest, TestUtils, SimplePostToolTest, TestCloudManagedSchemaConcurrent, CustomCollectionTest, TestReplicationHandlerBackup, TestQuerySenderListener, ZkStateWriterTest, TestLMJelinekMercerSimilarityFactory, TestTrie, TestOrdValues, SuggesterTSTTest, TestRealTimeGet, AliasIntegrationTest, QueryEqualityTest, ChangedSchemaMergeTest, AsyncMigrateRouteKeyTest, TestConfig, TestMiniSolrCloudCluster, TestLMDirichletSimilarityFactory, TestTolerantSearch, TestFiltering, TestRemoteStreaming, BlockDirectoryTest, MinimalSchemaTest, TestDistributedGrouping, MergeStrategyTest, TestInfoStreamLogging, TestAnalyzeInfixSuggestions, TestRecovery, UpdateParamsTest, TestFieldTypeResource, FastVectorHighlighterTest, AnalyticsMergeStrategyTest, TestDefaultSimilarityFactory, ConvertedLegacyTest, TestCoreDiscovery, FullSolrCloudDistribCmdsTest]
   [junit4] Completed on J1 in 39.22s, 1 test, 1 error <<< FAILURES!

[...truncated 726 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:519: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:467: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:61: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:191: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:510: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1351: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:958: There were test failures: 471 suites, 1872 tests, 1 error, 48 ignored (21 assumptions)

Total time: 59 minutes 41 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 64bit/jdk1.9.0-ea-b47 -XX:+UseCompressedOops -XX:+UseParallelGC
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



[JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.8.0_40-ea-b22) - Build # 11937 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/11937/
Java: 64bit/jdk1.8.0_40-ea-b22 -XX:+UseCompressedOops -XX:+UseG1GC

All tests passed

Build Log:
[...truncated 59315 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:519: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:426: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:105: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:208: Source checkout is dirty after running tests!!! Offending files:
* ./solr/licenses/runtimelibs.jar.sha1
* ./solr/licenses/runtimelibs_v2.jar.sha1

Total time: 89 minutes 40 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 64bit/jdk1.8.0_40-ea-b22 -XX:+UseCompressedOops -XX:+UseG1GC
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



Re: [JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.8.0_31) - Build # 11936 - Still Failing!

Posted by Noble Paul <no...@gmail.com>.
I shall rename it to something else

On Sun, Mar 8, 2015 at 7:19 PM, Shalin Shekhar Mangar <
shalinmangar@gmail.com> wrote:

> This was added in SOLR-7073.
>
> This feature requires a jar to be available which can be loaded using this
> new API under test. It looks like either we can add an exception to our
> policy and smoke tester or else just rename the jar file to some other
> extension. The API doesn't rely on the file being named as a .jar file.
>
> On Sun, Mar 8, 2015 at 6:06 PM, Uwe Schindler <uw...@thetaphi.de> wrote:
>
>> Hi,
>>
>> There is something completely broken. If you run "ant clean-jars" those
>> files are removed from the test-files folder! If they are there then
>> This violates against our policy to *not have JAR files in the source
>> checkout*. Smoke tester also checks for this.
>>
>> Uwe
>>
>> -----
>> Uwe Schindler
>> H.-H.-Meier-Allee 63, D-28213 Bremen
>> http://www.thetaphi.de
>> eMail: uwe@thetaphi.de
>>
>>
>> > -----Original Message-----
>> > From: Policeman Jenkins Server [mailto:jenkins@thetaphi.de]
>> > Sent: Sunday, March 08, 2015 12:40 PM
>> > To: dev@lucene.apache.org
>> > Subject: [JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.8.0_31) - Build #
>> > 11936 - Still Failing!
>> >
>> > Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/11936/
>> > Java: 64bit/jdk1.8.0_31 -XX:-UseCompressedOops -XX:+UseParallelGC
>> >
>> > All tests passed
>> >
>> > Build Log:
>> > [...truncated 59363 lines...]
>> > BUILD FAILED
>> > /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:519: The
>> > following error occurred while executing this line:
>> > /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:426: The
>> > following error occurred while executing this line:
>> > /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-
>> > targets.xml:105: The following error occurred while executing this line:
>> > /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-
>> > targets.xml:208: Source checkout is dirty after running tests!!!
>> Offending
>> > files:
>> > * ./solr/licenses/runtimelibs.jar.sha1
>> > * ./solr/licenses/runtimelibs_v2.jar.sha1
>> >
>> > Total time: 82 minutes 38 seconds
>> > Build step 'Invoke Ant' marked build as failure [description-setter]
>> > Description set: Java: 64bit/jdk1.8.0_31 -XX:-UseCompressedOops -
>> > XX:+UseParallelGC Archiving artifacts Recording test results Email was
>> > triggered for: Failure - Any Sending email for trigger: Failure - Any
>> >
>>
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: dev-help@lucene.apache.org
>>
>>
>
>
> --
> Regards,
> Shalin Shekhar Mangar.
>



-- 
-----------------------------------------------------
Noble Paul

Re: [JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.8.0_31) - Build # 11936 - Still Failing!

Posted by Shalin Shekhar Mangar <sh...@gmail.com>.
This was added in SOLR-7073.

This feature requires a jar to be available which can be loaded using this
new API under test. It looks like either we can add an exception to our
policy and smoke tester or else just rename the jar file to some other
extension. The API doesn't rely on the file being named as a .jar file.

On Sun, Mar 8, 2015 at 6:06 PM, Uwe Schindler <uw...@thetaphi.de> wrote:

> Hi,
>
> There is something completely broken. If you run "ant clean-jars" those
> files are removed from the test-files folder! If they are there then
> This violates against our policy to *not have JAR files in the source
> checkout*. Smoke tester also checks for this.
>
> Uwe
>
> -----
> Uwe Schindler
> H.-H.-Meier-Allee 63, D-28213 Bremen
> http://www.thetaphi.de
> eMail: uwe@thetaphi.de
>
>
> > -----Original Message-----
> > From: Policeman Jenkins Server [mailto:jenkins@thetaphi.de]
> > Sent: Sunday, March 08, 2015 12:40 PM
> > To: dev@lucene.apache.org
> > Subject: [JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.8.0_31) - Build #
> > 11936 - Still Failing!
> >
> > Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/11936/
> > Java: 64bit/jdk1.8.0_31 -XX:-UseCompressedOops -XX:+UseParallelGC
> >
> > All tests passed
> >
> > Build Log:
> > [...truncated 59363 lines...]
> > BUILD FAILED
> > /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:519: The
> > following error occurred while executing this line:
> > /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:426: The
> > following error occurred while executing this line:
> > /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-
> > targets.xml:105: The following error occurred while executing this line:
> > /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-
> > targets.xml:208: Source checkout is dirty after running tests!!!
> Offending
> > files:
> > * ./solr/licenses/runtimelibs.jar.sha1
> > * ./solr/licenses/runtimelibs_v2.jar.sha1
> >
> > Total time: 82 minutes 38 seconds
> > Build step 'Invoke Ant' marked build as failure [description-setter]
> > Description set: Java: 64bit/jdk1.8.0_31 -XX:-UseCompressedOops -
> > XX:+UseParallelGC Archiving artifacts Recording test results Email was
> > triggered for: Failure - Any Sending email for trigger: Failure - Any
> >
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
>
>


-- 
Regards,
Shalin Shekhar Mangar.

RE: [JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.8.0_31) - Build # 11936 - Still Failing!

Posted by Uwe Schindler <uw...@thetaphi.de>.
Hi,

There is something completely broken. If you run "ant clean-jars" those files are removed from the test-files folder! If they are there then
This violates against our policy to *not have JAR files in the source checkout*. Smoke tester also checks for this.

Uwe

-----
Uwe Schindler
H.-H.-Meier-Allee 63, D-28213 Bremen
http://www.thetaphi.de
eMail: uwe@thetaphi.de


> -----Original Message-----
> From: Policeman Jenkins Server [mailto:jenkins@thetaphi.de]
> Sent: Sunday, March 08, 2015 12:40 PM
> To: dev@lucene.apache.org
> Subject: [JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.8.0_31) - Build #
> 11936 - Still Failing!
> 
> Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/11936/
> Java: 64bit/jdk1.8.0_31 -XX:-UseCompressedOops -XX:+UseParallelGC
> 
> All tests passed
> 
> Build Log:
> [...truncated 59363 lines...]
> BUILD FAILED
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:519: The
> following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:426: The
> following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-
> targets.xml:105: The following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-
> targets.xml:208: Source checkout is dirty after running tests!!! Offending
> files:
> * ./solr/licenses/runtimelibs.jar.sha1
> * ./solr/licenses/runtimelibs_v2.jar.sha1
> 
> Total time: 82 minutes 38 seconds
> Build step 'Invoke Ant' marked build as failure [description-setter]
> Description set: Java: 64bit/jdk1.8.0_31 -XX:-UseCompressedOops -
> XX:+UseParallelGC Archiving artifacts Recording test results Email was
> triggered for: Failure - Any Sending email for trigger: Failure - Any
> 



---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.8.0_31) - Build # 11936 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/11936/
Java: 64bit/jdk1.8.0_31 -XX:-UseCompressedOops -XX:+UseParallelGC

All tests passed

Build Log:
[...truncated 59363 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:519: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:426: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:105: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:208: Source checkout is dirty after running tests!!! Offending files:
* ./solr/licenses/runtimelibs.jar.sha1
* ./solr/licenses/runtimelibs_v2.jar.sha1

Total time: 82 minutes 38 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 64bit/jdk1.8.0_31 -XX:-UseCompressedOops -XX:+UseParallelGC
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



Re: [JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.9.0-ea-b47) - Build # 11935 - Still Failing!

Posted by Shalin Shekhar Mangar <sh...@gmail.com>.
I can't reproduce this. Can someone login in to that box and clear the
invalid sha1 files?

On Sun, Mar 8, 2015 at 11:42 AM, Policeman Jenkins Server <
jenkins@thetaphi.de> wrote:

> Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/11935/
> Java: 64bit/jdk1.9.0-ea-b47 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC
>
> All tests passed
>
> Build Log:
> [...truncated 49960 lines...]
> BUILD FAILED
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:519: The
> following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:426: The
> following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:105:
> The following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:208:
> Source checkout is dirty after running tests!!! Offending files:
> * ./solr/licenses/runtimelibs.jar.sha1
> * ./solr/licenses/runtimelibs_v2.jar.sha1
>
> Total time: 76 minutes 55 seconds
> Build step 'Invoke Ant' marked build as failure
> [description-setter] Description set: Java: 64bit/jdk1.9.0-ea-b47
> -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC
> Archiving artifacts
> Recording test results
> Email was triggered for: Failure - Any
> Sending email for trigger: Failure - Any
>
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
>



-- 
Regards,
Shalin Shekhar Mangar.