You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2015/03/03 19:46:28 UTC

[JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.8.0) - Build # 2027 - Failure!

Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-MacOSX/2027/
Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC

1 tests failed.
FAILED:  org.apache.solr.schema.TestCloudManagedSchemaConcurrent.test

Error Message:
The target server failed to respond

Stack Trace:
org.apache.http.NoHttpResponseException: The target server failed to respond
	at __randomizedtesting.SeedInfo.seed([C2FC830A1FEAECC9:4AA8BCD0B1168131]:0)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:143)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:260)
	at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
	at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
	at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:271)
	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:123)
	at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:682)
	at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:486)
	at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:863)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:106)
	at org.apache.solr.util.RestTestHarness.getResponse(RestTestHarness.java:208)
	at org.apache.solr.util.RestTestHarness.query(RestTestHarness.java:100)
	at org.apache.solr.schema.TestCloudManagedSchemaConcurrent.schemaLockTest(TestCloudManagedSchemaConcurrent.java:677)
	at org.apache.solr.schema.TestCloudManagedSchemaConcurrent.test(TestCloudManagedSchemaConcurrent.java:253)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:483)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:950)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:925)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 9052 lines...]
   [junit4] Suite: org.apache.solr.schema.TestCloudManagedSchemaConcurrent
   [junit4]   2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001/init-core-data-001
   [junit4]   2> 94551 T334 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (false)
   [junit4]   2> 94551 T334 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
   [junit4]   2> 94567 T334 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 94568 T335 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 94669 T334 oasc.ZkTestServer.run start zk server on port:49241
   [junit4]   2> 94669 T334 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 94670 T334 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 94677 T342 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@10ab2ce2 name:ZooKeeperConnection Watcher:127.0.0.1:49241 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 94677 T334 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 94678 T334 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 94678 T334 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 94687 T334 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 94688 T334 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 94693 T345 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ba040e9 name:ZooKeeperConnection Watcher:127.0.0.1:49241/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 94695 T334 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 94695 T334 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 94695 T334 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 94702 T334 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 94706 T334 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 94710 T334 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 94715 T334 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig-managed-schema.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 94715 T334 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 94723 T334 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 94724 T334 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 94729 T334 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 94729 T334 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 94744 T334 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 94744 T334 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 94750 T334 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 94750 T334 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 94761 T334 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 94761 T334 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 94767 T334 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 94767 T334 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 94780 T334 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 94781 T334 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 94785 T334 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 94786 T334 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 94797 T334 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 94798 T334 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 94802 T334 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 94803 T334 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 94810 T334 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 94812 T334 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 94815 T348 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@18785275 name:ZooKeeperConnection Watcher:127.0.0.1:49241/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 94816 T334 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 94816 T334 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 96413 T334 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001/control-001/cores/collection1
   [junit4]   2> 96420 T334 oejs.Server.doStart jetty-9.2.6.v20141205
   [junit4]   2> 96425 T334 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@7eadc072{/,null,AVAILABLE}
   [junit4]   2> 96472 T334 oejs.AbstractConnector.doStart Started ServerConnector@211e60ce{SSL-http/1.1}{127.0.0.1:49245}
   [junit4]   2> 96473 T334 oejs.Server.doStart Started @99520ms
   [junit4]   2> 96484 T334 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@4554617c
   [junit4]   2> 96485 T334 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 96486 T334 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001/control-001
   [junit4]   2> 96486 T334 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001/control-001/'
   [junit4]   2> 96527 T334 oasc.SolrXmlConfig.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001/control-001/solr.xml
   [junit4]   2> 96546 T334 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001/control-001/cores
   [junit4]   2> 96547 T334 oasc.CoreContainer.<init> New CoreContainer 508862554
   [junit4]   2> 96547 T334 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001/control-001/]
   [junit4]   2> 96547 T334 oasc.CoreContainer.load loading shared library: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001/control-001/lib
   [junit4]   2> 96548 T334 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001/control-001/lib).
   [junit4]   2> 96562 T334 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 96563 T334 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 96563 T334 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 96563 T334 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 96563 T334 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
   [junit4]   2> 96564 T334 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 96564 T334 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 96565 T334 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 96565 T334 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 96566 T334 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 96566 T334 oashc.HttpShardHandlerFactory.getParameter Setting useRetries to: false
   [junit4]   2> 96570 T334 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 96573 T334 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 96574 T334 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 96574 T334 oasc.CoreContainer.load Node Name: 127.0.0.1
   [junit4]   2> 96575 T334 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:49241/solr
   [junit4]   2> 96575 T334 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 96575 T334 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 96578 T334 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 96585 T362 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@77be9965 name:ZooKeeperConnection Watcher:127.0.0.1:49241 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 96596 T334 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 96597 T334 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 96611 T334 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 96619 T365 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@13a942a1 name:ZooKeeperConnection Watcher:127.0.0.1:49241/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 96619 T334 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 96624 T334 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 96632 T334 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 96640 T334 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
   [junit4]   2> 96649 T334 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
   [junit4]   2> 96658 T334 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
   [junit4]   2> 96668 T334 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 96673 T334 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49245_
   [junit4]   2> 96674 T334 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49245_
   [junit4]   2> 96681 T334 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 96686 T334 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 96691 T334 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 96701 T334 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:49245_
   [junit4]   2> 96702 T334 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 96705 T334 oasc.Overseer.start Overseer (id=93415200914800644-127.0.0.1:49245_-n_0000000000) starting
   [junit4]   2> 96717 T334 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 96746 T334 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 96749 T367 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 96755 T366 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 96759 T334 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 96771 T334 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 96776 T334 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 96787 T334 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001/control-001/cores
   [junit4]   2> 96789 T334 oasc.CorePropertiesLocator.discoverUnder Found core collection1 in /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001/control-001/cores/collection1/
   [junit4]   2> 96789 T334 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 96794 T369 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
   [junit4]   2> 96795 T369 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 96797 T369 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 96799 T366 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"https://127.0.0.1:49245",
   [junit4]   2> 	  "node_name":"127.0.0.1:49245_",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "operation":"state"} current state version: 0
   [junit4]   2> 96801 T366 oasco.ReplicaMutator.updateState Update state numShards=1 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"https://127.0.0.1:49245",
   [junit4]   2> 	  "node_name":"127.0.0.1:49245_",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 96802 T366 oasco.ClusterStateMutator.createCollection building a new cName: control_collection
   [junit4]   2> 96803 T366 oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 96805 T365 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 96829 T370 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 97802 T369 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 97803 T369 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
   [junit4]   2> 97805 T369 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 97805 T369 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 97807 T369 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 97808 T369 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001/control-001/cores/collection1/'
   [junit4]   2> 97828 T369 oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
   [junit4]   2> 97833 T369 oasc.Config.<init> loaded config solrconfig.xml with version 0 
   [junit4]   2> 97854 T369 oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
   [junit4]   2> 97856 T369 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 97876 T369 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 97877 T369 oass.ManagedIndexSchemaFactory.create The schema is configured as managed, but managed schema resource managed-schema not found - loading non-managed schema schema.xml instead
   [junit4]   2> 97880 T369 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 97888 T369 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 98060 T369 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 98066 T369 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 98067 T369 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 98133 T369 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 98138 T369 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 98144 T369 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 98146 T369 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 98146 T369 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 98147 T369 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 98148 T369 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 98149 T369 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 98160 T369 oass.ManagedIndexSchema.persistManagedSchemaToZooKeeper Created and persisted managed schema znode at /configs/conf1/managed-schema
   [junit4]   2> 98163 T369 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml.bak
   [junit4]   2> 98175 T369 oass.ManagedIndexSchemaFactory.zkUgradeToManagedSchema After upgrading to managed schema in ZooKeeper, renamed the non-managed schema /configs/conf1/schema.xml to /configs/conf1/schema.xml.bak
   [junit4]   2> 98176 T369 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 98176 T369 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
   [junit4]   2> 98177 T369 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001/control-001/cores/collection1/, dataDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001/control-001/cores/collection1/data/
   [junit4]   2> 98177 T369 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
   [junit4]   2> 98178 T369 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001/control-001/cores/collection1/data
   [junit4]   2> 98179 T369 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001/control-001/cores/collection1/data/index/
   [junit4]   2> 98179 T369 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 98180 T369 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001/control-001/cores/collection1/data/index
   [junit4]   2> 98180 T369 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=45, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 98186 T369 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=NRTCachingDirectory(MMapDirectory@/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001/control-001/cores/collection1/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@28e0b9c3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
   [junit4]   2> 98186 T369 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 98188 T369 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 98188 T369 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 98188 T369 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 98189 T369 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 98189 T369 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 98190 T369 oasc.RequestHandlers.initHandlersFromConfig created /config: org.apache.solr.handler.SolrConfigHandler
   [junit4]   2> 98191 T369 oasc.RequestHandlers.initHandlersFromConfig created /schema: org.apache.solr.handler.SchemaHandler
   [junit4]   2> 98191 T369 oasc.RequestHandlers.initHandlersFromConfig created /replication: org.apache.solr.handler.ReplicationHandler
   [junit4]   2> 98191 T369 oasc.RequestHandlers.initHandlersFromConfig created /get: org.apache.solr.handler.RealTimeGetHandler
   [junit4]   2> 98192 T369 oasc.RequestHandlers.initHandlersFromConfig created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
   [junit4]   2> 98193 T369 oasc.RequestHandlers.initHandlersFromConfig created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
   [junit4]   2> 98193 T369 oasc.RequestHandlers.initHandlersFromConfig created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
   [junit4]   2> 98193 T369 oasc.RequestHandlers.initHandlersFromConfig created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
   [junit4]   2> 98194 T369 oasc.RequestHandlers.initHandlersFromConfig created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
   [junit4]   2> 98194 T369 oasc.RequestHandlers.initHandlersFromConfig created /admin/properties: org.apache.solr.handler.admin.PropertiesRequestHandler
   [junit4]   2> 98194 T369 oasc.RequestHandlers.initHandlersFromConfig created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
   [junit4]   2> 98195 T369 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: org.apache.solr.handler.admin.ShowFileRequestHandler
   [junit4]   2> 98196 T369 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: org.apache.solr.handler.PingRequestHandler
   [junit4]   2> 98196 T369 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 98196 T369 oasc.RequestHandlers.initHandlersFromConfig created /dump: DumpRequestHandler
   [junit4]   2> 98205 T369 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 98206 T369 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 98208 T369 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 98210 T369 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 98210 T369 oasc.RequestHandlers.applyInitParams WARN INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}}
   [junit4]   2> 98211 T369 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 98212 T369 oasu.UpdateHandler.<init> Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 98213 T369 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 98214 T369 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 98214 T369 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=16, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7654460900599452]
   [junit4]   2> 98216 T369 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=NRTCachingDirectory(MMapDirectory@/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001/control-001/cores/collection1/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@28e0b9c3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
   [junit4]   2> 98217 T369 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 98217 T369 oass.SolrIndexSearcher.<init> Opening Searcher@4174d7f5[collection1] main
   [junit4]   2> 98217 T369 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 98220 T369 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 98220 T369 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 98221 T369 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 98221 T369 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 98222 T369 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 98223 T369 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 98224 T369 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 98224 T369 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 98230 T369 oass.ZkIndexSchemaReader.createSchemaWatcher Creating ZooKeeper watch for the managed schema at /configs/conf1/managed-schema
   [junit4]   2> 98234 T369 oash.ReplicationHandler.inform Commits will be reserved for  10000
   [junit4]   2> 98235 T371 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4174d7f5[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 98236 T369 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 98237 T374 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:49245 collection:control_collection shard:shard1
   [junit4]   2> 98239 T334 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
   [junit4]   2> 98239 T334 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 98241 T374 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 98248 T334 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 98253 T334 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 98265 T377 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@17391a10 name:ZooKeeperConnection Watcher:127.0.0.1:49241/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 98266 T334 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 98267 T334 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 98270 T374 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 98272 T334 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 98276 T370 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 98278 T374 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 98278 T374 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C160 name=collection1 org.apache.solr.core.SolrCore@4058a5e3 url=https://127.0.0.1:49245/collection1 node=127.0.0.1:49245_ C160_STATE=coll:control_collection core:collection1 props:{core=collection1, base_url=https://127.0.0.1:49245, node_name=127.0.0.1:49245_, state=down}
   [junit4]   2> 98279 T374 C160 P49245 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:49245/collection1/
   [junit4]   2> 98280 T374 C160 P49245 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 98281 T374 C160 P49245 oasc.SyncStrategy.syncToMe https://127.0.0.1:49245/collection1/ has no replicas
   [junit4]   2> 98281 T374 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:49245/collection1/ shard1
   [junit4]   2> 98281 T374 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 98283 T366 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"leader",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection"} current state version: 1
   [junit4]   2> 98285 T334 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 98286 T334 oasc.AbstractFullDistribZkTestBase.createJettys Creating collection1 with stateFormat=2
   [junit4]   2> 98286 T334 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 98288 T334 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 98293 T380 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6e77a716 name:ZooKeeperConnection Watcher:127.0.0.1:49241/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 98293 T334 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 98295 T334 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 98304 T336 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14be0a15b260006, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 98306 T370 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 98322 T366 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"create",
   [junit4]   2> 	  "name":"collection1",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "stateFormat":"2"} current state version: 1
   [junit4]   2> 98322 T366 oasco.ClusterStateMutator.createCollection building a new cName: collection1
   [junit4]   2> 98324 T377 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 98324 T370 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 98395 T366 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"leader",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:49245",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "state":"active"} current state version: 2
   [junit4]   2> 98398 T366 oasco.ZkStateWriter.writePendingUpdates going to create_collection /collections/collection1/state.json
   [junit4]   2> 98411 T377 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 98412 T370 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 98458 T370 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 98573 T377 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 98574 T370 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 98606 T374 oasc.ZkController.register We are https://127.0.0.1:49245/collection1/ and leader is https://127.0.0.1:49245/collection1/
   [junit4]   2> 98607 T374 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:49245
   [junit4]   2> 98607 T374 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 98607 T374 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
   [junit4]   2> 98607 T374 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 98620 T370 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 98625 T366 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"https://127.0.0.1:49245",
   [junit4]   2> 	  "node_name":"127.0.0.1:49245_",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "operation":"state"} current state version: 4
   [junit4]   2> 98630 T366 oasco.ReplicaMutator.updateState Update state numShards=4 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"https://127.0.0.1:49245",
   [junit4]   2> 	  "node_name":"127.0.0.1:49245_",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 98753 T377 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 98753 T370 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 100123 T334 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001/shard-1-001/cores/collection1
   [junit4]   2> 100125 T334 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
   [junit4]   2> 100128 T334 oejs.Server.doStart jetty-9.2.6.v20141205
   [junit4]   2> 100135 T334 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@4e6ee984{/,null,AVAILABLE}
   [junit4]   2> 100145 T334 oejs.AbstractConnector.doStart Started ServerConnector@5a26e793{SSL-http/1.1}{127.0.0.1:49250}
   [junit4]   2> 100146 T334 oejs.Server.doStart Started @103192ms
   [junit4]   2> 100153 T334 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@4554617c
   [junit4]   2> 100155 T334 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 100156 T334 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001/shard-1-001
   [junit4]   2> 100156 T334 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001/shard-1-001/'
   [junit4]   2> 100212 T334 oasc.SolrXmlConfig.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001/shard-1-001/solr.xml
   [junit4]   2> 100239 T334 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001/shard-1-001/cores
   [junit4]   2> 100240 T334 oasc.CoreContainer.<init> New CoreContainer 1162110588
   [junit4]   2> 100240 T334 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001/shard-1-001/]
   [junit4]   2> 100240 T334 oasc.CoreContainer.load loading shared library: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001/shard-1-001/lib
   [junit4]   2> 100241 T334 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001/shard-1-001/lib).
   [junit4]   2> 100253 T334 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 100254 T334 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 100254 T334 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 100254 T334 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 100255 T334 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
   [junit4]   2> 100255 T334 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 100256 T334 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 100256 T334 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 100257 T334 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 100257 T334 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 100258 T334 oashc.HttpShardHandlerFactory.getParameter Setting useRetries to: false
   [junit4]   2> 100260 T334 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 100263 T334 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 100264 T334 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 100264 T334 oasc.CoreContainer.load Node Name: 127.0.0.1
   [junit4]   2> 100264 T334 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:49241/solr
   [junit4]   2> 100264 T334 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 100265 T334 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 100267 T334 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 100274 T394 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2823ee77 name:ZooKeeperConnection Watcher:127.0.0.1:49241 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 100276 T334 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 100277 T334 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 100291 T334 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 100294 T397 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@78bc3c4 name:ZooKeeperConnection Watcher:127.0.0.1:49241/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 100295 T334 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 100322 T334 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 101344 T334 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49250_
   [junit4]   2> 101346 T334 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49250_
   [junit4]   2> 101359 T334 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 101366 T334 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001/shard-1-001/cores
   [junit4]   2> 101368 T334 oasc.CorePropertiesLocator.discoverUnder Found core collection1 in /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001/shard-1-001/cores/collection1/
   [junit4]   2> 101369 T334 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 101380 T398 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 101381 T398 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 101385 T370 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 101386 T398 oasc.ZkController.preRegister Registering watch for external collection collection1
   [junit4]   2> 101387 T398 oascc.ZkStateReader.addZkWatch addZkWatch collection1
   [junit4]   2> 101388 T398 oascc.ZkStateReader.addZkWatch Updating collection state at /collections/collection1/state.json from ZooKeeper... 
   [junit4]   2> 101389 T366 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"https://127.0.0.1:49250",
   [junit4]   2> 	  "node_name":"127.0.0.1:49250_",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"} current state version: 5
   [junit4]   2> 101392 T366 oasco.ReplicaMutator.updateState Update state numShards=4 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"https://127.0.0.1:49250",
   [junit4]   2> 	  "node_name":"127.0.0.1:49250_",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 101392 T366 oasco.ReplicaMutator.updateState Collection already exists with numShards=4
   [junit4]   2> 101393 T366 oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard2
   [junit4]   2> 101401 T366 oasco.ZkStateWriter.writePendingUpdates going to update_collection /collections/collection1/state.json version: 0
   [junit4]   2> 101407 T397 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json for collection collection1 has occurred - updating... (live nodes size: 2)
   [junit4]   2> 101409 T398 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 0 
   [junit4]   2> 101409 T398 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 101422 T397 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 1 
   [junit4]   2> 102416 T398 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 102417 T398 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 102419 T398 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 102420 T398 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 102424 T398 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 102424 T398 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001/shard-1-001/cores/collection1/'
   [junit4]   2> 102453 T398 oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
   [junit4]   2> 102458 T398 oasc.Config.<init> loaded config solrconfig.xml with version 0 
   [junit4]   2> 102473 T398 oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
   [junit4]   2> 102476 T398 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 102494 T398 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 102500 T398 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/managed-schema
   [junit4]   2> 102511 T398 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 102763 T398 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 102801 T398 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 102802 T398 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 102843 T398 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 102861 T398 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 102925 T398 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 102927 T398 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 102928 T398 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 102928 T398 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 102932 T398 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 102933 T398 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 102946 T398 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 102946 T398 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
   [junit4]   2> 102947 T398 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001/shard-1-001/cores/collection1/, dataDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001/shard-1-001/cores/collection1/data/
   [junit4]   2> 102947 T398 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
   [junit4]   2> 102948 T398 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001/shard-1-001/cores/collection1/data
   [junit4]   2> 102950 T398 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001/shard-1-001/cores/collection1/data/index/
   [junit4]   2> 102951 T398 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001/shard-1-001/cores/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 102953 T398 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001/shard-1-001/cores/collection1/data/index
   [junit4]   2> 102953 T398 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=45, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 102967 T398 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=NRTCachingDirectory(MMapDirectory@/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001/shard-1-001/cores/collection1/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3a3a7fd8; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
   [junit4]   2> 102967 T398 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 102970 T398 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 102972 T398 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 102973 T398 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 102973 T398 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 102974 T398 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 102978 T398 oasc.RequestHandlers.initHandlersFromConfig created /config: org.apache.solr.handler.SolrConfigHandler
   [junit4]   2> 102978 T398 oasc.RequestHandlers.initHandlersFromConfig created /schema: org.apache.solr.handler.SchemaHandler
   [junit4]   2> 102979 T398 oasc.RequestHandlers.initHandlersFromConfig created /replication: org.apache.solr.handler.ReplicationHandler
   [junit4]   2> 102980 T398 oasc.RequestHandlers.initHandlersFromConfig created /get: org.apache.solr.handler.RealTimeGetHandler
   [junit4]   2> 102980 T398 oasc.RequestHandlers.initHandlersFromConfig created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
   [junit4]   2> 102982 T398 oasc.RequestHandlers.initHandlersFromConfig created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
   [junit4]   2> 102983 T398 oasc.RequestHandlers.initHandlersFromConfig created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
   [junit4]   2> 102983 T398 oasc.RequestHandlers.initHandlersFromConfig created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
   [junit4]   2> 102984 T398 oasc.RequestHandlers.initHandlersFromConfig created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
   [junit4]   2> 102984 T398 oasc.RequestHandlers.initHandlersFromConfig created /admin/properties: org.apache.solr.handler.admin.PropertiesRequestHandler
   [junit4]   2> 102985 T398 oasc.RequestHandlers.initHandlersFromConfig created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
   [junit4]   2> 102986 T398 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: org.apache.solr.handler.admin.ShowFileRequestHandler
   [junit4]   2> 102986 T398 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: org.apache.solr.handler.PingRequestHandler
   [junit4]   2> 102987 T398 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 102987 T398 oasc.RequestHandlers.initHandlersFromConfig created /dump: DumpRequestHandler
   [junit4]   2> 103008 T398 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 103010 T398 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 103012 T398 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 103013 T398 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 103013 T398 oasc.RequestHandlers.applyInitParams WARN INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}}
   [junit4]   2> 103014 T398 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 103017 T398 oasu.UpdateHandler.<init> Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 103018 T398 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 103018 T398 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 103019 T398 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=16, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7654460900599452]
   [junit4]   2> 103129 T398 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=NRTCachingDirectory(MMapDirectory@/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001/shard-1-001/cores/collection1/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3a3a7fd8; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
   [junit4]   2> 103129 T398 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 103130 T398 oass.SolrIndexSearcher.<init> Opening Searcher@5756afde[collection1] main
   [junit4]   2> 103135 T398 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 103148 T398 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 103148 T398 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 103151 T398 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 103151 T398 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 103151 T398 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 103152 T398 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 103153 T398 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 103153 T398 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 103153 T398 oass.ZkIndexSchemaReader.createSchemaWatcher Creating ZooKeeper watch for the managed schema at /configs/conf1/managed-schema
   [junit4]   2> 103155 T398 oash.ReplicationHandler.inform Commits will be reserved for  10000
   [junit4]   2> 103155 T399 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5756afde[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 103155 T398 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 103158 T402 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:49250 collection:collection1 shard:shard2
   [junit4]   2> 103160 T334 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
   [junit4]   2> 103160 T334 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 103161 T402 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
   [junit4]   2> 103176 T402 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
   [junit4]   2> 103181 T402 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 103181 T402 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C161 name=collection1 org.apache.solr.core.SolrCore@44cea52a url=https://127.0.0.1:49250/collection1 node=127.0.0.1:49250_ C161_STATE=coll:collection1 core:collection1 props:{core=collection1, base_url=https://127.0.0.1:49250, node_name=127.0.0.1:49250_, state=down}
   [junit4]   2> 103181 T402 C161 P49250 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:49250/collection1/
   [junit4]   2> 103182 T402 C161 P49250 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 103182 T402 C161 P49250 oasc.SyncStrategy.syncToMe https://127.0.0.1:49250/collection1/ has no replicas
   [junit4]   2> 103182 T402 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:49250/collection1/ shard2
   [junit4]   2> 103183 T402 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
   [junit4]   2> 103184 T370 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 103191 T366 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"leader",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"collection1"} current state version: 5
   [junit4]   2> 103206 T366 oasco.ZkStateWriter.writePendingUpdates going to update_collection /collections/collection1/state.json version: 1
   [junit4]   2> 103216 T397 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json for collection collection1 has occurred - updating... (live nodes size: 2)
   [junit4]   2> 103228 T397 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 2 
   [junit4]   2> 103252 T366 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"leader",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:49250",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "state":"active"} current state version: 5
   [junit4]   2> 103255 T366 oasco.ZkStateWriter.writePendingUpdates going to update_collection /collections/collection1/state.json version: 2
   [junit4]   2> 103263 T397 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json for collection collection1 has occurred - updating... (live nodes size: 2)
   [junit4]   2> 103270 T397 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 3 
   [junit4]   2> 103274 T370 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 103303 T402 oasc.ZkController.register We are https://127.0.0.1:49250/collection1/ and leader is https://127.0.0.1:49250/collection1/
   [junit4]   2> 103303 T402 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:49250
   [junit4]   2> 103304 T402 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 103304 T402 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
   [junit4]   2> 103304 T402 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 103309 T370 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 103313 T366 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"https://127.0.0.1:49250",
   [junit4]   2> 	  "node_name":"127.0.0.1:49250_",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"} current state version: 5
   [junit4]   2> 103318 T366 oasco.ReplicaMutator.updateState Update state numShards=4 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"https://127.0.0.1:49250",
   [junit4]   2> 	  "node_name":"127.0.0.1:49250_",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 103329 T366 oasco.ZkStateWriter.writePendingUpdates going to update_collection /collections/collection1/state.json version: 3
   [junit4]   2> 103341 T402 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 4 
   [junit4]   2> 103341 T397 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json for collection collection1 has occurred - updating... (live nodes size: 2)
   [junit4]   2> 103345 T397 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 4 
   [junit4]   2> 104899 T334 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001/shard-2-001/cores/collection1
   [junit4]   2> 104902 T334 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
   [junit4]   2> 104904 T334 oejs.Server.doStart jetty-9.2.6.v20141205
   [junit4]   2> 104911 T334 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@670a6a6c{/,null,AVAILABLE}
   [junit4]   2> 104918 T334 oejs.AbstractConnector.doStart Started ServerConnector@148eab89{SSL-http/1.1}{127.0.0.1:49253}
   [junit4]   2> 104919 T334 oejs.Server.doStart Started @107962ms
   [junit4]   2> 104928 T334 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@4554617c
   [junit4]   2> 104929 T334 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 104929 T334 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001/shard-2-001
   [junit4]   2> 104930 T334 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001/shard-2-001/'
   [junit4]   2> 104973 T334 oasc.SolrXmlConfig.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001/shard-2-001/solr.xml
   [junit4]   2> 104996 T334 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001/shard-2-001/cores
   [junit4]   2> 104997 T334 oasc.CoreContainer.<init> New CoreContainer 1294807565
   [junit4]   2> 104997 T334 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001/shard-2-001/]
   [junit4]   2> 104997 T334 oasc.CoreContainer.load loading shared library: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001/shard-2-001/lib
   [junit4]   2> 104998 T334 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001/shard-2-001/lib).
   [junit4]   2> 105015 T334 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 105015 T334 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 105015 T334 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 105016 T334 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 105017 T334 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
   [junit4]   2> 105017 T334 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 105017 T334 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 105018 T334 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 105018 T334 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 105018 T334 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 105018 T334 oashc.HttpShardHandlerFactory.getParameter Setting useRetries to: false
   [junit4]   2> 105022 T334 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 105025 T334 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 105025 T334 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 105026 T334 oasc.CoreContainer.load Node Name: 127.0.0.1
   [junit4]   2> 105026 T334 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:49241/solr
   [junit4]   2> 105027 T334 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 105027 T334 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 105031 T334 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 105035 T416 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2dd59745 name:ZooKeeperConnection Watcher:127.0.0.1:49241 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 105036 T334 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 105036 T334 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 105042 T334 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 105046 T419 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@703faa09 name:ZooKeeperConnection Watcher:127.0.0.1:49241/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 105047 T334 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 105066 T334 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 106081 T334 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49253_
   [junit4]   2> 106083 T334 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49253_
   [junit4]   2> 106095 T334 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 106103 T334 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001/shard-2-001/cores
   [junit4]   2> 106104 T334 oasc.CorePropertiesLocator.discoverUnder Found core collection1 in /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001/shard-2-001/cores/collection1/
   [junit4]   2> 106105 T334 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 106113 T420 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 106113 T420 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 106117 T370 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 106121 T366 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"https://127.0.0.1:49253",
   [junit4]   2> 	  "node_name":"127.0.0.1:49253_",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"} current state version: 5
   [junit4]   2> 106125 T366 oasco.ReplicaMutator.updateState Update state numShards=4 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"https://127.0.0.1:49253",
   [junit4]   2> 	  "node_name":"127.0.0.1:49253_",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 106125 T366 oasco.ReplicaMutator.updateState Collection already exists with numShards=4
   [junit4]   2> 106126 T366 oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard3
   [junit4]   2> 106130 T420 oasc.ZkController.preRegister Registering watch for external collection collection1
   [junit4]   2> 106130 T420 oascc.ZkStateReader.addZkWatch addZkWatch collection1
   [junit4]   2> 106131 T420 oascc.ZkStateReader.addZkWatch Updating collection state at /collections/collection1/state.json from ZooKeeper... 
   [junit4]   2> 106134 T420 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 4 
   [junit4]   2> 106135 T420 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 106136 T366 oasco.ZkStateWriter.writePendingUpdates going to update_collection /collections/collection1/state.json version: 4
   [junit4]   2> 106138 T419 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json for collection collection1 has occurred - updating... (live nodes size: 3)
   [junit4]   2> 106140 T419 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 5 
   [junit4]   2> 106141 T397 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json for collection collection1 has occurred - updating... (live nodes size: 3)
   [junit4]   2> 106148 T397 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 5 
   [junit4]   2> 107136 T420 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 107137 T420 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 107140 T420 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 107140 T420 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 107147 T420 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 107148 T420 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001/shard-2-001/cores/collection1/'
   [junit4]   2> 107178 T420 oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
   [junit4]   2> 107183 T420 oasc.Config.<init> loaded config solrconfig.xml with version 0 
   [junit4]   2> 107199 T420 oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
   [junit4]   2> 107210 T420 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 107228 T420 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 107231 T420 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/managed-schema
   [junit4]   2> 107245 T420 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 107502 T420 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 107517 T420 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 107520 T420 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 107532 T420 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 107544 T420 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 107568 T420 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 107570 T420 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 107576 T420 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 107576 T420 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 107580 T420 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 107580 T420 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 107588 T420 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 107589 T420 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
   [junit4]   2> 107590 T420 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001/shard-2-001/cores/collection1/, dataDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001/shard-2-001/cores/collection1/data/
   [junit4]   2> 107591 T420 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
   [junit4]   2> 107592 T420 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001/shard-2-001/cores/collection1/data
   [junit4]   2> 107592 T420 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001/shard-2-001/cores/collection1/data/index/
   [junit4]   2> 107598 T420 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001/shard-2-001/cores/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 107600 T420 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001/shard-2-001/cores/collection1/data/index
   [junit4]   2> 107600 T420 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=45, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 107607 T420 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=NRTCachingDirectory(MMapDirectory@/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.T

[...truncated too long message...]

it4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 619262 T2249 oasco.ZkStateWriter.writePendingUpdates going to update_collection /collections/collection1/state.json version: 52
   [junit4]   2> 619270 T334 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 619270 T334 oasc.CachingDirectoryFactory.close Closing NRTCachingDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 619270 T334 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001/shard-8-001/cores/collection1/data [CachedDir<<refCount=0;path=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001/shard-8-001/cores/collection1/data;done=false>>]
   [junit4]   2> 619270 T334 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001/shard-8-001/cores/collection1/data
   [junit4]   2> 619271 T334 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001/shard-8-001/cores/collection1/data/index [CachedDir<<refCount=0;path=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001/shard-8-001/cores/collection1/data/index;done=false>>]
   [junit4]   2> 619271 T334 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001/shard-8-001/cores/collection1/data/index
   [junit4]   2> 619272 T334 oasc.Overseer.close Overseer (id=93415200914800662-127.0.0.1:49279_-n_0000000008) closing
   [junit4]   2> 619274 T2216 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json for collection collection1 has occurred - updating... (live nodes size: 1)
   [junit4]   2> 619278 T2249 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:49279_
   [junit4]   2> 619281 T2216 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 53 
   [junit4]   2> 619282 T336 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14be0a15b260016, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 619282 T2174 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 619285 T334 oejs.AbstractConnector.doStop Stopped ServerConnector@4b9833e9{SSL-http/1.1}{127.0.0.1:0}
   [junit4]   2> 619288 T334 oejsh.ContextHandler.doStop Stopped o.e.j.s.ServletContextHandler@47bf2f5{/,null,UNAVAILABLE}
   [junit4]   2> 619292 T334 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:49241 49241
   [junit4]   2> 619322 T335 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:49241 49241
   [junit4]   2> 619525 T335 oasc.ZkTestServer$ZKServerMain.runFromConfig WARN Watch limit violations: 
   [junit4]   2> 	Maximum concurrent create/delete watches above limit:
   [junit4]   2> 	
   [junit4]   2> 		11	/solr/aliases.json
   [junit4]   2> 		11	/solr/clusterstate.json
   [junit4]   2> 		10	/solr/configs/conf1/managed-schema
   [junit4]   2> 		9	/solr/collections/collection1/state.json
   [junit4]   2> 		9	/solr/configs/conf1
   [junit4]   2> 	
   [junit4]   2> 	Maximum concurrent data watches above limit:
   [junit4]   2> 	
   [junit4]   2> 		2	/solr/overseer_elect/election/93415200914800644-127.0.0.1:49245_-n_0000000000
   [junit4]   2> 	
   [junit4]   2> 	Maximum concurrent children watches above limit:
   [junit4]   2> 	
   [junit4]   2> 		11	/solr/live_nodes
   [junit4]   2> 		8	/solr/overseer/collection-queue-work
   [junit4]   2> 		3	/solr/overseer/queue
   [junit4]   2> 	
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestCloudManagedSchemaConcurrent -Dtests.method=test -Dtests.seed=C2FC830A1FEAECC9 -Dtests.slow=true -Dtests.locale=en_MT -Dtests.timezone=America/Shiprock -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] ERROR    525s | TestCloudManagedSchemaConcurrent.test <<<
   [junit4]    > Throwable #1: org.apache.http.NoHttpResponseException: The target server failed to respond
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([C2FC830A1FEAECC9:4AA8BCD0B1168131]:0)
   [junit4]    > 	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:143)
   [junit4]    > 	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
   [junit4]    > 	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:260)
   [junit4]    > 	at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
   [junit4]    > 	at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
   [junit4]    > 	at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
   [junit4]    > 	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:271)
   [junit4]    > 	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:123)
   [junit4]    > 	at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:682)
   [junit4]    > 	at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:486)
   [junit4]    > 	at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:863)
   [junit4]    > 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
   [junit4]    > 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:106)
   [junit4]    > 	at org.apache.solr.util.RestTestHarness.getResponse(RestTestHarness.java:208)
   [junit4]    > 	at org.apache.solr.util.RestTestHarness.query(RestTestHarness.java:100)
   [junit4]    > 	at org.apache.solr.schema.TestCloudManagedSchemaConcurrent.schemaLockTest(TestCloudManagedSchemaConcurrent.java:677)
   [junit4]    > 	at org.apache.solr.schema.TestCloudManagedSchemaConcurrent.test(TestCloudManagedSchemaConcurrent.java:253)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:950)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:925)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 619608 T334 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent C2FC830A1FEAECC9-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene50), sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=en_MT, timezone=America/Shiprock
   [junit4]   2> NOTE: Mac OS X 10.8.5 x86_64/Oracle Corporation 1.8.0_31 (64-bit)/cpus=2,threads=1,free=49609688,total=162582528
   [junit4]   2> NOTE: All tests run in this JVM: [TestSearcherReuse, TestConfigReload, TestRawResponseWriter, DirectSolrSpellCheckerTest, TestLMJelinekMercerSimilarityFactory, TestMergePolicyConfig, WordBreakSolrSpellCheckerTest, DistributedFacetPivotWhiteBoxTest, SpellCheckCollatorTest, TestSolrQueryParserResource, HdfsDirectoryTest, TestBM25SimilarityFactory, TestCloudManagedSchemaConcurrent]
   [junit4] Completed in 525.11s, 1 test, 1 error <<< FAILURES!

[...truncated 1412 lines...]
BUILD FAILED
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:519: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:467: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:61: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/extra-targets.xml:39: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build.xml:191: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/common-build.xml:510: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:1351: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:958: There were test failures: 469 suites, 1869 tests, 1 error, 53 ignored (20 assumptions)

Total time: 132 minutes 45 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any