You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2015/05/13 03:17:40 UTC
[JENKINS] Lucene-Solr-Tests-5.x-Java7 - Build # 3108 - Failure
Build: https://builds.apache.org/job/Lucene-Solr-Tests-5.x-Java7/3108/
1 tests failed.
REGRESSION: org.apache.solr.cloud.RecoveryZkTest.test
Error Message:
shard1 is not consistent. Got 961 from http://127.0.0.1:44749/mun/x/collection1lastClient and got 247 from http://127.0.0.1:44752/mun/x/collection1
Stack Trace:
java.lang.AssertionError: shard1 is not consistent. Got 961 from http://127.0.0.1:44749/mun/x/collection1lastClient and got 247 from http://127.0.0.1:44752/mun/x/collection1
at __randomizedtesting.SeedInfo.seed([615D83292E4106AA:E909BCF380BD6B52]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.RecoveryZkTest.test(RecoveryZkTest.java:123)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:960)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:935)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 9849 lines...]
[junit4] Suite: org.apache.solr.cloud.RecoveryZkTest
[junit4] 2> Creating dataDir: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/init-core-data-001
[junit4] 2> 480155 T2948 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (false)
[junit4] 2> 480155 T2948 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /mun/x
[junit4] 2> 480162 T2948 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 480162 T2949 oasc.ZkTestServer$2$1.setClientPort client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 480163 T2949 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 480262 T2948 oasc.ZkTestServer.run start zk server on port:44739
[junit4] 2> 480263 T2948 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 480264 T2948 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 480268 T2956 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@180ac0bd name:ZooKeeperConnection Watcher:127.0.0.1:44739 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 480268 T2948 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 480269 T2948 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 480269 T2948 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 480272 T2948 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 480273 T2948 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 480274 T2959 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@55793be8 name:ZooKeeperConnection Watcher:127.0.0.1:44739/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 480275 T2948 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 480275 T2948 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 480275 T2948 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 480278 T2948 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 480279 T2948 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 480280 T2948 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 480282 T2948 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 480283 T2948 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 480285 T2948 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 480286 T2948 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 480389 T2948 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 480389 T2948 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 480391 T2948 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 480392 T2948 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 480393 T2948 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 480394 T2948 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 480396 T2948 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 480396 T2948 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 480398 T2948 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 480398 T2948 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 480400 T2948 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 480401 T2948 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 480402 T2948 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 480403 T2948 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 480405 T2948 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 480405 T2948 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 480407 T2948 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 480407 T2948 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 481730 T2948 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/control-001/cores/collection1
[junit4] 2> 481734 T2948 oejs.Server.doStart jetty-9.2.10.v20150310
[junit4] 2> 481736 T2948 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@2ce73f8b{/mun/x,null,AVAILABLE}
[junit4] 2> 481739 T2948 oejs.AbstractConnector.doStart Started ServerConnector@7e325f17{HTTP/1.1}{127.0.0.1:44742}
[junit4] 2> 481739 T2948 oejs.Server.doStart Started @486529ms
[junit4] 2> 481739 T2948 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {coreRootDirectory=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/control-001/cores, hostContext=/mun/x, solr.data.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/tempDir-001/control/data, hostPort=44742}
[junit4] 2> 481740 T2948 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@57bd06bf
[junit4] 2> 481740 T2948 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/control-001/'
[junit4] 2> 481774 T2948 oasc.SolrXmlConfig.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/control-001/solr.xml
[junit4] 2> 481829 T2948 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/control-001/cores
[junit4] 2> 481829 T2948 oasc.CoreContainer.<init> New CoreContainer 204453325
[junit4] 2> 481830 T2948 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/control-001/]
[junit4] 2> 481830 T2948 oasc.CoreContainer.load loading shared library: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/control-001/lib
[junit4] 2> 481830 T2948 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/control-001/lib).
[junit4] 2> 481839 T2948 oashc.HttpShardHandlerFactory.init created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 481844 T2948 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 481845 T2948 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 481845 T2948 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 481846 T2948 oasc.CoreContainer.load Node Name: 127.0.0.1
[junit4] 2> 481846 T2948 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:44739/solr
[junit4] 2> 481847 T2948 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 481847 T2948 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 481848 T2948 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 481849 T2973 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@681b0ec4 name:ZooKeeperConnection Watcher:127.0.0.1:44739 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 481850 T2948 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 481851 T2948 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 481852 T2948 n:127.0.0.1:44742_mun%2Fx oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 481853 T2976 n:127.0.0.1:44742_mun%2Fx oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5bce1728 name:ZooKeeperConnection Watcher:127.0.0.1:44739/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 481854 T2948 n:127.0.0.1:44742_mun%2Fx oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 481855 T2948 n:127.0.0.1:44742_mun%2Fx oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 481856 T2948 n:127.0.0.1:44742_mun%2Fx oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 481857 T2948 n:127.0.0.1:44742_mun%2Fx oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 481859 T2948 n:127.0.0.1:44742_mun%2Fx oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 481860 T2948 n:127.0.0.1:44742_mun%2Fx oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 481862 T2948 n:127.0.0.1:44742_mun%2Fx oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 481863 T2948 n:127.0.0.1:44742_mun%2Fx oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 481863 T2948 n:127.0.0.1:44742_mun%2Fx oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 481864 T2948 n:127.0.0.1:44742_mun%2Fx oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44742_mun%2Fx
[junit4] 2> 481865 T2948 n:127.0.0.1:44742_mun%2Fx oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:44742_mun%2Fx
[junit4] 2> 481866 T2948 n:127.0.0.1:44742_mun%2Fx oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 481867 T2948 n:127.0.0.1:44742_mun%2Fx oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 481868 T2948 n:127.0.0.1:44742_mun%2Fx oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 481869 T2948 n:127.0.0.1:44742_mun%2Fx oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:44742_mun%2Fx
[junit4] 2> 481869 T2948 n:127.0.0.1:44742_mun%2Fx oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 481870 T2948 n:127.0.0.1:44742_mun%2Fx oasc.Overseer.start Overseer (id=93813235560087555-127.0.0.1:44742_mun%2Fx-n_0000000000) starting
[junit4] 2> 481871 T2948 n:127.0.0.1:44742_mun%2Fx oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 481875 T2948 n:127.0.0.1:44742_mun%2Fx oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 481876 T2978 n:127.0.0.1:44742_mun%2Fx oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 481876 T2977 n:127.0.0.1:44742_mun%2Fx oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 481876 T2948 n:127.0.0.1:44742_mun%2Fx oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 481879 T2948 n:127.0.0.1:44742_mun%2Fx oasc.CorePropertiesLocator.discover Looking for core definitions underneath /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/control-001/cores
[junit4] 2> 481880 T2948 n:127.0.0.1:44742_mun%2Fx oasc.CoreDescriptor.<init> CORE DESCRIPTOR: {coreNodeName=, loadOnStartup=true, transient=false, shard=, absoluteInstDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/control-001/cores/collection1/, config=solrconfig.xml, instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/control-001/cores/collection1, dataDir=data/, name=collection1, collection=control_collection, schema=schema.xml}
[junit4] 2> 481881 T2948 n:127.0.0.1:44742_mun%2Fx oasc.CorePropertiesLocator.discoverUnder Found core collection1 in /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/control-001/cores/collection1/
[junit4] 2> 481881 T2948 n:127.0.0.1:44742_mun%2Fx oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 481881 T2980 n:127.0.0.1:44742_mun%2Fx c:control_collection x:collection1 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
[junit4] 2> 481881 T2980 n:127.0.0.1:44742_mun%2Fx c:control_collection x:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 481882 T2980 n:127.0.0.1:44742_mun%2Fx oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 481882 T2976 n:127.0.0.1:44742_mun%2Fx oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 481883 T2977 n:127.0.0.1:44742_mun%2Fx oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://127.0.0.1:44742/mun/x",
[junit4] 2> "node_name":"127.0.0.1:44742_mun%2Fx",
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "shard":null} current state version: 0
[junit4] 2> 481883 T2977 n:127.0.0.1:44742_mun%2Fx oasco.ReplicaMutator.updateState Update state numShards=1 message={
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://127.0.0.1:44742/mun/x",
[junit4] 2> "node_name":"127.0.0.1:44742_mun%2Fx",
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "shard":null}
[junit4] 2> 481883 T2977 n:127.0.0.1:44742_mun%2Fx oasco.ClusterStateMutator.createCollection building a new cName: control_collection
[junit4] 2> 481883 T2977 n:127.0.0.1:44742_mun%2Fx oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard1
[junit4] 2> 481884 T2976 n:127.0.0.1:44742_mun%2Fx oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 482882 T2980 n:127.0.0.1:44742_mun%2Fx oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 482883 T2980 n:127.0.0.1:44742_mun%2Fx oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 482883 T2980 n:127.0.0.1:44742_mun%2Fx oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 482883 T2980 n:127.0.0.1:44742_mun%2Fx oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 482884 T2980 n:127.0.0.1:44742_mun%2Fx oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 482884 T2980 n:127.0.0.1:44742_mun%2Fx oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/control-001/cores/collection1/'
[junit4] 2> 482898 T2980 n:127.0.0.1:44742_mun%2Fx oasc.Config.<init> loaded config solrconfig.xml with version 0
[junit4] 2> 482905 T2980 n:127.0.0.1:44742_mun%2Fx oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
[junit4] 2> 482920 T2980 n:127.0.0.1:44742_mun%2Fx oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.2.0
[junit4] 2> 482952 T2980 n:127.0.0.1:44742_mun%2Fx oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 483054 T2980 n:127.0.0.1:44742_mun%2Fx oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 483060 T2980 n:127.0.0.1:44742_mun%2Fx oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 483296 T2980 n:127.0.0.1:44742_mun%2Fx oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 483298 T2980 n:127.0.0.1:44742_mun%2Fx oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 483300 T2980 n:127.0.0.1:44742_mun%2Fx oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 483303 T2980 n:127.0.0.1:44742_mun%2Fx oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 483317 T2980 n:127.0.0.1:44742_mun%2Fx oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 483317 T2980 n:127.0.0.1:44742_mun%2Fx x:collection1 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 483317 T2980 n:127.0.0.1:44742_mun%2Fx x:collection1 oasc.SolrCore.<init> [[collection1] ] Opening new SolrCore at [/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/control-001/cores/collection1/], dataDir=[null]
[junit4] 2> 483317 T2980 n:127.0.0.1:44742_mun%2Fx x:collection1 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@69fc0ce9
[junit4] 2> 483318 T2980 n:127.0.0.1:44742_mun%2Fx x:collection1 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/control-001/cores/collection1/data
[junit4] 2> 483318 T2980 n:127.0.0.1:44742_mun%2Fx x:collection1 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/control-001/cores/collection1/data/index/
[junit4] 2> 483318 T2980 n:127.0.0.1:44742_mun%2Fx x:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 483319 T2980 n:127.0.0.1:44742_mun%2Fx x:collection1 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/control-001/cores/collection1/data/index
[junit4] 2> 483319 T2980 n:127.0.0.1:44742_mun%2Fx x:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=40, maxMergeAtOnceExplicit=27, maxMergedSegmentMB=1.1806640625, floorSegmentMB=1.6025390625, forceMergeDeletesPctAllowed=15.892435850651601, segmentsPerTier=31.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 483320 T2980 n:127.0.0.1:44742_mun%2Fx x:collection1 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@3758cbb9 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@26a6fb12),segFN=segments_1,generation=1}
[junit4] 2> 483320 T2980 n:127.0.0.1:44742_mun%2Fx x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 483323 T2980 n:127.0.0.1:44742_mun%2Fx x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 483324 T2980 n:127.0.0.1:44742_mun%2Fx x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 483324 T2980 n:127.0.0.1:44742_mun%2Fx x:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 483324 T2980 n:127.0.0.1:44742_mun%2Fx x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 483324 T2980 n:127.0.0.1:44742_mun%2Fx x:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 483324 T2980 n:127.0.0.1:44742_mun%2Fx x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 483325 T2980 n:127.0.0.1:44742_mun%2Fx x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 483325 T2980 n:127.0.0.1:44742_mun%2Fx x:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 483325 T2980 n:127.0.0.1:44742_mun%2Fx x:collection1 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 483337 T2980 n:127.0.0.1:44742_mun%2Fx x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 483339 T2980 n:127.0.0.1:44742_mun%2Fx x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 483340 T2980 n:127.0.0.1:44742_mun%2Fx x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 483342 T2980 n:127.0.0.1:44742_mun%2Fx x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 483345 T2980 n:127.0.0.1:44742_mun%2Fx x:collection1 oasc.RequestHandlers.initHandlersFromConfig Registered paths: /admin/mbeans,/update/json/docs,/admin/ping,/update/csv,/admin/segments,/admin/file,/admin/logging,standard,/admin/threads,/update/json,/schema,/config,/admin/properties,/update,/admin/luke,/replication,/admin/system,/get,/admin/plugins
[junit4] 2> 483346 T2980 n:127.0.0.1:44742_mun%2Fx x:collection1 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 483348 T2980 n:127.0.0.1:44742_mun%2Fx x:collection1 oasu.UpdateHandler.<init> Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 483348 T2980 n:127.0.0.1:44742_mun%2Fx x:collection1 oasu.UpdateLog.init Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10
[junit4] 2> 483349 T2980 n:127.0.0.1:44742_mun%2Fx x:collection1 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 483349 T2980 n:127.0.0.1:44742_mun%2Fx x:collection1 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 483349 T2980 n:127.0.0.1:44742_mun%2Fx x:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=43, maxMergeAtOnceExplicit=36, maxMergedSegmentMB=76.06640625, floorSegmentMB=1.890625, forceMergeDeletesPctAllowed=23.82292746427449, segmentsPerTier=18.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4269513756894481
[junit4] 2> 483350 T2980 n:127.0.0.1:44742_mun%2Fx x:collection1 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@3758cbb9 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@26a6fb12),segFN=segments_1,generation=1}
[junit4] 2> 483350 T2980 n:127.0.0.1:44742_mun%2Fx x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 483350 T2980 n:127.0.0.1:44742_mun%2Fx x:collection1 oass.SolrIndexSearcher.<init> Opening Searcher@478baca6[collection1] main
[junit4] 2> 483351 T2980 n:127.0.0.1:44742_mun%2Fx x:collection1 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 483351 T2980 n:127.0.0.1:44742_mun%2Fx x:collection1 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 483351 T2980 n:127.0.0.1:44742_mun%2Fx x:collection1 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 483352 T2980 n:127.0.0.1:44742_mun%2Fx x:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 483352 T2980 n:127.0.0.1:44742_mun%2Fx x:collection1 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 483352 T2980 n:127.0.0.1:44742_mun%2Fx x:collection1 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 483352 T2980 n:127.0.0.1:44742_mun%2Fx x:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 483353 T2980 n:127.0.0.1:44742_mun%2Fx x:collection1 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 483353 T2980 n:127.0.0.1:44742_mun%2Fx x:collection1 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 483353 T2980 n:127.0.0.1:44742_mun%2Fx x:collection1 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 483353 T2980 n:127.0.0.1:44742_mun%2Fx x:collection1 oasc.ZkController.getConfDirListeners watch zkdir /configs/conf1
[junit4] 2> 483354 T2981 n:127.0.0.1:44742_mun%2Fx x:collection1 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@478baca6[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 483354 T2980 n:127.0.0.1:44742_mun%2Fx x:collection1 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 483355 T2984 n:127.0.0.1:44742_mun%2Fx c:control_collection s:shard1 x:collection1 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:44742/mun/x collection:control_collection shard:shard1
[junit4] 2> 483355 T2948 n:127.0.0.1:44742_mun%2Fx oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2
[junit4] 2> 483356 T2948 n:127.0.0.1:44742_mun%2Fx oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 483356 T2984 n:127.0.0.1:44742_mun%2Fx c:control_collection s:shard1 x:collection1 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 483358 T2948 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 483359 T2948 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 483360 T2984 n:127.0.0.1:44742_mun%2Fx c:control_collection s:shard1 x:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 483360 T2987 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@46ec3f32 name:ZooKeeperConnection Watcher:127.0.0.1:44739/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 483360 T2948 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 483361 T2948 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 483361 T2948 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 483361 T2976 n:127.0.0.1:44742_mun%2Fx oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 483361 T2984 n:127.0.0.1:44742_mun%2Fx c:control_collection s:shard1 x:collection1 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 483362 T2984 n:127.0.0.1:44742_mun%2Fx c:control_collection s:shard1 x:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C382 name=collection1 org.apache.solr.core.SolrCore@709fa526 url=http://127.0.0.1:44742/mun/x/collection1 node=127.0.0.1:44742_mun%2Fx C382_STATE=coll:control_collection core:collection1 props:{base_url=http://127.0.0.1:44742/mun/x, node_name=127.0.0.1:44742_mun%2Fx, state=down, core=collection1}
[junit4] 2> 483362 T2984 n:127.0.0.1:44742_mun%2Fx c:control_collection s:shard1 x:collection1 C382 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:44742/mun/x/collection1/
[junit4] 2> 483362 T2977 n:127.0.0.1:44742_mun%2Fx oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state version: 1
[junit4] 2> 483362 T2984 n:127.0.0.1:44742_mun%2Fx c:control_collection s:shard1 x:collection1 C382 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 483363 T2984 n:127.0.0.1:44742_mun%2Fx c:control_collection s:shard1 x:collection1 C382 oasc.SyncStrategy.syncToMe http://127.0.0.1:44742/mun/x/collection1/ has no replicas
[junit4] 2> 483363 T2984 n:127.0.0.1:44742_mun%2Fx c:control_collection s:shard1 x:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:44742/mun/x/collection1/ shard1
[junit4] 2> 483363 T2984 n:127.0.0.1:44742_mun%2Fx c:control_collection s:shard1 x:collection1 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 483363 T2948 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 483366 T2976 n:127.0.0.1:44742_mun%2Fx oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 483367 T2977 n:127.0.0.1:44742_mun%2Fx oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:44742/mun/x",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 1
[junit4] 2> 483471 T2987 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 483471 T2976 n:127.0.0.1:44742_mun%2Fx oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 483522 T2984 n:127.0.0.1:44742_mun%2Fx c:control_collection s:shard1 x:collection1 oasc.ZkController.register We are http://127.0.0.1:44742/mun/x/collection1/ and leader is http://127.0.0.1:44742/mun/x/collection1/
[junit4] 2> 483523 T2984 n:127.0.0.1:44742_mun%2Fx c:control_collection s:shard1 x:collection1 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:44742/mun/x
[junit4] 2> 483523 T2984 n:127.0.0.1:44742_mun%2Fx c:control_collection s:shard1 x:collection1 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 483523 T2984 n:127.0.0.1:44742_mun%2Fx c:control_collection s:shard1 x:collection1 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
[junit4] 2> 483523 T2984 n:127.0.0.1:44742_mun%2Fx c:control_collection s:shard1 x:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 483525 T2976 n:127.0.0.1:44742_mun%2Fx oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 483525 T2977 n:127.0.0.1:44742_mun%2Fx oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://127.0.0.1:44742/mun/x",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "node_name":"127.0.0.1:44742_mun%2Fx",
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "shard":"shard1"} current state version: 2
[junit4] 2> 483526 T2977 n:127.0.0.1:44742_mun%2Fx oasco.ReplicaMutator.updateState Update state numShards=1 message={
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://127.0.0.1:44742/mun/x",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "node_name":"127.0.0.1:44742_mun%2Fx",
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "shard":"shard1"}
[junit4] 2> 483629 T2976 n:127.0.0.1:44742_mun%2Fx oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 483629 T2987 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 484619 T2948 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/shard-1-001/cores/collection1
[junit4] 2> 484622 T2948 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1 in directory /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/shard-1-001
[junit4] 2> 484623 T2948 oejs.Server.doStart jetty-9.2.10.v20150310
[junit4] 2> 484625 T2948 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@38e9c8ce{/mun/x,null,AVAILABLE}
[junit4] 2> 484626 T2948 oejs.AbstractConnector.doStart Started ServerConnector@4f453018{HTTP/1.1}{127.0.0.1:44749}
[junit4] 2> 484626 T2948 oejs.Server.doStart Started @489416ms
[junit4] 2> 484626 T2948 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {solrconfig=solrconfig.xml, hostContext=/mun/x, solr.data.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/tempDir-001/jetty1, hostPort=44749, coreRootDirectory=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/shard-1-001/cores}
[junit4] 2> 484627 T2948 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@57bd06bf
[junit4] 2> 484627 T2948 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/shard-1-001/'
[junit4] 2> 484657 T2948 oasc.SolrXmlConfig.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/shard-1-001/solr.xml
[junit4] 2> 484692 T2948 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/shard-1-001/cores
[junit4] 2> 484692 T2948 oasc.CoreContainer.<init> New CoreContainer 1842762933
[junit4] 2> 484692 T2948 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/shard-1-001/]
[junit4] 2> 484693 T2948 oasc.CoreContainer.load loading shared library: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/shard-1-001/lib
[junit4] 2> 484693 T2948 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/shard-1-001/lib).
[junit4] 2> 484703 T2948 oashc.HttpShardHandlerFactory.init created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 484707 T2948 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 484708 T2948 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 484708 T2948 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 484708 T2948 oasc.CoreContainer.load Node Name: 127.0.0.1
[junit4] 2> 484708 T2948 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:44739/solr
[junit4] 2> 484709 T2948 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 484709 T2948 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 484710 T2948 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 484711 T3001 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3bd04449 name:ZooKeeperConnection Watcher:127.0.0.1:44739 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 484711 T2948 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 484712 T2948 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 484713 T2948 n:127.0.0.1:44749_mun%2Fx oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 484714 T3004 n:127.0.0.1:44749_mun%2Fx oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6d241c0d name:ZooKeeperConnection Watcher:127.0.0.1:44739/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 484714 T2948 n:127.0.0.1:44749_mun%2Fx oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 484717 T2948 n:127.0.0.1:44749_mun%2Fx oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 485720 T2948 n:127.0.0.1:44749_mun%2Fx oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44749_mun%2Fx
[junit4] 2> 485721 T2948 n:127.0.0.1:44749_mun%2Fx oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:44749_mun%2Fx
[junit4] 2> 485723 T2948 n:127.0.0.1:44749_mun%2Fx oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 485725 T2948 n:127.0.0.1:44749_mun%2Fx oasc.CorePropertiesLocator.discover Looking for core definitions underneath /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/shard-1-001/cores
[junit4] 2> 485729 T2948 n:127.0.0.1:44749_mun%2Fx oasc.CoreDescriptor.<init> CORE DESCRIPTOR: {config=solrconfig.xml, loadOnStartup=true, collection=collection1, dataDir=data/, shard=, instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/shard-1-001/cores/collection1, transient=false, absoluteInstDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/shard-1-001/cores/collection1/, coreNodeName=, schema=schema.xml, name=collection1}
[junit4] 2> 485730 T2948 n:127.0.0.1:44749_mun%2Fx oasc.CorePropertiesLocator.discoverUnder Found core collection1 in /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/shard-1-001/cores/collection1/
[junit4] 2> 485730 T2948 n:127.0.0.1:44749_mun%2Fx oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 485731 T3005 n:127.0.0.1:44749_mun%2Fx c:collection1 x:collection1 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 485731 T3005 n:127.0.0.1:44749_mun%2Fx c:collection1 x:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 485732 T3005 n:127.0.0.1:44749_mun%2Fx oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 485732 T2976 n:127.0.0.1:44742_mun%2Fx oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 485733 T2977 n:127.0.0.1:44742_mun%2Fx oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://127.0.0.1:44749/mun/x",
[junit4] 2> "node_name":"127.0.0.1:44749_mun%2Fx",
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "shard":null} current state version: 3
[junit4] 2> 485734 T2977 n:127.0.0.1:44742_mun%2Fx oasco.ReplicaMutator.updateState Update state numShards=1 message={
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://127.0.0.1:44749/mun/x",
[junit4] 2> "node_name":"127.0.0.1:44749_mun%2Fx",
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "shard":null}
[junit4] 2> 485734 T2977 n:127.0.0.1:44742_mun%2Fx oasco.ClusterStateMutator.createCollection building a new cName: collection1
[junit4] 2> 485734 T2977 n:127.0.0.1:44742_mun%2Fx oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard1
[junit4] 2> 485735 T2987 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 485735 T2976 n:127.0.0.1:44742_mun%2Fx oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 485735 T3004 n:127.0.0.1:44749_mun%2Fx oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 486734 T3005 n:127.0.0.1:44749_mun%2Fx oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 486735 T3005 n:127.0.0.1:44749_mun%2Fx oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 486736 T3005 n:127.0.0.1:44749_mun%2Fx oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 486736 T3005 n:127.0.0.1:44749_mun%2Fx oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 486736 T3005 n:127.0.0.1:44749_mun%2Fx oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 486737 T3005 n:127.0.0.1:44749_mun%2Fx oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/shard-1-001/cores/collection1/'
[junit4] 2> 486761 T3005 n:127.0.0.1:44749_mun%2Fx oasc.Config.<init> loaded config solrconfig.xml with version 0
[junit4] 2> 486771 T3005 n:127.0.0.1:44749_mun%2Fx oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
[junit4] 2> 486794 T3005 n:127.0.0.1:44749_mun%2Fx oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.2.0
[junit4] 2> 486844 T3005 n:127.0.0.1:44749_mun%2Fx oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 486946 T3005 n:127.0.0.1:44749_mun%2Fx oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 486956 T3005 n:127.0.0.1:44749_mun%2Fx oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 487199 T3005 n:127.0.0.1:44749_mun%2Fx oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 487201 T3005 n:127.0.0.1:44749_mun%2Fx oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 487202 T3005 n:127.0.0.1:44749_mun%2Fx oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 487206 T3005 n:127.0.0.1:44749_mun%2Fx oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 487220 T3005 n:127.0.0.1:44749_mun%2Fx oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 487220 T3005 n:127.0.0.1:44749_mun%2Fx x:collection1 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 487220 T3005 n:127.0.0.1:44749_mun%2Fx x:collection1 oasc.SolrCore.<init> [[collection1] ] Opening new SolrCore at [/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/shard-1-001/cores/collection1/], dataDir=[null]
[junit4] 2> 487220 T3005 n:127.0.0.1:44749_mun%2Fx x:collection1 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@69fc0ce9
[junit4] 2> 487221 T3005 n:127.0.0.1:44749_mun%2Fx x:collection1 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/shard-1-001/cores/collection1/data
[junit4] 2> 487221 T3005 n:127.0.0.1:44749_mun%2Fx x:collection1 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/shard-1-001/cores/collection1/data/index/
[junit4] 2> 487221 T3005 n:127.0.0.1:44749_mun%2Fx x:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/shard-1-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 487222 T3005 n:127.0.0.1:44749_mun%2Fx x:collection1 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/shard-1-001/cores/collection1/data/index
[junit4] 2> 487222 T3005 n:127.0.0.1:44749_mun%2Fx x:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=40, maxMergeAtOnceExplicit=27, maxMergedSegmentMB=1.1806640625, floorSegmentMB=1.6025390625, forceMergeDeletesPctAllowed=15.892435850651601, segmentsPerTier=31.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 487223 T3005 n:127.0.0.1:44749_mun%2Fx x:collection1 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1f06104e lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@471880cb),segFN=segments_1,generation=1}
[junit4] 2> 487223 T3005 n:127.0.0.1:44749_mun%2Fx x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 487227 T3005 n:127.0.0.1:44749_mun%2Fx x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 487228 T3005 n:127.0.0.1:44749_mun%2Fx x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 487228 T3005 n:127.0.0.1:44749_mun%2Fx x:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 487228 T3005 n:127.0.0.1:44749_mun%2Fx x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 487228 T3005 n:127.0.0.1:44749_mun%2Fx x:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 487228 T3005 n:127.0.0.1:44749_mun%2Fx x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 487229 T3005 n:127.0.0.1:44749_mun%2Fx x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 487229 T3005 n:127.0.0.1:44749_mun%2Fx x:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 487229 T3005 n:127.0.0.1:44749_mun%2Fx x:collection1 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 487241 T3005 n:127.0.0.1:44749_mun%2Fx x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 487243 T3005 n:127.0.0.1:44749_mun%2Fx x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 487244 T3005 n:127.0.0.1:44749_mun%2Fx x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 487246 T3005 n:127.0.0.1:44749_mun%2Fx x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 487251 T3005 n:127.0.0.1:44749_mun%2Fx x:collection1 oasc.RequestHandlers.initHandlersFromConfig Registered paths: /admin/mbeans,/update/json/docs,/admin/ping,/update/csv,/admin/segments,/admin/file,/admin/logging,standard,/admin/threads,/update/json,/schema,/config,/admin/properties,/update,/admin/luke,/replication,/admin/system,/get,/admin/plugins
[junit4] 2> 487252 T3005 n:127.0.0.1:44749_mun%2Fx x:collection1 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 487253 T3005 n:127.0.0.1:44749_mun%2Fx x:collection1 oasu.UpdateHandler.<init> Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 487253 T3005 n:127.0.0.1:44749_mun%2Fx x:collection1 oasu.UpdateLog.init Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10
[junit4] 2> 487255 T3005 n:127.0.0.1:44749_mun%2Fx x:collection1 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 487255 T3005 n:127.0.0.1:44749_mun%2Fx x:collection1 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 487256 T3005 n:127.0.0.1:44749_mun%2Fx x:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=43, maxMergeAtOnceExplicit=36, maxMergedSegmentMB=76.06640625, floorSegmentMB=1.890625, forceMergeDeletesPctAllowed=23.82292746427449, segmentsPerTier=18.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4269513756894481
[junit4] 2> 487256 T3005 n:127.0.0.1:44749_mun%2Fx x:collection1 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1f06104e lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@471880cb),segFN=segments_1,generation=1}
[junit4] 2> 487256 T3005 n:127.0.0.1:44749_mun%2Fx x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 487256 T3005 n:127.0.0.1:44749_mun%2Fx x:collection1 oass.SolrIndexSearcher.<init> Opening Searcher@65fa751c[collection1] main
[junit4] 2> 487257 T3005 n:127.0.0.1:44749_mun%2Fx x:collection1 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 487257 T3005 n:127.0.0.1:44749_mun%2Fx x:collection1 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 487257 T3005 n:127.0.0.1:44749_mun%2Fx x:collection1 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 487258 T3005 n:127.0.0.1:44749_mun%2Fx x:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 487258 T3005 n:127.0.0.1:44749_mun%2Fx x:collection1 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 487258 T3005 n:127.0.0.1:44749_mun%2Fx x:collection1 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 487259 T3005 n:127.0.0.1:44749_mun%2Fx x:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 487259 T3005 n:127.0.0.1:44749_mun%2Fx x:collection1 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 487259 T3005 n:127.0.0.1:44749_mun%2Fx x:collection1 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 487259 T3005 n:127.0.0.1:44749_mun%2Fx x:collection1 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 487260 T3006 n:127.0.0.1:44749_mun%2Fx x:collection1 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@65fa751c[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 487260 T3005 n:127.0.0.1:44749_mun%2Fx x:collection1 oasc.ZkController.getConfDirListeners watch zkdir /configs/conf1
[junit4] 2> 487261 T3005 n:127.0.0.1:44749_mun%2Fx x:collection1 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 487262 T3009 n:127.0.0.1:44749_mun%2Fx c:collection1 s:shard1 x:collection1 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:44749/mun/x collection:collection1 shard:shard1
[junit4] 2> 487262 T2948 n:127.0.0.1:44749_mun%2Fx oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2
[junit4] 2> 487262 T2948 n:127.0.0.1:44749_mun%2Fx oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 487262 T3009 n:127.0.0.1:44749_mun%2Fx c:collection1 s:shard1 x:collection1 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 487266 T3009 n:127.0.0.1:44749_mun%2Fx c:collection1 s:shard1 x:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 487267 T2976 n:127.0.0.1:44742_mun%2Fx oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 487268 T3009 n:127.0.0.1:44749_mun%2Fx c:collection1 s:shard1 x:collection1 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 487268 T3009 n:127.0.0.1:44749_mun%2Fx c:collection1 s:shard1 x:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C383 name=collection1 org.apache.solr.core.SolrCore@1927b06 url=http://127.0.0.1:44749/mun/x/collection1 node=127.0.0.1:44749_mun%2Fx C383_STATE=coll:collection1 core:collection1 props:{base_url=http://127.0.0.1:44749/mun/x, node_name=127.0.0.1:44749_mun%2Fx, state=down, core=collection1}
[junit4] 2> 487268 T3009 n:127.0.0.1:44749_mun%2Fx c:collection1 s:shard1 x:collection1 C383 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:44749/mun/x/collection1/
[junit4] 2> 487268 T2977 n:127.0.0.1:44742_mun%2Fx oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1"} current state version: 4
[junit4] 2> 487268 T3009 n:127.0.0.1:44749_mun%2Fx c:collection1 s:shard1 x:collection1 C383 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 487269 T3009 n:127.0.0.1:44749_mun%2Fx c:collection1 s:shard1 x:collection1 C383 oasc.SyncStrategy.syncToMe http://127.0.0.1:44749/mun/x/collection1/ has no replicas
[junit4] 2> 487269 T3009 n:127.0.0.1:44749_mun%2Fx c:collection1 s:shard1 x:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:44749/mun/x/collection1/ shard1
[junit4] 2> 487269 T3009 n:127.0.0.1:44749_mun%2Fx c:collection1 s:shard1 x:collection1 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 487269 T2976 n:127.0.0.1:44742_mun%2Fx oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 487270 T3004 n:127.0.0.1:44749_mun%2Fx oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 487269 T2987 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 487273 T2976 n:127.0.0.1:44742_mun%2Fx oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 487273 T2977 n:127.0.0.1:44742_mun%2Fx oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "base_url":"http://127.0.0.1:44749/mun/x",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 5
[junit4] 2> 487376 T2987 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 487376 T3004 n:127.0.0.1:44749_mun%2Fx oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 487376 T2976 n:127.0.0.1:44742_mun%2Fx oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 487426 T3009 n:127.0.0.1:44749_mun%2Fx c:collection1 s:shard1 x:collection1 oasc.ZkController.register We are http://127.0.0.1:44749/mun/x/collection1/ and leader is http://127.0.0.1:44749/mun/x/collection1/
[junit4] 2> 487427 T3009 n:127.0.0.1:44749_mun%2Fx c:collection1 s:shard1 x:collection1 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:44749/mun/x
[junit4] 2> 487427 T3009 n:127.0.0.1:44749_mun%2Fx c:collection1 s:shard1 x:collection1 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 487427 T3009 n:127.0.0.1:44749_mun%2Fx c:collection1 s:shard1 x:collection1 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 487427 T3009 n:127.0.0.1:44749_mun%2Fx c:collection1 s:shard1 x:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 487428 T2976 n:127.0.0.1:44742_mun%2Fx oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 487429 T2977 n:127.0.0.1:44742_mun%2Fx oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://127.0.0.1:44749/mun/x",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "node_name":"127.0.0.1:44749_mun%2Fx",
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "shard":"shard1"} current state version: 6
[junit4] 2> 487430 T2977 n:127.0.0.1:44742_mun%2Fx oasco.ReplicaMutator.updateState Update state numShards=1 message={
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://127.0.0.1:44749/mun/x",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "node_name":"127.0.0.1:44749_mun%2Fx",
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "shard":"shard1"}
[junit4] 2> 487532 T2987 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 487532 T3004 n:127.0.0.1:44749_mun%2Fx oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 487532 T2976 n:127.0.0.1:44742_mun%2Fx oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 488395 T2948 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/shard-2-001/cores/collection1
[junit4] 2> 488397 T2948 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2 in directory /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/shard-2-001
[junit4] 2> 488398 T2948 oejs.Server.doStart jetty-9.2.10.v20150310
[junit4] 2> 488400 T2948 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@6cb96e3a{/mun/x,null,AVAILABLE}
[junit4] 2> 488401 T2948 oejs.AbstractConnector.doStart Started ServerConnector@30530e76{HTTP/1.1}{127.0.0.1:44752}
[junit4] 2> 488401 T2948 oejs.Server.doStart Started @493191ms
[junit4] 2> 488401 T2948 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {solr.data.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/tempDir-001/jetty2, solrconfig=solrconfig.xml, hostContext=/mun/x, hostPort=44752, coreRootDirectory=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/shard-2-001/cores}
[junit4] 2> 488402 T2948 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@57bd06bf
[junit4] 2> 488402 T2948 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/shard-2-001/'
[junit4] 2> 488431 T2948 oasc.SolrXmlConfig.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/shard-2-001/solr.xml
[junit4] 2> 488478 T2948 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/shard-2-001/cores
[junit4] 2> 488478 T2948 oasc.CoreContainer.<init> New CoreContainer 614187200
[junit4] 2> 488478 T2948 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/shard-2-001/]
[junit4] 2> 488479 T2948 oasc.CoreContainer.load loading shared library: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/shard-2-001/lib
[junit4] 2> 488479 T2948 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/shard-2-001/lib).
[junit4] 2> 488488 T2948 oashc.HttpShardHandlerFactory.init created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 488493 T2948 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 488493 T2948 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 488494 T2948 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 488494 T2948 oasc.CoreContainer.load Node Name: 127.0.0.1
[junit4] 2> 488494 T2948 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:44739/solr
[junit4] 2> 488494 T2948 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 488494 T2948 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 488495 T2948 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 488497 T3023 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@cb54fdf name:ZooKeeperConnection Watcher:127.0.0.1:44739 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 488497 T2948 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 488497 T2948 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 488499 T2948 n:127.0.0.1:44752_mun%2Fx oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 488500 T3026 n:127.0.0.1:44752_mun%2Fx oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e8c12d name:ZooKeeperConnection Watcher:127.0.0.1:44739/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 488500 T2948 n:127.0.0.1:44752_mun%2Fx oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 488503 T2948 n:127.0.0.1:44752_mun%2Fx oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 489506 T2948 n:127.0.0.1:44752_mun%2Fx oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44752_mun%2Fx
[junit4] 2> 489506 T2948 n:127.0.0.1:44752_mun%2Fx oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:44752_mun%2Fx
[junit4] 2> 489508 T2948 n:127.0.0.1:44752_mun%2Fx oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 489510 T2948 n:127.0.0.1:44752_mun%2Fx oasc.CorePropertiesLocator.discover Looking for core definitions underneath /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/shard-2-001/cores
[junit4] 2> 489512 T2948 n:127.0.0.1:44752_mun%2Fx oasc.CoreDescriptor.<init> CORE DESCRIPTOR: {coreNodeName=, loadOnStartup=true, shard=, instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/shard-2-001/cores/collection1, collection=collection1, config=solrconfig.xml, name=collection1, absoluteInstDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/shard-2-001/cores/collection1/, dataDir=data/, schema=schema.xml, transient=false}
[junit4] 2> 489512 T2948 n:127.0.0.1:44752_mun%2Fx oasc.CorePropertiesLocator.discoverUnder Found core collection1 in /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/shard-2-001/cores/collection1/
[junit4] 2> 489512 T2948 n:127.0.0.1:44752_mun%2Fx oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 489513 T3027 n:127.0.0.1:44752_mun%2Fx c:collection1 x:collection1 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 489513 T3027 n:127.0.0.1:44752_mun%2Fx c:collection1 x:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 489514 T3027 n:127.0.0.1:44752_mun%2Fx oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 489514 T2976 n:127.0.0.1:44742_mun%2Fx oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 489515 T2977 n:127.0.0.1:44742_mun%2Fx oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://127.0.0.1:44752/mun/x",
[junit4] 2> "node_name":"127.0.0.1:44752_mun%2Fx",
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "shard":null} current state version: 7
[junit4] 2> 489515 T2977 n:127.0.0.1:44742_mun%2Fx oasco.ReplicaMutator.updateState Update state numShards=1 message={
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://127.0.0.1:44752/mun/x",
[junit4] 2> "node_name":"127.0.0.1:44752_mun%2Fx",
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "shard":null}
[junit4] 2> 489516 T2977 n:127.0.0.1:44742_mun%2Fx oasco.ReplicaMutator.updateState Collection already exists with numShards=1
[junit4] 2> 489516 T2977 n:127.0.0.1:44742_mun%2Fx oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard1
[junit4] 2> 489517 T3004 n:127.0.0.1:44749_mun%2Fx oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 489517 T3026 n:127.0.0.1:44752_mun%2Fx oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 489517 T2987 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 489517 T2976 n:127.0.0.1:44742_mun%2Fx oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 490514 T3027 n:127.0.0.1:44752_mun%2Fx oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 490515 T3027 n:127.0.0.1:44752_mun%2Fx oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 490515 T3027 n:127.0.0.1:44752_mun%2Fx oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 490515 T3027 n:127.0.0.1:44752_mun%2Fx oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 490516 T3027 n:127.0.0.1:44752_mun%2Fx oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 490516 T3027 n:127.0.0.1:44752_mun%2Fx oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/shard-2-001/cores/collection1/'
[junit4] 2> 490530 T3027 n:127.0.0.1:44752_mun%2Fx oasc.Config.<init> loaded config solrconfig.xml with version 0
[junit4] 2> 490537 T3027 n:127.0.0.1:44752_mun%2Fx oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
[junit4] 2> 490553 T3027 n:127.0.0.1:44752_mun%2Fx oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.2.0
[junit4] 2> 490586 T3027 n:127.0.0.1:44752_mun%2Fx oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 490688 T3027 n:127.0.0.1:44752_mun%2Fx oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 490694 T3027 n:127.0.0.1:44752_mun%2Fx oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 490931 T3027 n:127.0.0.1:44752_mun%2Fx oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 490933 T3027 n:127.0.0.1:44752_mun%2Fx oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 490935 T3027 n:127.0.0.1:44752_mun%2Fx oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 490938 T3027 n:127.0.0.1:44752_mun%2Fx oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 490950 T3027 n:127.0.0.1:44752_mun%2Fx oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 490951 T3027 n:127.0.0.1:44752_mun%2Fx x:collection1 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 490951 T3027 n:127.0.0.1:44752_mun%2Fx x:collection1 oasc.SolrCore.<init> [[collection1] ] Opening new SolrCore at [/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/shard-2-001/cores/collection1/], dataDir=[null]
[junit4] 2> 490951 T3027 n:127.0.0.1:44752_mun%2Fx x:collection1 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@69fc0ce9
[junit4] 2> 490952 T3027 n:127.0.0.1:44752_mun%2Fx x:collection1 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/shard-2-001/cores/collection1/data
[junit4] 2> 490953 T3027 n:127.0.0.1:44752_mun%2Fx x:collection1 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/shard-2-001/cores/collection1/data/index/
[junit4] 2> 490953 T3027 n:127.0.0.1:44752_mun%2Fx x:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/shard-2-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 490953 T3027 n:127.0.0.1:44752_mun%2Fx x:collection1 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/shard-2-001/cores/collection1/data/index
[junit4] 2> 490953 T3027 n:127.0.0.1:44752_mun%2Fx x:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=40, maxMergeAtOnceExplicit=27, maxMergedSegmentMB=1.1806640625, floorSegmentMB=1.6025390625, forceMergeDeletesPctAllowed=15.8
[...truncated too long message...]
Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:44752_mun%2Fx
[junit4] 2> 650898 T3124 n:127.0.0.1:44752_mun%2Fx oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> ASYNC NEW_CORE C407 name=collection1 org.apache.solr.core.SolrCore@2f54567b url=http://127.0.0.1:44752/mun/x/collection1 node=127.0.0.1:44752_mun%2Fx C407_STATE=coll:collection1 core:collection1 props:{base_url=http://127.0.0.1:44752/mun/x, node_name=127.0.0.1:44752_mun%2Fx, state=active, core=collection1}
[junit4] 2> 651894 T3123 n:127.0.0.1:44752_mun%2Fx C407 oasc.SyncStrategy.sync WARN Closed, skipping sync up.
[junit4] 2> 651895 T3123 n:127.0.0.1:44752_mun%2Fx oasc.ShardLeaderElectionContext.rejoinLeaderElection Not rejoining election because CoreContainer is closed
[junit4] 2> 651896 T3123 n:127.0.0.1:44752_mun%2Fx oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@2f54567b
[junit4] 2> 651896 T3123 n:127.0.0.1:44752_mun%2Fx oasc.ZkController.unregisterConfListener removed listener for config directory [/configs/conf1]
[junit4] 2> 651896 T3123 n:127.0.0.1:44752_mun%2Fx oasc.ZkController.unregisterConfListener No more listeners for config directory [/configs/conf1]
[junit4] 2> 651897 T3123 n:127.0.0.1:44752_mun%2Fx oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=63,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=422,cumulative_deletesById=225,cumulative_deletesByQuery=0,cumulative_errors=0,transaction_logs_total_size=49308,transaction_logs_total_number=1}
[junit4] 2> 651897 T3123 n:127.0.0.1:44752_mun%2Fx oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 651897 T3123 n:127.0.0.1:44752_mun%2Fx oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 651897 T3123 n:127.0.0.1:44752_mun%2Fx oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 651898 T3123 n:127.0.0.1:44752_mun%2Fx oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 651908 T3123 n:127.0.0.1:44752_mun%2Fx oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 651909 T3123 n:127.0.0.1:44752_mun%2Fx oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/shard-2-001/cores/collection1/data [CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/shard-2-001/cores/collection1/data;done=false>>]
[junit4] 2> 651909 T3123 n:127.0.0.1:44752_mun%2Fx oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/shard-2-001/cores/collection1/data
[junit4] 2> 651909 T3123 n:127.0.0.1:44752_mun%2Fx oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/shard-2-001/cores/collection1/data/index [CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/shard-2-001/cores/collection1/data/index;done=false>>]
[junit4] 2> 651909 T3123 n:127.0.0.1:44752_mun%2Fx oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001/shard-2-001/cores/collection1/data/index
[junit4] 2> 651911 T2948 oejs.AbstractConnector.doStop Stopped ServerConnector@7d9b2e8d{HTTP/1.1}{127.0.0.1:44752}
[junit4] 2> 651912 T2948 oejsh.ContextHandler.doStop Stopped o.e.j.s.ServletContextHandler@26ba8c03{/mun/x,null,UNAVAILABLE}
[junit4] 2> 651914 T2948 c:control_collection s:shard1 x:collection1 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:44739 44739
[junit4] 2> 652130 T2949 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:44739 44739
[junit4] 2> 652131 T2949 oasc.ZkTestServer$ZKServerMain.runFromConfig WARN Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 5 /solr/aliases.json
[junit4] 2> 5 /solr/clusterstate.json
[junit4] 2> 4 /solr/configs/conf1
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 2 /solr/overseer_elect/election/93813235560087558-127.0.0.1:44749_mun%2Fx-n_0000000001
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard1/election/93813235560087558-core_node1-n_0000000000
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 4 /solr/live_nodes
[junit4] 2> 3 /solr/overseer/queue
[junit4] 2> 3 /solr/overseer/collection-queue-work
[junit4] 2>
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=RecoveryZkTest -Dtests.method=test -Dtests.seed=615D83292E4106AA -Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=hr_HR -Dtests.timezone=MST7MDT -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[junit4] FAILURE 172s J2 | RecoveryZkTest.test <<<
[junit4] > Throwable #1: java.lang.AssertionError: shard1 is not consistent. Got 961 from http://127.0.0.1:44749/mun/x/collection1lastClient and got 247 from http://127.0.0.1:44752/mun/x/collection1
[junit4] > at __randomizedtesting.SeedInfo.seed([615D83292E4106AA:E909BCF380BD6B52]:0)
[junit4] > at org.apache.solr.cloud.RecoveryZkTest.test(RecoveryZkTest.java:123)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:960)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:935)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 652144 T2948 c:control_collection s:shard1 x:collection1 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest 615D83292E4106AA-001
[junit4] 2> 171995 T2947 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene50): {id=PostingsFormat(name=LuceneVarGapFixedInterval), rnd_b=PostingsFormat(name=LuceneVarGapFixedInterval), a_i=PostingsFormat(name=LuceneVarGapFixedInterval), _version_=FSTOrd50, a_t=PostingsFormat(name=LuceneVarGapDocFreqInterval)}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=false,coord=yes): {}, locale=hr_HR, timezone=MST7MDT
[junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_65 (64-bit)/cpus=16,threads=1,free=181437288,total=308805632
[junit4] 2> NOTE: All tests run in this JVM: [TestManagedSchema, TestDefaultSearchFieldResource, ZkStateWriterTest, AutoCommitTest, CursorMarkTest, HdfsThreadLeakTest, ZkSolrClientTest, TestRTGBase, TestDistributedGrouping, OverseerTest, TestDynamicFieldCollectionResource, StandardRequestHandlerTest, TestReplicationHandler, TestWriterPerf, DocumentBuilderTest, SolrIndexSplitterTest, EchoParamsTest, QueryParsingTest, TestSchemaNameResource, TestValueSourceCache, TermVectorComponentTest, TestObjectReleaseTracker, DistributedFacetPivotWhiteBoxTest, TestLRUCache, TestJoin, TestMacros, TestTrie, TestConfigSets, SolrCmdDistributorTest, CustomCollectionTest, TestFastOutputStream, RecoveryZkTest]
[junit4] Completed [139/488] on J2 in 172.54s, 1 test, 1 failure <<< FAILURES!
[...truncated 1128 lines...]
BUILD FAILED
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/build.xml:536: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/build.xml:484: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/build.xml:61: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/extra-targets.xml:39: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build.xml:229: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/common-build.xml:511: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/lucene/common-build.xml:1433: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/lucene/common-build.xml:991: There were test failures: 488 suites, 1958 tests, 1 failure, 71 ignored (26 assumptions)
Total time: 52 minutes 39 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Sending artifact delta relative to Lucene-Solr-Tests-5.x-Java7 #3107
Archived 5 artifacts
Archive block size is 32768
Received 0 blocks and 233662519 bytes
Compression is 0.0%
Took 45 sec
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-Tests-5.x-Java7 - Build # 3109 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-5.x-Java7/3109/
2 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.handler.TestSolrConfigHandlerConcurrent
Error Message:
1 thread leaked from SUITE scope at org.apache.solr.handler.TestSolrConfigHandlerConcurrent: 1) Thread[id=207, name=qtp207074561-207, state=RUNNABLE, group=TGRP-TestSolrConfigHandlerConcurrent] at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:579) at sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:618) at org.apache.http.conn.ssl.SSLSocketFactory.connectSocket(SSLSocketFactory.java:532) at org.apache.http.conn.ssl.SSLSocketFactory.connectSocket(SSLSocketFactory.java:409) at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:177) at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:304) at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:611) at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:446) at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107) at org.apache.solr.servlet.HttpSolrCall.remoteQuery(HttpSolrCall.java:464) at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:362) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:175) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:168) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652) at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:105) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652) at org.eclipse.jetty.servlets.UserAgentFilter.doFilter(UserAgentFilter.java:83) at org.eclipse.jetty.servlets.GzipFilter.doFilter(GzipFilter.java:300) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:221) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97) at org.eclipse.jetty.server.Server.handle(Server.java:497) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:310) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:257) at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:540) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555) at java.lang.Thread.run(Thread.java:745)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.handler.TestSolrConfigHandlerConcurrent:
1) Thread[id=207, name=qtp207074561-207, state=RUNNABLE, group=TGRP-TestSolrConfigHandlerConcurrent]
at java.net.PlainSocketImpl.socketConnect(Native Method)
at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
at java.net.Socket.connect(Socket.java:579)
at sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:618)
at org.apache.http.conn.ssl.SSLSocketFactory.connectSocket(SSLSocketFactory.java:532)
at org.apache.http.conn.ssl.SSLSocketFactory.connectSocket(SSLSocketFactory.java:409)
at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:177)
at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:304)
at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:611)
at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:446)
at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
at org.apache.solr.servlet.HttpSolrCall.remoteQuery(HttpSolrCall.java:464)
at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:362)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:175)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:168)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:105)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
at org.eclipse.jetty.servlets.UserAgentFilter.doFilter(UserAgentFilter.java:83)
at org.eclipse.jetty.servlets.GzipFilter.doFilter(GzipFilter.java:300)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585)
at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:221)
at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127)
at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515)
at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
at org.eclipse.jetty.server.Server.handle(Server.java:497)
at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:310)
at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:257)
at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:540)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635)
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555)
at java.lang.Thread.run(Thread.java:745)
at __randomizedtesting.SeedInfo.seed([4162C6E10C136CF4]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.handler.TestSolrConfigHandlerConcurrent
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=207, name=qtp207074561-207, state=RUNNABLE, group=TGRP-TestSolrConfigHandlerConcurrent] at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:579) at sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:618) at org.apache.http.conn.ssl.SSLSocketFactory.connectSocket(SSLSocketFactory.java:532) at org.apache.http.conn.ssl.SSLSocketFactory.connectSocket(SSLSocketFactory.java:409) at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:177) at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:304) at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:611) at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:446) at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107) at org.apache.solr.servlet.HttpSolrCall.remoteQuery(HttpSolrCall.java:464) at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:362) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:175) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:168) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652) at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:105) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652) at org.eclipse.jetty.servlets.UserAgentFilter.doFilter(UserAgentFilter.java:83) at org.eclipse.jetty.servlets.GzipFilter.doFilter(GzipFilter.java:300) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:221) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97) at org.eclipse.jetty.server.Server.handle(Server.java:497) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:310) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:257) at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:540) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555) at java.lang.Thread.run(Thread.java:745)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=207, name=qtp207074561-207, state=RUNNABLE, group=TGRP-TestSolrConfigHandlerConcurrent]
at java.net.PlainSocketImpl.socketConnect(Native Method)
at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
at java.net.Socket.connect(Socket.java:579)
at sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:618)
at org.apache.http.conn.ssl.SSLSocketFactory.connectSocket(SSLSocketFactory.java:532)
at org.apache.http.conn.ssl.SSLSocketFactory.connectSocket(SSLSocketFactory.java:409)
at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:177)
at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:304)
at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:611)
at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:446)
at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
at org.apache.solr.servlet.HttpSolrCall.remoteQuery(HttpSolrCall.java:464)
at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:362)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:175)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:168)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:105)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
at org.eclipse.jetty.servlets.UserAgentFilter.doFilter(UserAgentFilter.java:83)
at org.eclipse.jetty.servlets.GzipFilter.doFilter(GzipFilter.java:300)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585)
at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:221)
at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127)
at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515)
at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
at org.eclipse.jetty.server.Server.handle(Server.java:497)
at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:310)
at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:257)
at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:540)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635)
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555)
at java.lang.Thread.run(Thread.java:745)
at __randomizedtesting.SeedInfo.seed([4162C6E10C136CF4]:0)
Build Log:
[...truncated 9479 lines...]
[junit4] Suite: org.apache.solr.handler.TestSolrConfigHandlerConcurrent
[junit4] 2> Creating dataDir: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.handler.TestSolrConfigHandlerConcurrent 4162C6E10C136CF4-001/init-core-data-001
[junit4] 2> 35028 T22 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (true)
[junit4] 2> 35029 T22 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /uq_/tz
[junit4] 2> 35095 T22 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 35106 T23 oasc.ZkTestServer$2$1.setClientPort client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 35107 T23 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 35508 T22 oasc.ZkTestServer.run start zk server on port:15659
[junit4] 2> 35686 T22 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 36040 T22 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 36298 T30 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@472ec00d name:ZooKeeperConnection Watcher:127.0.0.1:15659 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 36299 T22 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 36301 T22 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 36322 T22 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 36548 T22 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 36549 T22 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 36552 T33 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@623e2a62 name:ZooKeeperConnection Watcher:127.0.0.1:15659/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 36552 T22 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 36554 T22 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 36585 T22 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 36592 T22 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 36598 T22 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 36602 T22 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 36608 T22 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 36656 T22 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 36664 T22 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 36664 T22 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 36669 T22 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 36670 T22 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 36676 T22 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 36676 T22 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 36681 T22 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 36682 T22 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 36687 T22 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 36687 T22 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 36692 T22 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 36693 T22 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 36699 T22 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 36699 T22 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 36704 T22 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 36705 T22 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 36710 T22 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 36711 T22 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 36716 T22 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 36716 T22 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 36743 T22 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 36744 T22 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 36747 T36 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@65ce9dc5 name:ZooKeeperConnection Watcher:127.0.0.1:15659/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 36748 T22 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 36748 T22 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 39104 T22 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.handler.TestSolrConfigHandlerConcurrent 4162C6E10C136CF4-001/control-001/cores/collection1
[junit4] 2> 41008 T22 oejs.Server.doStart jetty-9.2.10.v20150310
[junit4] 2> 41675 T22 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@5af9fd0b{/uq_/tz,null,AVAILABLE}
[junit4] 2> 41812 T22 oejs.AbstractConnector.doStart Started ServerConnector@19a0ecb1{SSL-http/1.1}{127.0.0.1:16532}
[junit4] 2> 41813 T22 oejs.Server.doStart Started @47318ms
[junit4] 2> 41814 T22 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {hostContext=/uq_/tz, coreRootDirectory=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.handler.TestSolrConfigHandlerConcurrent 4162C6E10C136CF4-001/control-001/cores, solr.data.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.handler.TestSolrConfigHandlerConcurrent 4162C6E10C136CF4-001/tempDir-001/control/data, hostPort=16532}
[junit4] 2> 41857 T22 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@57bd06bf
[junit4] 2> 41858 T22 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.handler.TestSolrConfigHandlerConcurrent 4162C6E10C136CF4-001/control-001/'
[junit4] 2> 41946 T22 oasc.SolrXmlConfig.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.handler.TestSolrConfigHandlerConcurrent 4162C6E10C136CF4-001/control-001/solr.xml
[junit4] 2> 42063 T22 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.handler.TestSolrConfigHandlerConcurrent 4162C6E10C136CF4-001/control-001/cores
[junit4] 2> 42064 T22 oasc.CoreContainer.<init> New CoreContainer 1161179411
[junit4] 2> 42065 T22 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.handler.TestSolrConfigHandlerConcurrent 4162C6E10C136CF4-001/control-001/]
[junit4] 2> 42066 T22 oasc.CoreContainer.load loading shared library: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.handler.TestSolrConfigHandlerConcurrent 4162C6E10C136CF4-001/control-001/lib
[junit4] 2> 42067 T22 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.handler.TestSolrConfigHandlerConcurrent 4162C6E10C136CF4-001/control-001/lib).
[junit4] 2> 42202 T22 oashc.HttpShardHandlerFactory.init created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 42220 T22 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 42227 T22 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 42228 T22 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 42228 T22 oasc.CoreContainer.load Node Name: 127.0.0.1
[junit4] 2> 42229 T22 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:15659/solr
[junit4] 2> 42312 T22 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 42313 T22 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 42314 T22 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 42319 T51 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b99a290 name:ZooKeeperConnection Watcher:127.0.0.1:15659 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 42319 T22 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 42321 T22 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 42357 T22 n:127.0.0.1:16532_uq_%2Ftz oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 42359 T54 n:127.0.0.1:16532_uq_%2Ftz oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@711a9933 name:ZooKeeperConnection Watcher:127.0.0.1:15659/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 42360 T22 n:127.0.0.1:16532_uq_%2Ftz oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 42399 T22 n:127.0.0.1:16532_uq_%2Ftz oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 42421 T22 n:127.0.0.1:16532_uq_%2Ftz oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 42437 T22 n:127.0.0.1:16532_uq_%2Ftz oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 42444 T22 n:127.0.0.1:16532_uq_%2Ftz oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 42450 T22 n:127.0.0.1:16532_uq_%2Ftz oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 42492 T22 n:127.0.0.1:16532_uq_%2Ftz oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 42498 T22 n:127.0.0.1:16532_uq_%2Ftz oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 42502 T22 n:127.0.0.1:16532_uq_%2Ftz oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 42506 T22 n:127.0.0.1:16532_uq_%2Ftz oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:16532_uq_%2Ftz
[junit4] 2> 42519 T22 n:127.0.0.1:16532_uq_%2Ftz oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:16532_uq_%2Ftz
[junit4] 2> 42526 T22 n:127.0.0.1:16532_uq_%2Ftz oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 42531 T22 n:127.0.0.1:16532_uq_%2Ftz oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 42536 T22 n:127.0.0.1:16532_uq_%2Ftz oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 42575 T22 n:127.0.0.1:16532_uq_%2Ftz oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:16532_uq_%2Ftz
[junit4] 2> 42576 T22 n:127.0.0.1:16532_uq_%2Ftz oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 42580 T22 n:127.0.0.1:16532_uq_%2Ftz oasc.Overseer.start Overseer (id=93814149860098052-127.0.0.1:16532_uq_%2Ftz-n_0000000000) starting
[junit4] 2> 42622 T22 n:127.0.0.1:16532_uq_%2Ftz oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 42668 T22 n:127.0.0.1:16532_uq_%2Ftz oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 42694 T56 n:127.0.0.1:16532_uq_%2Ftz oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 42694 T22 n:127.0.0.1:16532_uq_%2Ftz oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 42712 T55 n:127.0.0.1:16532_uq_%2Ftz oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 42730 T22 n:127.0.0.1:16532_uq_%2Ftz oasc.CorePropertiesLocator.discover Looking for core definitions underneath /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.handler.TestSolrConfigHandlerConcurrent 4162C6E10C136CF4-001/control-001/cores
[junit4] 2> 42755 T22 n:127.0.0.1:16532_uq_%2Ftz oasc.CoreDescriptor.<init> CORE DESCRIPTOR: {instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.handler.TestSolrConfigHandlerConcurrent 4162C6E10C136CF4-001/control-001/cores/collection1, name=collection1, config=solrconfig.xml, collection=control_collection, coreNodeName=, transient=false, shard=, absoluteInstDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.handler.TestSolrConfigHandlerConcurrent 4162C6E10C136CF4-001/control-001/cores/collection1/, loadOnStartup=true, dataDir=data/, schema=schema.xml}
[junit4] 2> 42755 T22 n:127.0.0.1:16532_uq_%2Ftz oasc.CorePropertiesLocator.discoverUnder Found core collection1 in /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.handler.TestSolrConfigHandlerConcurrent 4162C6E10C136CF4-001/control-001/cores/collection1/
[junit4] 2> 42756 T22 n:127.0.0.1:16532_uq_%2Ftz oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 42759 T58 n:127.0.0.1:16532_uq_%2Ftz c:control_collection x:collection1 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
[junit4] 2> 42760 T58 n:127.0.0.1:16532_uq_%2Ftz c:control_collection x:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 42780 T54 n:127.0.0.1:16532_uq_%2Ftz oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 42780 T58 n:127.0.0.1:16532_uq_%2Ftz oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 42790 T55 n:127.0.0.1:16532_uq_%2Ftz oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "node_name":"127.0.0.1:16532_uq_%2Ftz",
[junit4] 2> "operation":"state",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:16532/uq_/tz",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "numShards":"1"} current state version: 0
[junit4] 2> 42861 T55 n:127.0.0.1:16532_uq_%2Ftz oasco.ReplicaMutator.updateState Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "node_name":"127.0.0.1:16532_uq_%2Ftz",
[junit4] 2> "operation":"state",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:16532/uq_/tz",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "numShards":"1"}
[junit4] 2> 42870 T55 n:127.0.0.1:16532_uq_%2Ftz oasco.ClusterStateMutator.createCollection building a new cName: control_collection
[junit4] 2> 42934 T55 n:127.0.0.1:16532_uq_%2Ftz oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard1
[junit4] 2> 42959 T54 n:127.0.0.1:16532_uq_%2Ftz oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 43783 T58 n:127.0.0.1:16532_uq_%2Ftz oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 43783 T58 n:127.0.0.1:16532_uq_%2Ftz oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 43785 T58 n:127.0.0.1:16532_uq_%2Ftz oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 43785 T58 n:127.0.0.1:16532_uq_%2Ftz oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 43787 T58 n:127.0.0.1:16532_uq_%2Ftz oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 43788 T58 n:127.0.0.1:16532_uq_%2Ftz oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.handler.TestSolrConfigHandlerConcurrent 4162C6E10C136CF4-001/control-001/cores/collection1/'
[junit4] 2> 43884 T58 n:127.0.0.1:16532_uq_%2Ftz oasc.Config.<init> loaded config solrconfig.xml with version 0
[junit4] 2> 43944 T58 n:127.0.0.1:16532_uq_%2Ftz oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
[junit4] 2> 43985 T58 n:127.0.0.1:16532_uq_%2Ftz oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.2.0
[junit4] 2> 44059 T58 n:127.0.0.1:16532_uq_%2Ftz oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 44062 T58 n:127.0.0.1:16532_uq_%2Ftz oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 44166 T58 n:127.0.0.1:16532_uq_%2Ftz oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 44660 T58 n:127.0.0.1:16532_uq_%2Ftz oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 44684 T58 n:127.0.0.1:16532_uq_%2Ftz oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 44688 T58 n:127.0.0.1:16532_uq_%2Ftz oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 44722 T58 n:127.0.0.1:16532_uq_%2Ftz oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 44728 T58 n:127.0.0.1:16532_uq_%2Ftz oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 44734 T58 n:127.0.0.1:16532_uq_%2Ftz oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 44736 T58 n:127.0.0.1:16532_uq_%2Ftz oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 44737 T58 n:127.0.0.1:16532_uq_%2Ftz oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 44737 T58 n:127.0.0.1:16532_uq_%2Ftz oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 44739 T58 n:127.0.0.1:16532_uq_%2Ftz oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 44739 T58 n:127.0.0.1:16532_uq_%2Ftz oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 44740 T58 n:127.0.0.1:16532_uq_%2Ftz oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 44740 T58 n:127.0.0.1:16532_uq_%2Ftz x:collection1 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 44741 T58 n:127.0.0.1:16532_uq_%2Ftz x:collection1 oasc.SolrCore.<init> [[collection1] ] Opening new SolrCore at [/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.handler.TestSolrConfigHandlerConcurrent 4162C6E10C136CF4-001/control-001/cores/collection1/], dataDir=[null]
[junit4] 2> 44742 T58 n:127.0.0.1:16532_uq_%2Ftz x:collection1 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3291ea21
[junit4] 2> 44761 T58 n:127.0.0.1:16532_uq_%2Ftz x:collection1 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.handler.TestSolrConfigHandlerConcurrent 4162C6E10C136CF4-001/control-001/cores/collection1/data
[junit4] 2> 44762 T58 n:127.0.0.1:16532_uq_%2Ftz x:collection1 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.handler.TestSolrConfigHandlerConcurrent 4162C6E10C136CF4-001/control-001/cores/collection1/data/index/
[junit4] 2> 44762 T58 n:127.0.0.1:16532_uq_%2Ftz x:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.handler.TestSolrConfigHandlerConcurrent 4162C6E10C136CF4-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 44763 T58 n:127.0.0.1:16532_uq_%2Ftz x:collection1 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.handler.TestSolrConfigHandlerConcurrent 4162C6E10C136CF4-001/control-001/cores/collection1/data/index
[junit4] 2> 44763 T58 n:127.0.0.1:16532_uq_%2Ftz x:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=36, maxMergeAtOnceExplicit=36, maxMergedSegmentMB=2.4912109375, floorSegmentMB=0.4375, forceMergeDeletesPctAllowed=5.391086396139415, segmentsPerTier=12.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.12452571128587407
[junit4] 2> 44765 T58 n:127.0.0.1:16532_uq_%2Ftz x:collection1 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1363d95 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@100501d2),segFN=segments_1,generation=1}
[junit4] 2> 44765 T58 n:127.0.0.1:16532_uq_%2Ftz x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 44775 T58 n:127.0.0.1:16532_uq_%2Ftz x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 44776 T58 n:127.0.0.1:16532_uq_%2Ftz x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 44776 T58 n:127.0.0.1:16532_uq_%2Ftz x:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 44777 T58 n:127.0.0.1:16532_uq_%2Ftz x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 44777 T58 n:127.0.0.1:16532_uq_%2Ftz x:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 44778 T58 n:127.0.0.1:16532_uq_%2Ftz x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 44779 T58 n:127.0.0.1:16532_uq_%2Ftz x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 44779 T58 n:127.0.0.1:16532_uq_%2Ftz x:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 44779 T58 n:127.0.0.1:16532_uq_%2Ftz x:collection1 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 44807 T58 n:127.0.0.1:16532_uq_%2Ftz x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 44821 T58 n:127.0.0.1:16532_uq_%2Ftz x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 44824 T58 n:127.0.0.1:16532_uq_%2Ftz x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 44826 T58 n:127.0.0.1:16532_uq_%2Ftz x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 44842 T58 n:127.0.0.1:16532_uq_%2Ftz x:collection1 oasc.RequestHandlers.initHandlersFromConfig Registered paths: /replication,/admin/file,/admin/mbeans,/admin/properties,/get,/update/json/docs,/admin/segments,/admin/threads,/admin/logging,/config,/admin/ping,standard,/update/csv,/schema,/admin/luke,/admin/plugins,/admin/system,/update/json,/update
[junit4] 2> 44845 T58 n:127.0.0.1:16532_uq_%2Ftz x:collection1 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 44848 T58 n:127.0.0.1:16532_uq_%2Ftz x:collection1 oasu.UpdateHandler.<init> Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 44849 T58 n:127.0.0.1:16532_uq_%2Ftz x:collection1 oasu.UpdateLog.init Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10
[junit4] 2> 44861 T58 n:127.0.0.1:16532_uq_%2Ftz x:collection1 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 44862 T58 n:127.0.0.1:16532_uq_%2Ftz x:collection1 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 44863 T58 n:127.0.0.1:16532_uq_%2Ftz x:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=17, maxMergeAtOnceExplicit=46, maxMergedSegmentMB=43.025390625, floorSegmentMB=1.26953125, forceMergeDeletesPctAllowed=20.55083406130898, segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8268423730807084
[junit4] 2> 44864 T58 n:127.0.0.1:16532_uq_%2Ftz x:collection1 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1363d95 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@100501d2),segFN=segments_1,generation=1}
[junit4] 2> 44865 T58 n:127.0.0.1:16532_uq_%2Ftz x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 44865 T58 n:127.0.0.1:16532_uq_%2Ftz x:collection1 oass.SolrIndexSearcher.<init> Opening Searcher@306359f3[collection1] main
[junit4] 2> 44866 T58 n:127.0.0.1:16532_uq_%2Ftz x:collection1 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 44868 T58 n:127.0.0.1:16532_uq_%2Ftz x:collection1 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 44868 T58 n:127.0.0.1:16532_uq_%2Ftz x:collection1 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 44885 T58 n:127.0.0.1:16532_uq_%2Ftz x:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 44886 T58 n:127.0.0.1:16532_uq_%2Ftz x:collection1 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 44886 T58 n:127.0.0.1:16532_uq_%2Ftz x:collection1 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 44887 T58 n:127.0.0.1:16532_uq_%2Ftz x:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 44888 T58 n:127.0.0.1:16532_uq_%2Ftz x:collection1 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 44888 T58 n:127.0.0.1:16532_uq_%2Ftz x:collection1 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 44889 T58 n:127.0.0.1:16532_uq_%2Ftz x:collection1 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 44895 T59 n:127.0.0.1:16532_uq_%2Ftz x:collection1 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@306359f3[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 44897 T58 n:127.0.0.1:16532_uq_%2Ftz x:collection1 oasc.ZkController.getConfDirListeners watch zkdir /configs/conf1
[junit4] 2> 44907 T58 n:127.0.0.1:16532_uq_%2Ftz x:collection1 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 44908 T62 n:127.0.0.1:16532_uq_%2Ftz c:control_collection s:shard1 x:collection1 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:16532/uq_/tz collection:control_collection shard:shard1
[junit4] 2> 44909 T22 n:127.0.0.1:16532_uq_%2Ftz oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2
[junit4] 2> 44910 T22 n:127.0.0.1:16532_uq_%2Ftz oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 44961 T62 n:127.0.0.1:16532_uq_%2Ftz c:control_collection s:shard1 x:collection1 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 44971 T62 n:127.0.0.1:16532_uq_%2Ftz c:control_collection s:shard1 x:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 44974 T54 n:127.0.0.1:16532_uq_%2Ftz oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 44975 T62 n:127.0.0.1:16532_uq_%2Ftz c:control_collection s:shard1 x:collection1 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 44976 T62 n:127.0.0.1:16532_uq_%2Ftz c:control_collection s:shard1 x:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 44976 T55 n:127.0.0.1:16532_uq_%2Ftz oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state version: 1
[junit4] 2> ASYNC NEW_CORE C4 name=collection1 org.apache.solr.core.SolrCore@32af198c url=https://127.0.0.1:16532/uq_/tz/collection1 node=127.0.0.1:16532_uq_%2Ftz C4_STATE=coll:control_collection core:collection1 props:{core=collection1, node_name=127.0.0.1:16532_uq_%2Ftz, base_url=https://127.0.0.1:16532/uq_/tz, state=down}
[junit4] 2> 44989 T62 n:127.0.0.1:16532_uq_%2Ftz c:control_collection s:shard1 x:collection1 C4 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:16532/uq_/tz/collection1/
[junit4] 2> 44989 T62 n:127.0.0.1:16532_uq_%2Ftz c:control_collection s:shard1 x:collection1 C4 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 44990 T62 n:127.0.0.1:16532_uq_%2Ftz c:control_collection s:shard1 x:collection1 C4 oasc.SyncStrategy.syncToMe https://127.0.0.1:16532/uq_/tz/collection1/ has no replicas
[junit4] 2> 44990 T62 n:127.0.0.1:16532_uq_%2Ftz c:control_collection s:shard1 x:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:16532/uq_/tz/collection1/ shard1
[junit4] 2> 44996 T54 n:127.0.0.1:16532_uq_%2Ftz oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 45012 T62 n:127.0.0.1:16532_uq_%2Ftz c:control_collection s:shard1 x:collection1 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 45018 T54 n:127.0.0.1:16532_uq_%2Ftz oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 45020 T55 n:127.0.0.1:16532_uq_%2Ftz oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"https://127.0.0.1:16532/uq_/tz",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 2
[junit4] 2> 45126 T54 n:127.0.0.1:16532_uq_%2Ftz oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 45173 T62 n:127.0.0.1:16532_uq_%2Ftz c:control_collection s:shard1 x:collection1 oasc.ZkController.register We are https://127.0.0.1:16532/uq_/tz/collection1/ and leader is https://127.0.0.1:16532/uq_/tz/collection1/
[junit4] 2> 45173 T62 n:127.0.0.1:16532_uq_%2Ftz c:control_collection s:shard1 x:collection1 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:16532/uq_/tz
[junit4] 2> 45174 T62 n:127.0.0.1:16532_uq_%2Ftz c:control_collection s:shard1 x:collection1 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 45174 T62 n:127.0.0.1:16532_uq_%2Ftz c:control_collection s:shard1 x:collection1 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
[junit4] 2> 45175 T62 n:127.0.0.1:16532_uq_%2Ftz c:control_collection s:shard1 x:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 45177 T54 n:127.0.0.1:16532_uq_%2Ftz oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 45180 T55 n:127.0.0.1:16532_uq_%2Ftz oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "node_name":"127.0.0.1:16532_uq_%2Ftz",
[junit4] 2> "operation":"state",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:16532/uq_/tz",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node1"} current state version: 3
[junit4] 2> 45182 T55 n:127.0.0.1:16532_uq_%2Ftz oasco.ReplicaMutator.updateState Update state numShards=2 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "node_name":"127.0.0.1:16532_uq_%2Ftz",
[junit4] 2> "operation":"state",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:16532/uq_/tz",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 45207 T22 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 45209 T22 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 45211 T65 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1a992216 name:ZooKeeperConnection Watcher:127.0.0.1:15659/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 45212 T22 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 45213 T22 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 45213 T22 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 45223 T22 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 45288 T65 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 45288 T54 n:127.0.0.1:16532_uq_%2Ftz oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 47218 T22 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.handler.TestSolrConfigHandlerConcurrent 4162C6E10C136CF4-001/shard-1-001/cores/collection1
[junit4] 2> 47223 T22 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1 in directory /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.handler.TestSolrConfigHandlerConcurrent 4162C6E10C136CF4-001/shard-1-001
[junit4] 2> 47225 T22 oejs.Server.doStart jetty-9.2.10.v20150310
[junit4] 2> 47229 T22 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@12d8b54d{/uq_/tz,null,AVAILABLE}
[junit4] 2> 47247 T22 oejs.AbstractConnector.doStart Started ServerConnector@6a233503{SSL-http/1.1}{127.0.0.1:47798}
[junit4] 2> 47248 T22 oejs.Server.doStart Started @52752ms
[junit4] 2> 47248 T22 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {hostContext=/uq_/tz, hostPort=47798, solr.data.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.handler.TestSolrConfigHandlerConcurrent 4162C6E10C136CF4-001/tempDir-001/jetty1, coreRootDirectory=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.handler.TestSolrConfigHandlerConcurrent 4162C6E10C136CF4-001/shard-1-001/cores, solrconfig=solrconfig.xml}
[junit4] 2> 47256 T22 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@57bd06bf
[junit4] 2> 47258 T22 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.handler.TestSolrConfigHandlerConcurrent 4162C6E10C136CF4-001/shard-1-001/'
[junit4] 2> 47322 T22 oasc.SolrXmlConfig.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.handler.TestSolrConfigHandlerConcurrent 4162C6E10C136CF4-001/shard-1-001/solr.xml
[junit4] 2> 47404 T22 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.handler.TestSolrConfigHandlerConcurrent 4162C6E10C136CF4-001/shard-1-001/cores
[junit4] 2> 47405 T22 oasc.CoreContainer.<init> New CoreContainer 494480014
[junit4] 2> 47406 T22 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.handler.TestSolrConfigHandlerConcurrent 4162C6E10C136CF4-001/shard-1-001/]
[junit4] 2> 47407 T22 oasc.CoreContainer.load loading shared library: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.handler.TestSolrConfigHandlerConcurrent 4162C6E10C136CF4-001/shard-1-001/lib
[junit4] 2> 47408 T22 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.handler.TestSolrConfigHandlerConcurrent 4162C6E10C136CF4-001/shard-1-001/lib).
[junit4] 2> 47425 T22 oashc.HttpShardHandlerFactory.init created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 47439 T22 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 47444 T22 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 47445 T22 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 47445 T22 oasc.CoreContainer.load Node Name: 127.0.0.1
[junit4] 2> 47446 T22 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:15659/solr
[junit4] 2> 47447 T22 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 47447 T22 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 47448 T22 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 47451 T79 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@65723aee name:ZooKeeperConnection Watcher:127.0.0.1:15659 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 47452 T22 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 47453 T22 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 47457 T22 n:127.0.0.1:47798_uq_%2Ftz oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 47459 T82 n:127.0.0.1:47798_uq_%2Ftz oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@409c4443 name:ZooKeeperConnection Watcher:127.0.0.1:15659/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 47460 T22 n:127.0.0.1:47798_uq_%2Ftz oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 47468 T22 n:127.0.0.1:47798_uq_%2Ftz oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 48475 T22 n:127.0.0.1:47798_uq_%2Ftz oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47798_uq_%2Ftz
[junit4] 2> 48476 T22 n:127.0.0.1:47798_uq_%2Ftz oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:47798_uq_%2Ftz
[junit4] 2> 48481 T22 n:127.0.0.1:47798_uq_%2Ftz oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 48494 T22 n:127.0.0.1:47798_uq_%2Ftz oasc.CorePropertiesLocator.discover Looking for core definitions underneath /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.handler.TestSolrConfigHandlerConcurrent 4162C6E10C136CF4-001/shard-1-001/cores
[junit4] 2> 48501 T22 n:127.0.0.1:47798_uq_%2Ftz oasc.CoreDescriptor.<init> CORE DESCRIPTOR: {schema=schema.xml, config=solrconfig.xml, dataDir=data/, absoluteInstDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.handler.TestSolrConfigHandlerConcurrent 4162C6E10C136CF4-001/shard-1-001/cores/collection1/, instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.handler.TestSolrConfigHandlerConcurrent 4162C6E10C136CF4-001/shard-1-001/cores/collection1, transient=false, loadOnStartup=true, coreNodeName=, name=collection1, collection=collection1, shard=}
[junit4] 2> 48501 T22 n:127.0.0.1:47798_uq_%2Ftz oasc.CorePropertiesLocator.discoverUnder Found core collection1 in /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.handler.TestSolrConfigHandlerConcurrent 4162C6E10C136CF4-001/shard-1-001/cores/collection1/
[junit4] 2> 48502 T22 n:127.0.0.1:47798_uq_%2Ftz oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 48504 T83 n:127.0.0.1:47798_uq_%2Ftz c:collection1 x:collection1 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 48505 T83 n:127.0.0.1:47798_uq_%2Ftz c:collection1 x:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 48506 T83 n:127.0.0.1:47798_uq_%2Ftz oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 48506 T54 n:127.0.0.1:16532_uq_%2Ftz oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 48508 T55 n:127.0.0.1:16532_uq_%2Ftz oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "node_name":"127.0.0.1:47798_uq_%2Ftz",
[junit4] 2> "operation":"state",
[junit4] 2> "collection":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:47798/uq_/tz",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "numShards":"2"} current state version: 4
[junit4] 2> 48510 T55 n:127.0.0.1:16532_uq_%2Ftz oasco.ReplicaMutator.updateState Update state numShards=2 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "node_name":"127.0.0.1:47798_uq_%2Ftz",
[junit4] 2> "operation":"state",
[junit4] 2> "collection":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:47798/uq_/tz",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "numShards":"2"}
[junit4] 2> 48510 T55 n:127.0.0.1:16532_uq_%2Ftz oasco.ClusterStateMutator.createCollection building a new cName: collection1
[junit4] 2> 48511 T55 n:127.0.0.1:16532_uq_%2Ftz oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard1
[junit4] 2> 48514 T65 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 48514 T54 n:127.0.0.1:16532_uq_%2Ftz oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 48514 T82 n:127.0.0.1:47798_uq_%2Ftz oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 49508 T83 n:127.0.0.1:47798_uq_%2Ftz oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 49509 T83 n:127.0.0.1:47798_uq_%2Ftz oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 49510 T83 n:127.0.0.1:47798_uq_%2Ftz oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 49511 T83 n:127.0.0.1:47798_uq_%2Ftz oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 49512 T83 n:127.0.0.1:47798_uq_%2Ftz oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 49513 T83 n:127.0.0.1:47798_uq_%2Ftz oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.handler.TestSolrConfigHandlerConcurrent 4162C6E10C136CF4-001/shard-1-001/cores/collection1/'
[junit4] 2> 49532 T83 n:127.0.0.1:47798_uq_%2Ftz oasc.Config.<init> loaded config solrconfig.xml with version 0
[junit4] 2> 49551 T83 n:127.0.0.1:47798_uq_%2Ftz oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
[junit4] 2> 49577 T83 n:127.0.0.1:47798_uq_%2Ftz oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.2.0
[junit4] 2> 49635 T83 n:127.0.0.1:47798_uq_%2Ftz oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 49638 T83 n:127.0.0.1:47798_uq_%2Ftz oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 49692 T83 n:127.0.0.1:47798_uq_%2Ftz oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 50127 T83 n:127.0.0.1:47798_uq_%2Ftz oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 50149 T83 n:127.0.0.1:47798_uq_%2Ftz oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 50152 T83 n:127.0.0.1:47798_uq_%2Ftz oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 50183 T83 n:127.0.0.1:47798_uq_%2Ftz oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 50189 T83 n:127.0.0.1:47798_uq_%2Ftz oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 50195 T83 n:127.0.0.1:47798_uq_%2Ftz oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 50197 T83 n:127.0.0.1:47798_uq_%2Ftz oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 50197 T83 n:127.0.0.1:47798_uq_%2Ftz oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 50197 T83 n:127.0.0.1:47798_uq_%2Ftz oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 50199 T83 n:127.0.0.1:47798_uq_%2Ftz oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 50199 T83 n:127.0.0.1:47798_uq_%2Ftz oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 50200 T83 n:127.0.0.1:47798_uq_%2Ftz oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 50200 T83 n:127.0.0.1:47798_uq_%2Ftz x:collection1 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 50201 T83 n:127.0.0.1:47798_uq_%2Ftz x:collection1 oasc.SolrCore.<init> [[collection1] ] Opening new SolrCore at [/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.handler.TestSolrConfigHandlerConcurrent 4162C6E10C136CF4-001/shard-1-001/cores/collection1/], dataDir=[null]
[junit4] 2> 50201 T83 n:127.0.0.1:47798_uq_%2Ftz x:collection1 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3291ea21
[junit4] 2> 50203 T83 n:127.0.0.1:47798_uq_%2Ftz x:collection1 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.handler.TestSolrConfigHandlerConcurrent 4162C6E10C136CF4-001/shard-1-001/cores/collection1/data
[junit4] 2> 50203 T83 n:127.0.0.1:47798_uq_%2Ftz x:collection1 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.handler.TestSolrConfigHandlerConcurrent 4162C6E10C136CF4-001/shard-1-001/cores/collection1/data/index/
[junit4] 2> 50204 T83 n:127.0.0.1:47798_uq_%2Ftz x:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.handler.TestSolrConfigHandlerConcurrent 4162C6E10C136CF4-001/shard-1-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 50204 T83 n:127.0.0.1:47798_uq_%2Ftz x:collection1 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.handler.TestSolrConfigHandlerConcurrent 4162C6E10C136CF4-001/shard-1-001/cores/collection1/data/index
[junit4] 2> 50205 T83 n:127.0.0.1:47798_uq_%2Ftz x:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=36, maxMergeAtOnceExplicit=36, maxMergedSegmentMB=2.4912109375, floorSegmentMB=0.4375, forceMergeDeletesPctAllowed=5.391086396139415, segmentsPerTier=12.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.12452571128587407
[junit4] 2> 50206 T83 n:127.0.0.1:47798_uq_%2Ftz x:collection1 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@6d3ad41 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@331389e7),segFN=segments_1,generation=1}
[junit4] 2> 50206 T83 n:127.0.0.1:47798_uq_%2Ftz x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 50218 T83 n:127.0.0.1:47798_uq_%2Ftz x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 50219 T83 n:127.0.0.1:47798_uq_%2Ftz x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 50219 T83 n:127.0.0.1:47798_uq_%2Ftz x:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 50219 T83 n:127.0.0.1:47798_uq_%2Ftz x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 50220 T83 n:127.0.0.1:47798_uq_%2Ftz x:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 50220 T83 n:127.0.0.1:47798_uq_%2Ftz x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 50221 T83 n:127.0.0.1:47798_uq_%2Ftz x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 50221 T83 n:127.0.0.1:47798_uq_%2Ftz x:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 50222 T83 n:127.0.0.1:47798_uq_%2Ftz x:collection1 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 50244 T83 n:127.0.0.1:47798_uq_%2Ftz x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 50248 T83 n:127.0.0.1:47798_uq_%2Ftz x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 50251 T83 n:127.0.0.1:47798_uq_%2Ftz x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 50255 T83 n:127.0.0.1:47798_uq_%2Ftz x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 50288 T83 n:127.0.0.1:47798_uq_%2Ftz x:collection1 oasc.RequestHandlers.initHandlersFromConfig Registered paths: /replication,/admin/file,/admin/mbeans,/admin/properties,/get,/update/json/docs,/admin/segments,/admin/threads,/admin/logging,/config,/admin/ping,standard,/update/csv,/schema,/admin/luke,/admin/plugins,/admin/system,/update/json,/update
[junit4] 2> 50290 T83 n:127.0.0.1:47798_uq_%2Ftz x:collection1 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 50293 T83 n:127.0.0.1:47798_uq_%2Ftz x:collection1 oasu.UpdateHandler.<init> Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 50293 T83 n:127.0.0.1:47798_uq_%2Ftz x:collection1 oasu.UpdateLog.init Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10
[junit4] 2> 50296 T83 n:127.0.0.1:47798_uq_%2Ftz x:collection1 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 50297 T83 n:127.0.0.1:47798_uq_%2Ftz x:collection1 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 50298 T83 n:127.0.0.1:47798_uq_%2Ftz x:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=17, maxMergeAtOnceExplicit=46, maxMergedSegmentMB=43.025390625, floorSegmentMB=1.26953125, forceMergeDeletesPctAllowed=20.55083406130898, segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8268423730807084
[junit4] 2> 50299 T83 n:127.0.0.1:47798_uq_%2Ftz x:collection1 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@6d3ad41 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@331389e7),segFN=segments_1,generation=1}
[junit4] 2> 50300 T83 n:127.0.0.1:47798_uq_%2Ftz x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 50300 T83 n:127.0.0.1:47798_uq_%2Ftz x:collection1 oass.SolrIndexSearcher.<init> Opening Searcher@4eb78974[collection1] main
[junit4] 2> 50301 T83 n:127.0.0.1:47798_uq_%2Ftz x:collection1 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 50303 T83 n:127.0.0.1:47798_uq_%2Ftz x:collection1 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 50303 T83 n:127.0.0.1:47798_uq_%2Ftz x:collection1 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 50304 T83 n:127.0.0.1:47798_uq_%2Ftz x:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 50304 T83 n:127.0.0.1:47798_uq_%2Ftz x:collection1 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 50305 T83 n:127.0.0.1:47798_uq_%2Ftz x:collection1 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 50306 T83 n:127.0.0.1:47798_uq_%2Ftz x:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 50306 T83 n:127.0.0.1:47798_uq_%2Ftz x:collection1 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 50307 T83 n:127.0.0.1:47798_uq_%2Ftz x:collection1 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 50307 T83 n:127.0.0.1:47798_uq_%2Ftz x:collection1 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 50311 T84 n:127.0.0.1:47798_uq_%2Ftz x:collection1 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4eb78974[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 50312 T83 n:127.0.0.1:47798_uq_%2Ftz x:collection1 oasc.ZkController.getConfDirListeners watch zkdir /configs/conf1
[junit4] 2> 50314 T83 n:127.0.0.1:47798_uq_%2Ftz x:collection1 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 50315 T87 n:127.0.0.1:47798_uq_%2Ftz c:collection1 s:shard1 x:collection1 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:47798/uq_/tz collection:collection1 shard:shard1
[junit4] 2> 50316 T22 n:127.0.0.1:47798_uq_%2Ftz oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2
[junit4] 2> 50317 T22 n:127.0.0.1:47798_uq_%2Ftz oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 50318 T87 n:127.0.0.1:47798_uq_%2Ftz c:collection1 s:shard1 x:collection1 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 50329 T87 n:127.0.0.1:47798_uq_%2Ftz c:collection1 s:shard1 x:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 50333 T54 n:127.0.0.1:16532_uq_%2Ftz oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 50334 T87 n:127.0.0.1:47798_uq_%2Ftz c:collection1 s:shard1 x:collection1 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 50334 T87 n:127.0.0.1:47798_uq_%2Ftz c:collection1 s:shard1 x:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C5 name=collection1 org.apache.solr.core.SolrCore@3797aabb url=https://127.0.0.1:47798/uq_/tz/collection1 node=127.0.0.1:47798_uq_%2Ftz C5_STATE=coll:collection1 core:collection1 props:{core=collection1, node_name=127.0.0.1:47798_uq_%2Ftz, base_url=https://127.0.0.1:47798/uq_/tz, state=down}
[junit4] 2> 50335 T87 n:127.0.0.1:47798_uq_%2Ftz c:collection1 s:shard1 x:collection1 C5 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:47798/uq_/tz/collection1/
[junit4] 2> 50335 T87 n:127.0.0.1:47798_uq_%2Ftz c:collection1 s:shard1 x:collection1 C5 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 50335 T55 n:127.0.0.1:16532_uq_%2Ftz oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1"} current state version: 5
[junit4] 2> 50336 T87 n:127.0.0.1:47798_uq_%2Ftz c:collection1 s:shard1 x:collection1 C5 oasc.SyncStrategy.syncToMe https://127.0.0.1:47798/uq_/tz/collection1/ has no replicas
[junit4] 2> 50337 T87 n:127.0.0.1:47798_uq_%2Ftz c:collection1 s:shard1 x:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:47798/uq_/tz/collection1/ shard1
[junit4] 2> 50337 T87 n:127.0.0.1:47798_uq_%2Ftz c:collection1 s:shard1 x:collection1 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 50340 T82 n:127.0.0.1:47798_uq_%2Ftz oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 50340 T65 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 50340 T54 n:127.0.0.1:16532_uq_%2Ftz oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 50350 T54 n:127.0.0.1:16532_uq_%2Ftz oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 50353 T55 n:127.0.0.1:16532_uq_%2Ftz oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "base_url":"https://127.0.0.1:47798/uq_/tz",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 6
[junit4] 2> 50461 T54 n:127.0.0.1:16532_uq_%2Ftz oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 50461 T82 n:127.0.0.1:47798_uq_%2Ftz oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 50461 T65 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 50505 T87 n:127.0.0.1:47798_uq_%2Ftz c:collection1 s:shard1 x:collection1 oasc.ZkController.register We are https://127.0.0.1:47798/uq_/tz/collection1/ and leader is https://127.0.0.1:47798/uq_/tz/collection1/
[junit4] 2> 50506 T87 n:127.0.0.1:47798_uq_%2Ftz c:collection1 s:shard1 x:collection1 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:47798/uq_/tz
[junit4] 2> 50507 T87 n:127.0.0.1:47798_uq_%2Ftz c:collection1 s:shard1 x:collection1 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 50507 T87 n:127.0.0.1:47798_uq_%2Ftz c:collection1 s:shard1 x:collection1 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 50507 T87 n:127.0.0.1:47798_uq_%2Ftz c:collection1 s:shard1 x:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 50510 T54 n:127.0.0.1:16532_uq_%2Ftz oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 50513 T55 n:127.0.0.1:16532_uq_%2Ftz oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "node_name":"127.0.0.1:47798_uq_%2Ftz",
[junit4] 2> "operation":"state",
[junit4] 2> "collection":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:47798/uq_/tz",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node1"} current state version: 7
[junit4] 2> 50515 T55 n:127.0.0.1:16532_uq_%2Ftz oasco.ReplicaMutator.updateState Update state numShards=2 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "node_name":"127.0.0.1:47798_uq_%2Ftz"
[...truncated too long message...]
n.ssl.SSLSocketFactory.connectSocket(SSLSocketFactory.java:409)
[junit4] > at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:177)
[junit4] > at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:304)
[junit4] > at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:611)
[junit4] > at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:446)
[junit4] > at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
[junit4] > at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
[junit4] > at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
[junit4] > at org.apache.solr.servlet.HttpSolrCall.remoteQuery(HttpSolrCall.java:464)
[junit4] > at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:362)
[junit4] > at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:175)
[junit4] > at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:168)
[junit4] > at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
[junit4] > at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:105)
[junit4] > at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
[junit4] > at org.eclipse.jetty.servlets.UserAgentFilter.doFilter(UserAgentFilter.java:83)
[junit4] > at org.eclipse.jetty.servlets.GzipFilter.doFilter(GzipFilter.java:300)
[junit4] > at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
[junit4] > at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585)
[junit4] > at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:221)
[junit4] > at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127)
[junit4] > at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515)
[junit4] > at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
[junit4] > at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061)
[junit4] > at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
[junit4] > at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
[junit4] > at org.eclipse.jetty.server.Server.handle(Server.java:497)
[junit4] > at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:310)
[junit4] > at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:257)
[junit4] > at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:540)
[junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635)
[junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > at __randomizedtesting.SeedInfo.seed([4162C6E10C136CF4]:0)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
[junit4] > 1) Thread[id=207, name=qtp207074561-207, state=RUNNABLE, group=TGRP-TestSolrConfigHandlerConcurrent]
[junit4] > at java.net.PlainSocketImpl.socketConnect(Native Method)
[junit4] > at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
[junit4] > at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
[junit4] > at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
[junit4] > at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
[junit4] > at java.net.Socket.connect(Socket.java:579)
[junit4] > at sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:618)
[junit4] > at org.apache.http.conn.ssl.SSLSocketFactory.connectSocket(SSLSocketFactory.java:532)
[junit4] > at org.apache.http.conn.ssl.SSLSocketFactory.connectSocket(SSLSocketFactory.java:409)
[junit4] > at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:177)
[junit4] > at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:304)
[junit4] > at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:611)
[junit4] > at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:446)
[junit4] > at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
[junit4] > at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
[junit4] > at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
[junit4] > at org.apache.solr.servlet.HttpSolrCall.remoteQuery(HttpSolrCall.java:464)
[junit4] > at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:362)
[junit4] > at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:175)
[junit4] > at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:168)
[junit4] > at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
[junit4] > at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:105)
[junit4] > at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
[junit4] > at org.eclipse.jetty.servlets.UserAgentFilter.doFilter(UserAgentFilter.java:83)
[junit4] > at org.eclipse.jetty.servlets.GzipFilter.doFilter(GzipFilter.java:300)
[junit4] > at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
[junit4] > at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585)
[junit4] > at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:221)
[junit4] > at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127)
[junit4] > at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515)
[junit4] > at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
[junit4] > at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061)
[junit4] > at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
[junit4] > at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
[junit4] > at org.eclipse.jetty.server.Server.handle(Server.java:497)
[junit4] > at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:310)
[junit4] > at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:257)
[junit4] > at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:540)
[junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635)
[junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > at __randomizedtesting.SeedInfo.seed([4162C6E10C136CF4]:0)
[junit4] Completed [22/488] on J2 in 112.35s, 1 test, 2 errors <<< FAILURES!
[...truncated 1445 lines...]
BUILD FAILED
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/build.xml:536: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/build.xml:484: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/build.xml:61: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/extra-targets.xml:39: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build.xml:229: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/common-build.xml:511: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/lucene/common-build.xml:1433: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/lucene/common-build.xml:991: There were test failures: 488 suites, 1958 tests, 2 suite-level errors, 1124 ignored (19 assumptions)
Total time: 44 minutes 42 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Sending artifact delta relative to Lucene-Solr-Tests-5.x-Java7 #3107
Archived 5 artifacts
Archive block size is 32768
Received 0 blocks and 89027961 bytes
Compression is 0.0%
Took 17 sec
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure