You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2015/05/12 03:17:26 UTC
[JENKINS] Lucene-Solr-Tests-5.x-Java7 - Build # 3102 - Failure
Build: https://builds.apache.org/job/Lucene-Solr-Tests-5.x-Java7/3102/
1 tests failed.
REGRESSION: org.apache.solr.cloud.RecoveryZkTest.test
Error Message:
shard1 is not consistent. Got 917 from http://127.0.0.1:46312/_dok/ja/collection1lastClient and got 245 from http://127.0.0.1:46324/_dok/ja/collection1
Stack Trace:
java.lang.AssertionError: shard1 is not consistent. Got 917 from http://127.0.0.1:46312/_dok/ja/collection1lastClient and got 245 from http://127.0.0.1:46324/_dok/ja/collection1
at __randomizedtesting.SeedInfo.seed([70695C437378C6C8:F83D6399DD84AB30]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.RecoveryZkTest.test(RecoveryZkTest.java:123)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:960)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:935)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 10310 lines...]
[junit4] Suite: org.apache.solr.cloud.RecoveryZkTest
[junit4] 2> Creating dataDir: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.RecoveryZkTest 70695C437378C6C8-001/init-core-data-001
[junit4] 2> 1525469 T9348 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (false)
[junit4] 2> 1525471 T9348 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /_dok/ja
[junit4] 2> 1525481 T9348 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 1525482 T9349 oasc.ZkTestServer$2$1.setClientPort client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1525483 T9349 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 1525582 T9348 oasc.ZkTestServer.run start zk server on port:46292
[junit4] 2> 1525583 T9348 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1525584 T9348 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1525587 T9356 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@20536a4b name:ZooKeeperConnection Watcher:127.0.0.1:46292 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1525587 T9348 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1525588 T9348 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1525588 T9348 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 1525591 T9348 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1525591 T9348 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1525593 T9359 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b8dc6f name:ZooKeeperConnection Watcher:127.0.0.1:46292/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1525593 T9348 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1525593 T9348 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1525593 T9348 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 1525595 T9348 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 1525597 T9348 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 1525597 T9348 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 1525599 T9348 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1525599 T9348 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 1525601 T9348 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 1525601 T9348 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 1525703 T9348 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1525703 T9348 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1525705 T9348 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1525705 T9348 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 1525706 T9348 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1525707 T9348 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 1525708 T9348 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1525708 T9348 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 1525710 T9348 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 1525710 T9348 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 1525711 T9348 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1525712 T9348 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 1525713 T9348 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1525713 T9348 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1525715 T9348 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1525715 T9348 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 1525716 T9348 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1525717 T9348 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 1526697 T9348 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.RecoveryZkTest 70695C437378C6C8-001/control-001/cores/collection1
[junit4] 2> 1526700 T9348 oejs.Server.doStart jetty-9.2.10.v20150310
[junit4] 2> 1526702 T9348 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@4be4f5fa{/_dok/ja,null,AVAILABLE}
[junit4] 2> 1526706 T9348 oejs.AbstractConnector.doStart Started ServerConnector@1b3dd8d7{HTTP/1.1}{127.0.0.1:46297}
[junit4] 2> 1526706 T9348 oejs.Server.doStart Started @1534962ms
[junit4] 2> 1526706 T9348 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {solr.data.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.RecoveryZkTest 70695C437378C6C8-001/tempDir-001/control/data, hostContext=/_dok/ja, coreRootDirectory=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.RecoveryZkTest 70695C437378C6C8-001/control-001/cores, hostPort=46297}
[junit4] 2> 1526707 T9348 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@57bd06bf
[junit4] 2> 1526707 T9348 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.RecoveryZkTest 70695C437378C6C8-001/control-001/'
[junit4] 2> 1526740 T9348 oasc.SolrXmlConfig.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.RecoveryZkTest 70695C437378C6C8-001/control-001/solr.xml
[junit4] 2> 1526777 T9348 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.RecoveryZkTest 70695C437378C6C8-001/control-001/cores
[junit4] 2> 1526778 T9348 oasc.CoreContainer.<init> New CoreContainer 1442603642
[junit4] 2> 1526778 T9348 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.RecoveryZkTest 70695C437378C6C8-001/control-001/]
[junit4] 2> 1526778 T9348 oasc.CoreContainer.load loading shared library: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.RecoveryZkTest 70695C437378C6C8-001/control-001/lib
[junit4] 2> 1526779 T9348 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.RecoveryZkTest 70695C437378C6C8-001/control-001/lib).
[junit4] 2> 1526788 T9348 oashc.HttpShardHandlerFactory.init created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 1526793 T9348 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1526794 T9348 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1526794 T9348 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1526794 T9348 oasc.CoreContainer.load Node Name: 127.0.0.1
[junit4] 2> 1526794 T9348 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:46292/solr
[junit4] 2> 1526795 T9348 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1526795 T9348 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1526795 T9348 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1526797 T9373 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@11af4de8 name:ZooKeeperConnection Watcher:127.0.0.1:46292 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1526797 T9348 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1526798 T9348 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1526800 T9348 n:127.0.0.1:46297__dok%2Fja oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1526801 T9376 n:127.0.0.1:46297__dok%2Fja oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4d372734 name:ZooKeeperConnection Watcher:127.0.0.1:46292/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1526801 T9348 n:127.0.0.1:46297__dok%2Fja oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1526803 T9348 n:127.0.0.1:46297__dok%2Fja oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 1526805 T9348 n:127.0.0.1:46297__dok%2Fja oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 1526806 T9348 n:127.0.0.1:46297__dok%2Fja oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 1526808 T9348 n:127.0.0.1:46297__dok%2Fja oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 1526809 T9348 n:127.0.0.1:46297__dok%2Fja oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 1526811 T9348 n:127.0.0.1:46297__dok%2Fja oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 1526812 T9348 n:127.0.0.1:46297__dok%2Fja oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 1526813 T9348 n:127.0.0.1:46297__dok%2Fja oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 1526814 T9348 n:127.0.0.1:46297__dok%2Fja oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46297__dok%2Fja
[junit4] 2> 1526814 T9348 n:127.0.0.1:46297__dok%2Fja oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:46297__dok%2Fja
[junit4] 2> 1526815 T9348 n:127.0.0.1:46297__dok%2Fja oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 1526816 T9348 n:127.0.0.1:46297__dok%2Fja oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 1526817 T9348 n:127.0.0.1:46297__dok%2Fja oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 1526818 T9348 n:127.0.0.1:46297__dok%2Fja oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:46297__dok%2Fja
[junit4] 2> 1526819 T9348 n:127.0.0.1:46297__dok%2Fja oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 1526820 T9348 n:127.0.0.1:46297__dok%2Fja oasc.Overseer.start Overseer (id=93807640987828227-127.0.0.1:46297__dok%2Fja-n_0000000000) starting
[junit4] 2> 1526821 T9348 n:127.0.0.1:46297__dok%2Fja oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 1526827 T9348 n:127.0.0.1:46297__dok%2Fja oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 1526828 T9378 n:127.0.0.1:46297__dok%2Fja oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 1526828 T9348 n:127.0.0.1:46297__dok%2Fja oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1526829 T9377 n:127.0.0.1:46297__dok%2Fja oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 1526832 T9348 n:127.0.0.1:46297__dok%2Fja oasc.CorePropertiesLocator.discover Looking for core definitions underneath /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.RecoveryZkTest 70695C437378C6C8-001/control-001/cores
[junit4] 2> 1526834 T9348 n:127.0.0.1:46297__dok%2Fja oasc.CoreDescriptor.<init> CORE DESCRIPTOR: {collection=control_collection, config=solrconfig.xml, loadOnStartup=true, instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.RecoveryZkTest 70695C437378C6C8-001/control-001/cores/collection1, coreNodeName=, absoluteInstDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.RecoveryZkTest 70695C437378C6C8-001/control-001/cores/collection1/, name=collection1, transient=false, dataDir=data/, shard=, schema=schema.xml}
[junit4] 2> 1526834 T9348 n:127.0.0.1:46297__dok%2Fja oasc.CorePropertiesLocator.discoverUnder Found core collection1 in /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.RecoveryZkTest 70695C437378C6C8-001/control-001/cores/collection1/
[junit4] 2> 1526834 T9348 n:127.0.0.1:46297__dok%2Fja oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1526835 T9380 n:127.0.0.1:46297__dok%2Fja c:control_collection x:collection1 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
[junit4] 2> 1526835 T9380 n:127.0.0.1:46297__dok%2Fja c:control_collection x:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1526836 T9380 n:127.0.0.1:46297__dok%2Fja oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1526836 T9376 n:127.0.0.1:46297__dok%2Fja oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1526837 T9377 n:127.0.0.1:46297__dok%2Fja oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:46297/_dok/ja",
[junit4] 2> "core":"collection1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "node_name":"127.0.0.1:46297__dok%2Fja",
[junit4] 2> "operation":"state",
[junit4] 2> "numShards":"1",
[junit4] 2> "shard":null,
[junit4] 2> "state":"down"} current state version: 0
[junit4] 2> 1526837 T9377 n:127.0.0.1:46297__dok%2Fja oasco.ReplicaMutator.updateState Update state numShards=1 message={
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:46297/_dok/ja",
[junit4] 2> "core":"collection1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "node_name":"127.0.0.1:46297__dok%2Fja",
[junit4] 2> "operation":"state",
[junit4] 2> "numShards":"1",
[junit4] 2> "shard":null,
[junit4] 2> "state":"down"}
[junit4] 2> 1526837 T9377 n:127.0.0.1:46297__dok%2Fja oasco.ClusterStateMutator.createCollection building a new cName: control_collection
[junit4] 2> 1526838 T9377 n:127.0.0.1:46297__dok%2Fja oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard1
[junit4] 2> 1526839 T9376 n:127.0.0.1:46297__dok%2Fja oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1527836 T9380 n:127.0.0.1:46297__dok%2Fja oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1527837 T9380 n:127.0.0.1:46297__dok%2Fja oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 1527837 T9380 n:127.0.0.1:46297__dok%2Fja oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1527837 T9380 n:127.0.0.1:46297__dok%2Fja oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 1527838 T9380 n:127.0.0.1:46297__dok%2Fja oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1527838 T9380 n:127.0.0.1:46297__dok%2Fja oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.RecoveryZkTest 70695C437378C6C8-001/control-001/cores/collection1/'
[junit4] 2> 1527852 T9380 n:127.0.0.1:46297__dok%2Fja oasc.Config.<init> loaded config solrconfig.xml with version 0
[junit4] 2> 1527860 T9380 n:127.0.0.1:46297__dok%2Fja oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
[junit4] 2> 1527876 T9380 n:127.0.0.1:46297__dok%2Fja oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.2.0
[junit4] 2> 1527913 T9380 n:127.0.0.1:46297__dok%2Fja oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1528014 T9380 n:127.0.0.1:46297__dok%2Fja oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 1528020 T9380 n:127.0.0.1:46297__dok%2Fja oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1528278 T9380 n:127.0.0.1:46297__dok%2Fja oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1528281 T9380 n:127.0.0.1:46297__dok%2Fja oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1528282 T9380 n:127.0.0.1:46297__dok%2Fja oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1528285 T9380 n:127.0.0.1:46297__dok%2Fja oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1528296 T9380 n:127.0.0.1:46297__dok%2Fja oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 1528296 T9380 n:127.0.0.1:46297__dok%2Fja x:collection1 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1528297 T9380 n:127.0.0.1:46297__dok%2Fja x:collection1 oasc.SolrCore.<init> [[collection1] ] Opening new SolrCore at [/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.RecoveryZkTest 70695C437378C6C8-001/control-001/cores/collection1/], dataDir=[null]
[junit4] 2> 1528297 T9380 n:127.0.0.1:46297__dok%2Fja x:collection1 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4dff61ca
[junit4] 2> 1528298 T9380 n:127.0.0.1:46297__dok%2Fja x:collection1 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.RecoveryZkTest 70695C437378C6C8-001/control-001/cores/collection1/data
[junit4] 2> 1528298 T9380 n:127.0.0.1:46297__dok%2Fja x:collection1 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.RecoveryZkTest 70695C437378C6C8-001/control-001/cores/collection1/data/index/
[junit4] 2> 1528298 T9380 n:127.0.0.1:46297__dok%2Fja x:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.RecoveryZkTest 70695C437378C6C8-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1528298 T9380 n:127.0.0.1:46297__dok%2Fja x:collection1 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.RecoveryZkTest 70695C437378C6C8-001/control-001/cores/collection1/data/index
[junit4] 2> 1528299 T9380 n:127.0.0.1:46297__dok%2Fja x:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=50, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 1528299 T9380 n:127.0.0.1:46297__dok%2Fja x:collection1 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@dc13879 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@86296fd),segFN=segments_1,generation=1}
[junit4] 2> 1528300 T9380 n:127.0.0.1:46297__dok%2Fja x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1528303 T9380 n:127.0.0.1:46297__dok%2Fja x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1528304 T9380 n:127.0.0.1:46297__dok%2Fja x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1528304 T9380 n:127.0.0.1:46297__dok%2Fja x:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1528304 T9380 n:127.0.0.1:46297__dok%2Fja x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1528304 T9380 n:127.0.0.1:46297__dok%2Fja x:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1528304 T9380 n:127.0.0.1:46297__dok%2Fja x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1528305 T9380 n:127.0.0.1:46297__dok%2Fja x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1528305 T9380 n:127.0.0.1:46297__dok%2Fja x:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1528305 T9380 n:127.0.0.1:46297__dok%2Fja x:collection1 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1528324 T9380 n:127.0.0.1:46297__dok%2Fja x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1528326 T9380 n:127.0.0.1:46297__dok%2Fja x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1528327 T9380 n:127.0.0.1:46297__dok%2Fja x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1528329 T9380 n:127.0.0.1:46297__dok%2Fja x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1528332 T9380 n:127.0.0.1:46297__dok%2Fja x:collection1 oasc.RequestHandlers.initHandlersFromConfig Registered paths: /update/json,/admin/file,/admin/logging,/admin/mbeans,/get,/config,/admin/threads,/update/csv,/admin/system,/admin/ping,/admin/segments,/replication,/update,standard,/admin/luke,/admin/plugins,/schema,/admin/properties,/update/json/docs
[junit4] 2> 1528334 T9380 n:127.0.0.1:46297__dok%2Fja x:collection1 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 1528336 T9380 n:127.0.0.1:46297__dok%2Fja x:collection1 oasu.UpdateHandler.<init> Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1528336 T9380 n:127.0.0.1:46297__dok%2Fja x:collection1 oasu.UpdateLog.init Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10
[junit4] 2> 1528337 T9380 n:127.0.0.1:46297__dok%2Fja x:collection1 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1528338 T9380 n:127.0.0.1:46297__dok%2Fja x:collection1 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1528338 T9380 n:127.0.0.1:46297__dok%2Fja x:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=49, maxMergeAtOnceExplicit=38, maxMergedSegmentMB=37.1484375, floorSegmentMB=1.1083984375, forceMergeDeletesPctAllowed=8.250284646858772, segmentsPerTier=39.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.11590379808613305
[junit4] 2> 1528338 T9380 n:127.0.0.1:46297__dok%2Fja x:collection1 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@dc13879 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@86296fd),segFN=segments_1,generation=1}
[junit4] 2> 1528339 T9380 n:127.0.0.1:46297__dok%2Fja x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1528339 T9380 n:127.0.0.1:46297__dok%2Fja x:collection1 oass.SolrIndexSearcher.<init> Opening Searcher@388a6677[collection1] main
[junit4] 2> 1528339 T9380 n:127.0.0.1:46297__dok%2Fja x:collection1 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 1528340 T9380 n:127.0.0.1:46297__dok%2Fja x:collection1 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1528340 T9380 n:127.0.0.1:46297__dok%2Fja x:collection1 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 1528340 T9380 n:127.0.0.1:46297__dok%2Fja x:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1528340 T9380 n:127.0.0.1:46297__dok%2Fja x:collection1 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 1528341 T9380 n:127.0.0.1:46297__dok%2Fja x:collection1 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1528341 T9380 n:127.0.0.1:46297__dok%2Fja x:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 1528341 T9380 n:127.0.0.1:46297__dok%2Fja x:collection1 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1528341 T9380 n:127.0.0.1:46297__dok%2Fja x:collection1 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 1528341 T9380 n:127.0.0.1:46297__dok%2Fja x:collection1 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 1528342 T9380 n:127.0.0.1:46297__dok%2Fja x:collection1 oasc.ZkController.getConfDirListeners watch zkdir /configs/conf1
[junit4] 2> 1528342 T9381 n:127.0.0.1:46297__dok%2Fja x:collection1 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@388a6677[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1528342 T9380 n:127.0.0.1:46297__dok%2Fja x:collection1 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1528343 T9384 n:127.0.0.1:46297__dok%2Fja c:control_collection s:shard1 x:collection1 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:46297/_dok/ja collection:control_collection shard:shard1
[junit4] 2> 1528343 T9348 n:127.0.0.1:46297__dok%2Fja oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1
[junit4] 2> 1528344 T9348 n:127.0.0.1:46297__dok%2Fja oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1528344 T9384 n:127.0.0.1:46297__dok%2Fja c:control_collection s:shard1 x:collection1 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 1528345 T9348 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1528346 T9348 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1528347 T9384 n:127.0.0.1:46297__dok%2Fja c:control_collection s:shard1 x:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 1528347 T9387 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@166b0e61 name:ZooKeeperConnection Watcher:127.0.0.1:46292/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1528347 T9348 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1528348 T9348 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1528348 T9348 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1528349 T9376 n:127.0.0.1:46297__dok%2Fja oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1528349 T9384 n:127.0.0.1:46297__dok%2Fja c:control_collection s:shard1 x:collection1 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 1528349 T9384 n:127.0.0.1:46297__dok%2Fja c:control_collection s:shard1 x:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C2970 name=collection1 org.apache.solr.core.SolrCore@6f0daece url=http://127.0.0.1:46297/_dok/ja/collection1 node=127.0.0.1:46297__dok%2Fja C2970_STATE=coll:control_collection core:collection1 props:{base_url=http://127.0.0.1:46297/_dok/ja, core=collection1, node_name=127.0.0.1:46297__dok%2Fja, state=down}
[junit4] 2> 1528349 T9384 n:127.0.0.1:46297__dok%2Fja c:control_collection s:shard1 x:collection1 C2970 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:46297/_dok/ja/collection1/
[junit4] 2> 1528349 T9377 n:127.0.0.1:46297__dok%2Fja oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state version: 1
[junit4] 2> 1528350 T9384 n:127.0.0.1:46297__dok%2Fja c:control_collection s:shard1 x:collection1 C2970 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 1528350 T9384 n:127.0.0.1:46297__dok%2Fja c:control_collection s:shard1 x:collection1 C2970 oasc.SyncStrategy.syncToMe http://127.0.0.1:46297/_dok/ja/collection1/ has no replicas
[junit4] 2> 1528350 T9384 n:127.0.0.1:46297__dok%2Fja c:control_collection s:shard1 x:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:46297/_dok/ja/collection1/ shard1
[junit4] 2> 1528350 T9384 n:127.0.0.1:46297__dok%2Fja c:control_collection s:shard1 x:collection1 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 1528351 T9348 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 1528351 T9376 n:127.0.0.1:46297__dok%2Fja oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1528351 T9387 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1528351 T9348 oasc.AbstractFullDistribZkTestBase.createJettys Creating collection1 with stateFormat=2
[junit4] 2> 1528352 T9348 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1528352 T9348 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1528354 T9390 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2f23f51c name:ZooKeeperConnection Watcher:127.0.0.1:46292/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1528354 T9348 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1528354 T9376 n:127.0.0.1:46297__dok%2Fja oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1528354 T9348 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1528355 T9377 n:127.0.0.1:46297__dok%2Fja oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:46297/_dok/ja",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 2
[junit4] 2> 1528357 T9377 n:127.0.0.1:46297__dok%2Fja oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"create",
[junit4] 2> "name":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "stateFormat":"2"} current state version: 2
[junit4] 2> 1528357 T9377 n:127.0.0.1:46297__dok%2Fja oasco.ClusterStateMutator.createCollection building a new cName: collection1
[junit4] 2> 1528357 T9376 n:127.0.0.1:46297__dok%2Fja oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1528357 T9387 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1528359 T9376 n:127.0.0.1:46297__dok%2Fja oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1528360 T9377 n:127.0.0.1:46297__dok%2Fja oasco.ZkStateWriter.writePendingUpdates going to create_collection /collections/collection1/state.json
[junit4] 2> 1528360 T9387 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1528360 T9376 n:127.0.0.1:46297__dok%2Fja oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1528405 T9384 n:127.0.0.1:46297__dok%2Fja c:control_collection s:shard1 x:collection1 oasc.ZkController.register We are http://127.0.0.1:46297/_dok/ja/collection1/ and leader is http://127.0.0.1:46297/_dok/ja/collection1/
[junit4] 2> 1528406 T9384 n:127.0.0.1:46297__dok%2Fja c:control_collection s:shard1 x:collection1 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:46297/_dok/ja
[junit4] 2> 1528406 T9384 n:127.0.0.1:46297__dok%2Fja c:control_collection s:shard1 x:collection1 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 1528406 T9384 n:127.0.0.1:46297__dok%2Fja c:control_collection s:shard1 x:collection1 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
[junit4] 2> 1528406 T9384 n:127.0.0.1:46297__dok%2Fja c:control_collection s:shard1 x:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1528407 T9376 n:127.0.0.1:46297__dok%2Fja oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1528408 T9377 n:127.0.0.1:46297__dok%2Fja oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:46297/_dok/ja",
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "node_name":"127.0.0.1:46297__dok%2Fja",
[junit4] 2> "operation":"state",
[junit4] 2> "numShards":"1",
[junit4] 2> "shard":"shard1",
[junit4] 2> "state":"active"} current state version: 4
[junit4] 2> 1528408 T9377 n:127.0.0.1:46297__dok%2Fja oasco.ReplicaMutator.updateState Update state numShards=1 message={
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:46297/_dok/ja",
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "node_name":"127.0.0.1:46297__dok%2Fja",
[junit4] 2> "operation":"state",
[junit4] 2> "numShards":"1",
[junit4] 2> "shard":"shard1",
[junit4] 2> "state":"active"}
[junit4] 2> 1528511 T9387 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1528511 T9376 n:127.0.0.1:46297__dok%2Fja oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1529623 T9348 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.RecoveryZkTest 70695C437378C6C8-001/shard-1-001/cores/collection1
[junit4] 2> 1529625 T9348 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1 in directory /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.RecoveryZkTest 70695C437378C6C8-001/shard-1-001
[junit4] 2> 1529626 T9348 oejs.Server.doStart jetty-9.2.10.v20150310
[junit4] 2> 1529628 T9348 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@2f9dcd0{/_dok/ja,null,AVAILABLE}
[junit4] 2> 1529629 T9348 oejs.AbstractConnector.doStart Started ServerConnector@7f843685{HTTP/1.1}{127.0.0.1:46312}
[junit4] 2> 1529629 T9348 oejs.Server.doStart Started @1537885ms
[junit4] 2> 1529629 T9348 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {hostContext=/_dok/ja, solrconfig=solrconfig.xml, hostPort=46312, solr.data.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.RecoveryZkTest 70695C437378C6C8-001/tempDir-001/jetty1, coreRootDirectory=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.RecoveryZkTest 70695C437378C6C8-001/shard-1-001/cores}
[junit4] 2> 1529629 T9348 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@57bd06bf
[junit4] 2> 1529630 T9348 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.RecoveryZkTest 70695C437378C6C8-001/shard-1-001/'
[junit4] 2> 1529663 T9348 oasc.SolrXmlConfig.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.RecoveryZkTest 70695C437378C6C8-001/shard-1-001/solr.xml
[junit4] 2> 1529703 T9348 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.RecoveryZkTest 70695C437378C6C8-001/shard-1-001/cores
[junit4] 2> 1529704 T9348 oasc.CoreContainer.<init> New CoreContainer 1107051012
[junit4] 2> 1529704 T9348 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.RecoveryZkTest 70695C437378C6C8-001/shard-1-001/]
[junit4] 2> 1529704 T9348 oasc.CoreContainer.load loading shared library: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.RecoveryZkTest 70695C437378C6C8-001/shard-1-001/lib
[junit4] 2> 1529705 T9348 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.RecoveryZkTest 70695C437378C6C8-001/shard-1-001/lib).
[junit4] 2> 1529713 T9348 oashc.HttpShardHandlerFactory.init created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 1529719 T9348 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1529720 T9348 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1529720 T9348 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1529720 T9348 oasc.CoreContainer.load Node Name: 127.0.0.1
[junit4] 2> 1529720 T9348 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:46292/solr
[junit4] 2> 1529721 T9348 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1529721 T9348 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1529721 T9348 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1529723 T9404 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@453086b7 name:ZooKeeperConnection Watcher:127.0.0.1:46292 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1529723 T9348 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1529723 T9348 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1529726 T9348 n:127.0.0.1:46312__dok%2Fja oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1529727 T9407 n:127.0.0.1:46312__dok%2Fja oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@719c3dc name:ZooKeeperConnection Watcher:127.0.0.1:46292/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1529727 T9348 n:127.0.0.1:46312__dok%2Fja oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1529731 T9348 n:127.0.0.1:46312__dok%2Fja oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1530735 T9348 n:127.0.0.1:46312__dok%2Fja oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46312__dok%2Fja
[junit4] 2> 1530736 T9348 n:127.0.0.1:46312__dok%2Fja oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:46312__dok%2Fja
[junit4] 2> 1530739 T9348 n:127.0.0.1:46312__dok%2Fja oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 1530740 T9348 n:127.0.0.1:46312__dok%2Fja oasc.CorePropertiesLocator.discover Looking for core definitions underneath /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.RecoveryZkTest 70695C437378C6C8-001/shard-1-001/cores
[junit4] 2> 1530743 T9348 n:127.0.0.1:46312__dok%2Fja oasc.CoreDescriptor.<init> CORE DESCRIPTOR: {collection=collection1, absoluteInstDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.RecoveryZkTest 70695C437378C6C8-001/shard-1-001/cores/collection1/, loadOnStartup=true, transient=false, name=collection1, config=solrconfig.xml, schema=schema.xml, dataDir=data/, instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.RecoveryZkTest 70695C437378C6C8-001/shard-1-001/cores/collection1, shard=, coreNodeName=}
[junit4] 2> 1530743 T9348 n:127.0.0.1:46312__dok%2Fja oasc.CorePropertiesLocator.discoverUnder Found core collection1 in /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.RecoveryZkTest 70695C437378C6C8-001/shard-1-001/cores/collection1/
[junit4] 2> 1530743 T9348 n:127.0.0.1:46312__dok%2Fja oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1530745 T9408 n:127.0.0.1:46312__dok%2Fja c:collection1 x:collection1 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 1530745 T9408 n:127.0.0.1:46312__dok%2Fja c:collection1 x:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1530746 T9376 n:127.0.0.1:46297__dok%2Fja oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1530746 T9408 n:127.0.0.1:46312__dok%2Fja oasc.ZkController.preRegister Registering watch for external collection collection1
[junit4] 2> 1530747 T9408 n:127.0.0.1:46312__dok%2Fja oascc.ZkStateReader.addZkWatch addZkWatch collection1
[junit4] 2> 1530747 T9377 n:127.0.0.1:46297__dok%2Fja oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:46312/_dok/ja",
[junit4] 2> "core":"collection1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "node_name":"127.0.0.1:46312__dok%2Fja",
[junit4] 2> "operation":"state",
[junit4] 2> "numShards":"1",
[junit4] 2> "shard":null,
[junit4] 2> "state":"down"} current state version: 5
[junit4] 2> 1530747 T9408 n:127.0.0.1:46312__dok%2Fja oascc.ZkStateReader.addZkWatch Updating collection state at /collections/collection1/state.json from ZooKeeper...
[junit4] 2> 1530747 T9377 n:127.0.0.1:46297__dok%2Fja oasco.ReplicaMutator.updateState Update state numShards=1 message={
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:46312/_dok/ja",
[junit4] 2> "core":"collection1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "node_name":"127.0.0.1:46312__dok%2Fja",
[junit4] 2> "operation":"state",
[junit4] 2> "numShards":"1",
[junit4] 2> "shard":null,
[junit4] 2> "state":"down"}
[junit4] 2> 1530748 T9377 n:127.0.0.1:46297__dok%2Fja oasco.ReplicaMutator.updateState Collection already exists with numShards=1
[junit4] 2> 1530748 T9377 n:127.0.0.1:46297__dok%2Fja oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard1
[junit4] 2> 1530748 T9408 n:127.0.0.1:46312__dok%2Fja oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 0
[junit4] 2> 1530748 T9408 n:127.0.0.1:46312__dok%2Fja oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1530749 T9377 n:127.0.0.1:46297__dok%2Fja oasco.ZkStateWriter.writePendingUpdates going to update_collection /collections/collection1/state.json version: 0
[junit4] 2> 1530749 T9407 n:127.0.0.1:46312__dok%2Fja oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json for collection collection1 has occurred - updating... (live nodes size: 2)
[junit4] 2> 1530750 T9407 n:127.0.0.1:46312__dok%2Fja oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 1
[junit4] 2> 1531748 T9408 n:127.0.0.1:46312__dok%2Fja oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1531749 T9408 n:127.0.0.1:46312__dok%2Fja oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 1531749 T9408 n:127.0.0.1:46312__dok%2Fja oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1531749 T9408 n:127.0.0.1:46312__dok%2Fja oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1531750 T9408 n:127.0.0.1:46312__dok%2Fja oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1531750 T9408 n:127.0.0.1:46312__dok%2Fja oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.RecoveryZkTest 70695C437378C6C8-001/shard-1-001/cores/collection1/'
[junit4] 2> 1531766 T9408 n:127.0.0.1:46312__dok%2Fja oasc.Config.<init> loaded config solrconfig.xml with version 0
[junit4] 2> 1531775 T9408 n:127.0.0.1:46312__dok%2Fja oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
[junit4] 2> 1531793 T9408 n:127.0.0.1:46312__dok%2Fja oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.2.0
[junit4] 2> 1531833 T9408 n:127.0.0.1:46312__dok%2Fja oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1531934 T9408 n:127.0.0.1:46312__dok%2Fja oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 1531942 T9408 n:127.0.0.1:46312__dok%2Fja oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1532318 T9408 n:127.0.0.1:46312__dok%2Fja oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1532321 T9408 n:127.0.0.1:46312__dok%2Fja oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1532323 T9408 n:127.0.0.1:46312__dok%2Fja oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1532327 T9408 n:127.0.0.1:46312__dok%2Fja oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1532343 T9408 n:127.0.0.1:46312__dok%2Fja oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 1532344 T9408 n:127.0.0.1:46312__dok%2Fja x:collection1 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1532344 T9408 n:127.0.0.1:46312__dok%2Fja x:collection1 oasc.SolrCore.<init> [[collection1] ] Opening new SolrCore at [/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.RecoveryZkTest 70695C437378C6C8-001/shard-1-001/cores/collection1/], dataDir=[null]
[junit4] 2> 1532344 T9408 n:127.0.0.1:46312__dok%2Fja x:collection1 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4dff61ca
[junit4] 2> 1532345 T9408 n:127.0.0.1:46312__dok%2Fja x:collection1 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.RecoveryZkTest 70695C437378C6C8-001/shard-1-001/cores/collection1/data
[junit4] 2> 1532345 T9408 n:127.0.0.1:46312__dok%2Fja x:collection1 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.RecoveryZkTest 70695C437378C6C8-001/shard-1-001/cores/collection1/data/index/
[junit4] 2> 1532346 T9408 n:127.0.0.1:46312__dok%2Fja x:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.RecoveryZkTest 70695C437378C6C8-001/shard-1-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1532346 T9408 n:127.0.0.1:46312__dok%2Fja x:collection1 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.RecoveryZkTest 70695C437378C6C8-001/shard-1-001/cores/collection1/data/index
[junit4] 2> 1532347 T9408 n:127.0.0.1:46312__dok%2Fja x:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=50, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 1532348 T9408 n:127.0.0.1:46312__dok%2Fja x:collection1 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@6134099e lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1f6395ed),segFN=segments_1,generation=1}
[junit4] 2> 1532348 T9408 n:127.0.0.1:46312__dok%2Fja x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1532354 T9408 n:127.0.0.1:46312__dok%2Fja x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1532355 T9408 n:127.0.0.1:46312__dok%2Fja x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1532355 T9408 n:127.0.0.1:46312__dok%2Fja x:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1532355 T9408 n:127.0.0.1:46312__dok%2Fja x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1532356 T9408 n:127.0.0.1:46312__dok%2Fja x:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1532356 T9408 n:127.0.0.1:46312__dok%2Fja x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1532356 T9408 n:127.0.0.1:46312__dok%2Fja x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1532357 T9408 n:127.0.0.1:46312__dok%2Fja x:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1532357 T9408 n:127.0.0.1:46312__dok%2Fja x:collection1 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1532378 T9408 n:127.0.0.1:46312__dok%2Fja x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1532381 T9408 n:127.0.0.1:46312__dok%2Fja x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1532384 T9408 n:127.0.0.1:46312__dok%2Fja x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1532386 T9408 n:127.0.0.1:46312__dok%2Fja x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1532395 T9408 n:127.0.0.1:46312__dok%2Fja x:collection1 oasc.RequestHandlers.initHandlersFromConfig Registered paths: /update/json,/admin/file,/admin/logging,/admin/mbeans,/get,/config,/admin/threads,/update/csv,/admin/system,/admin/ping,/admin/segments,/replication,/update,standard,/admin/luke,/admin/plugins,/schema,/admin/properties,/update/json/docs
[junit4] 2> 1532397 T9408 n:127.0.0.1:46312__dok%2Fja x:collection1 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 1532399 T9408 n:127.0.0.1:46312__dok%2Fja x:collection1 oasu.UpdateHandler.<init> Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1532399 T9408 n:127.0.0.1:46312__dok%2Fja x:collection1 oasu.UpdateLog.init Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10
[junit4] 2> 1532401 T9408 n:127.0.0.1:46312__dok%2Fja x:collection1 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1532401 T9408 n:127.0.0.1:46312__dok%2Fja x:collection1 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1532402 T9408 n:127.0.0.1:46312__dok%2Fja x:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=49, maxMergeAtOnceExplicit=38, maxMergedSegmentMB=37.1484375, floorSegmentMB=1.1083984375, forceMergeDeletesPctAllowed=8.250284646858772, segmentsPerTier=39.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.11590379808613305
[junit4] 2> 1532403 T9408 n:127.0.0.1:46312__dok%2Fja x:collection1 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@6134099e lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1f6395ed),segFN=segments_1,generation=1}
[junit4] 2> 1532403 T9408 n:127.0.0.1:46312__dok%2Fja x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1532404 T9408 n:127.0.0.1:46312__dok%2Fja x:collection1 oass.SolrIndexSearcher.<init> Opening Searcher@5e03db0d[collection1] main
[junit4] 2> 1532404 T9408 n:127.0.0.1:46312__dok%2Fja x:collection1 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1532405 T9408 n:127.0.0.1:46312__dok%2Fja x:collection1 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1532405 T9408 n:127.0.0.1:46312__dok%2Fja x:collection1 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 1532405 T9408 n:127.0.0.1:46312__dok%2Fja x:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1532406 T9408 n:127.0.0.1:46312__dok%2Fja x:collection1 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 1532406 T9408 n:127.0.0.1:46312__dok%2Fja x:collection1 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1532406 T9408 n:127.0.0.1:46312__dok%2Fja x:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 1532407 T9408 n:127.0.0.1:46312__dok%2Fja x:collection1 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1532407 T9408 n:127.0.0.1:46312__dok%2Fja x:collection1 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 1532407 T9408 n:127.0.0.1:46312__dok%2Fja x:collection1 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 1532408 T9409 n:127.0.0.1:46312__dok%2Fja x:collection1 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5e03db0d[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1532409 T9408 n:127.0.0.1:46312__dok%2Fja x:collection1 oasc.ZkController.getConfDirListeners watch zkdir /configs/conf1
[junit4] 2> 1532409 T9408 n:127.0.0.1:46312__dok%2Fja x:collection1 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1532410 T9412 n:127.0.0.1:46312__dok%2Fja c:collection1 s:shard1 x:collection1 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:46312/_dok/ja collection:collection1 shard:shard1
[junit4] 2> 1532410 T9348 n:127.0.0.1:46312__dok%2Fja oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1
[junit4] 2> 1532410 T9348 n:127.0.0.1:46312__dok%2Fja oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1532411 T9412 n:127.0.0.1:46312__dok%2Fja c:collection1 s:shard1 x:collection1 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 1532414 T9412 n:127.0.0.1:46312__dok%2Fja c:collection1 s:shard1 x:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 1532415 T9376 n:127.0.0.1:46297__dok%2Fja oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1532415 T9412 n:127.0.0.1:46312__dok%2Fja c:collection1 s:shard1 x:collection1 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 1532415 T9412 n:127.0.0.1:46312__dok%2Fja c:collection1 s:shard1 x:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C2971 name=collection1 org.apache.solr.core.SolrCore@5e2ea4cd url=http://127.0.0.1:46312/_dok/ja/collection1 node=127.0.0.1:46312__dok%2Fja C2971_STATE=coll:collection1 core:collection1 props:{base_url=http://127.0.0.1:46312/_dok/ja, core=collection1, node_name=127.0.0.1:46312__dok%2Fja, state=down}
[junit4] 2> 1532415 T9412 n:127.0.0.1:46312__dok%2Fja c:collection1 s:shard1 x:collection1 C2971 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:46312/_dok/ja/collection1/
[junit4] 2> 1532416 T9377 n:127.0.0.1:46297__dok%2Fja oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1"} current state version: 5
[junit4] 2> 1532416 T9412 n:127.0.0.1:46312__dok%2Fja c:collection1 s:shard1 x:collection1 C2971 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 1532416 T9412 n:127.0.0.1:46312__dok%2Fja c:collection1 s:shard1 x:collection1 C2971 oasc.SyncStrategy.syncToMe http://127.0.0.1:46312/_dok/ja/collection1/ has no replicas
[junit4] 2> 1532416 T9412 n:127.0.0.1:46312__dok%2Fja c:collection1 s:shard1 x:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:46312/_dok/ja/collection1/ shard1
[junit4] 2> 1532416 T9412 n:127.0.0.1:46312__dok%2Fja c:collection1 s:shard1 x:collection1 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 1532417 T9377 n:127.0.0.1:46297__dok%2Fja oasco.ZkStateWriter.writePendingUpdates going to update_collection /collections/collection1/state.json version: 1
[junit4] 2> 1532417 T9407 n:127.0.0.1:46312__dok%2Fja oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json for collection collection1 has occurred - updating... (live nodes size: 2)
[junit4] 2> 1532418 T9407 n:127.0.0.1:46312__dok%2Fja oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 2
[junit4] 2> 1532420 T9377 n:127.0.0.1:46297__dok%2Fja oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "base_url":"http://127.0.0.1:46312/_dok/ja",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 5
[junit4] 2> 1532421 T9377 n:127.0.0.1:46297__dok%2Fja oasco.ZkStateWriter.writePendingUpdates going to update_collection /collections/collection1/state.json version: 2
[junit4] 2> 1532421 T9407 n:127.0.0.1:46312__dok%2Fja oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json for collection collection1 has occurred - updating... (live nodes size: 2)
[junit4] 2> 1532422 T9407 n:127.0.0.1:46312__dok%2Fja oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 3
[junit4] 2> 1532423 T9376 n:127.0.0.1:46297__dok%2Fja oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1532470 T9412 n:127.0.0.1:46312__dok%2Fja c:collection1 s:shard1 x:collection1 oasc.ZkController.register We are http://127.0.0.1:46312/_dok/ja/collection1/ and leader is http://127.0.0.1:46312/_dok/ja/collection1/
[junit4] 2> 1532471 T9412 n:127.0.0.1:46312__dok%2Fja c:collection1 s:shard1 x:collection1 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:46312/_dok/ja
[junit4] 2> 1532471 T9412 n:127.0.0.1:46312__dok%2Fja c:collection1 s:shard1 x:collection1 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 1532471 T9412 n:127.0.0.1:46312__dok%2Fja c:collection1 s:shard1 x:collection1 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 1532471 T9412 n:127.0.0.1:46312__dok%2Fja c:collection1 s:shard1 x:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1532473 T9376 n:127.0.0.1:46297__dok%2Fja oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1532473 T9377 n:127.0.0.1:46297__dok%2Fja oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:46312/_dok/ja",
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "node_name":"127.0.0.1:46312__dok%2Fja",
[junit4] 2> "operation":"state",
[junit4] 2> "numShards":"1",
[junit4] 2> "shard":"shard1",
[junit4] 2> "state":"active"} current state version: 5
[junit4] 2> 1532474 T9377 n:127.0.0.1:46297__dok%2Fja oasco.ReplicaMutator.updateState Update state numShards=1 message={
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:46312/_dok/ja",
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "node_name":"127.0.0.1:46312__dok%2Fja",
[junit4] 2> "operation":"state",
[junit4] 2> "numShards":"1",
[junit4] 2> "shard":"shard1",
[junit4] 2> "state":"active"}
[junit4] 2> 1532475 T9377 n:127.0.0.1:46297__dok%2Fja oasco.ZkStateWriter.writePendingUpdates going to update_collection /collections/collection1/state.json version: 3
[junit4] 2> 1532475 T9412 n:127.0.0.1:46312__dok%2Fja c:collection1 s:shard1 x:collection1 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 3
[junit4] 2> 1532475 T9407 n:127.0.0.1:46312__dok%2Fja oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json for collection collection1 has occurred - updating... (live nodes size: 2)
[junit4] 2> 1532476 T9407 n:127.0.0.1:46312__dok%2Fja oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 4
[junit4] 2> 1533364 T9348 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.RecoveryZkTest 70695C437378C6C8-001/shard-2-001/cores/collection1
[junit4] 2> 1533366 T9348 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2 in directory /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.RecoveryZkTest 70695C437378C6C8-001/shard-2-001
[junit4] 2> 1533367 T9348 oejs.Server.doStart jetty-9.2.10.v20150310
[junit4] 2> 1533368 T9348 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@18dd0a4c{/_dok/ja,null,AVAILABLE}
[junit4] 2> 1533369 T9348 oejs.AbstractConnector.doStart Started ServerConnector@5b3927d5{HTTP/1.1}{127.0.0.1:46324}
[junit4] 2> 1533369 T9348 oejs.Server.doStart Started @1541625ms
[junit4] 2> 1533369 T9348 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {hostContext=/_dok/ja, solr.data.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.RecoveryZkTest 70695C437378C6C8-001/tempDir-001/jetty2, coreRootDirectory=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.RecoveryZkTest 70695C437378C6C8-001/shard-2-001/cores, solrconfig=solrconfig.xml, hostPort=46324}
[junit4] 2> 1533370 T9348 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@57bd06bf
[junit4] 2> 1533370 T9348 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.RecoveryZkTest 70695C437378C6C8-001/shard-2-001/'
[junit4] 2> 1533400 T9348 oasc.SolrXmlConfig.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.RecoveryZkTest 70695C437378C6C8-001/shard-2-001/solr.xml
[junit4] 2> 1533434 T9348 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.RecoveryZkTest 70695C437378C6C8-001/shard-2-001/cores
[junit4] 2> 1533435 T9348 oasc.CoreContainer.<init> New CoreContainer 249327823
[junit4] 2> 1533435 T9348 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.RecoveryZkTest 70695C437378C6C8-001/shard-2-001/]
[junit4] 2> 1533435 T9348 oasc.CoreContainer.load loading shared library: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.RecoveryZkTest 70695C437378C6C8-001/shard-2-001/lib
[junit4] 2> 1533436 T9348 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.RecoveryZkTest 70695C437378C6C8-001/shard-2-001/lib).
[junit4] 2> 1533444 T9348 oashc.HttpShardHandlerFactory.init created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 1533449 T9348 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1533450 T9348 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1533450 T9348 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1533450 T9348 oasc.CoreContainer.load Node Name: 127.0.0.1
[junit4] 2> 1533450 T9348 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:46292/solr
[junit4] 2> 1533450 T9348 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1533451 T9348 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1533451 T9348 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1533453 T9426 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2784b391 name:ZooKeeperConnection Watcher:127.0.0.1:46292 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1533453 T9348 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1533454 T9348 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1533457 T9348 n:127.0.0.1:46324__dok%2Fja oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1533458 T9429 n:127.0.0.1:46324__dok%2Fja oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4b6dc5cd name:ZooKeeperConnection Watcher:127.0.0.1:46292/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1533458 T9348 n:127.0.0.1:46324__dok%2Fja oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1533462 T9348 n:127.0.0.1:46324__dok%2Fja oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1534466 T9348 n:127.0.0.1:46324__dok%2Fja oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46324__dok%2Fja
[junit4] 2> 1534467 T9348 n:127.0.0.1:46324__dok%2Fja oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:46324__dok%2Fja
[junit4] 2> 1534470 T9348 n:127.0.0.1:46324__dok%2Fja oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 1534472 T9348 n:127.0.0.1:46324__dok%2Fja oasc.CorePropertiesLocator.discover Looking for core definitions underneath /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.RecoveryZkTest 70695C437378C6C8-001/shard-2-001/cores
[junit4] 2> 1534477 T9348 n:127.0.0.1:46324__dok%2Fja oasc.CoreDescriptor.<init> CORE DESCRIPTOR: {name=collection1, shard=, config=solrconfig.xml, instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.RecoveryZkTest 70695C437378C6C8-001/shard-2-001/cores/collection1, coreNodeName=, schema=schema.xml, absoluteInstDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.RecoveryZkTest 70695C437378C6C8-001/shard-2-001/cores/collection1/, collection=collection1, transient=false, dataDir=data/, loadOnStartup=true}
[junit4] 2> 1534477 T9348 n:127.0.0.1:46324__dok%2Fja oasc.CorePropertiesLocator.discoverUnder Found core collection1 in /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.RecoveryZkTest 70695C437378C6C8-001/shard-2-001/cores/collection1/
[junit4] 2> 1534478 T9348 n:127.0.0.1:46324__dok%2Fja oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1534480 T9430 n:127.0.0.1:46324__dok%2Fja c:collection1 x:collection1 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 1534480 T9430 n:127.0.0.1:46324__dok%2Fja c:collection1 x:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1534481 T9376 n:127.0.0.1:46297__dok%2Fja oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1534481 T9430 n:127.0.0.1:46324__dok%2Fja oasc.ZkController.preRegister Registering watch for external collection collection1
[junit4] 2> 1534481 T9430 n:127.0.0.1:46324__dok%2Fja oascc.ZkStateReader.addZkWatch addZkWatch collection1
[junit4] 2> 1534482 T9377 n:127.0.0.1:46297__dok%2Fja oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:46324/_dok/ja",
[junit4] 2> "core":"collection1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "node_name":"127.0.0.1:46324__dok%2Fja",
[junit4] 2> "operation":"state",
[junit4] 2> "numShards":"1",
[junit4] 2> "shard":null,
[junit4] 2> "state":"down"} current state version: 5
[junit4] 2> 1534482 T9430 n:127.0.0.1:46324__dok%2Fja oascc.ZkStateReader.addZkWatch Updating collection state at /collections/collection1/state.json from ZooKeeper...
[junit4] 2> 1534482 T9377 n:127.0.0.1:46297__dok%2Fja oasco.ReplicaMutator.updateState Update state numShards=1 message={
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:46324/_dok/ja",
[junit4] 2> "core":"collection1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "node_name":"127.0.0.1:46324__dok%2Fja",
[junit4] 2> "operation":"state",
[junit4] 2> "numShards":"1",
[junit4] 2> "shard":null,
[junit4] 2> "state":"down"}
[junit4] 2> 1534482 T9377 n:127.0.0.1:46297__dok%2Fja oasco.ReplicaMutator.updateState Collection already exists with numShards=1
[junit4] 2> 1534482 T9377 n:127.0.0.1:46297__dok%2Fja oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard1
[junit4] 2> 1534483 T9430 n:127.0.0.1:46324__dok%2Fja oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 4
[junit4] 2> 1534483 T9430 n:127.0.0.1:46324__dok%2Fja oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1534483 T9377 n:127.0.0.1:46297__dok%2Fja oasco.ZkStateWriter.writePendingUpdates going to update_collection /collections/collection1/state.json version: 4
[junit4] 2> 1534484 T9429 n:127.0.0.1:46324__dok%2Fja oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json for collection collection1 has occurred - updating... (live nodes size: 3)
[junit4] 2> 1534484 T9407 n:127.0.0.1:46312__dok%2Fja oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json for collection collection1 has occurred - updating... (live nodes size: 3)
[junit4] 2> 1534485 T9429 n:127.0.0.1:46324__dok%2Fja oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 5
[junit4] 2> 1534485 T9407 n:127.0.0.1:46312__dok%2Fja oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 5
[junit4] 2> 1535483 T9430 n:127.0.0.1:46324__dok%2Fja oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1535484 T9430 n:127.0.0.1:46324__dok%2Fja oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 1535484 T9430 n:127.0.0.1:46324__dok%2Fja oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1535485 T9430 n:127.0.0.1:46324__dok%2Fja oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1535485 T9430 n:127.0.0.1:46324__dok%2Fja oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1535485 T9430 n:127.0.0.1:46324__dok%2Fja oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/
[...truncated too long message...]
olrCoreState Closing SolrCoreState
[junit4] 2> 1696035 T9517 n:127.0.0.1:46324__dok%2Fja oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 1696036 T9517 n:127.0.0.1:46324__dok%2Fja oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 1696037 T9517 n:127.0.0.1:46324__dok%2Fja oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 1696046 T9517 n:127.0.0.1:46324__dok%2Fja oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 1696046 T9517 n:127.0.0.1:46324__dok%2Fja oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.RecoveryZkTest 70695C437378C6C8-001/shard-2-001/cores/collection1/data [CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.RecoveryZkTest 70695C437378C6C8-001/shard-2-001/cores/collection1/data;done=false>>]
[junit4] 2> 1696047 T9517 n:127.0.0.1:46324__dok%2Fja oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.RecoveryZkTest 70695C437378C6C8-001/shard-2-001/cores/collection1/data
[junit4] 2> 1696047 T9517 n:127.0.0.1:46324__dok%2Fja oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.RecoveryZkTest 70695C437378C6C8-001/shard-2-001/cores/collection1/data/index [CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.RecoveryZkTest 70695C437378C6C8-001/shard-2-001/cores/collection1/data/index;done=false>>]
[junit4] 2> 1696047 T9517 n:127.0.0.1:46324__dok%2Fja oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.RecoveryZkTest 70695C437378C6C8-001/shard-2-001/cores/collection1/data/index
[junit4] 2> 1696049 T9348 oejs.AbstractConnector.doStop Stopped ServerConnector@60c51f14{HTTP/1.1}{127.0.0.1:46324}
[junit4] 2> 1696050 T9348 oejsh.ContextHandler.doStop Stopped o.e.j.s.ServletContextHandler@5f31e928{/_dok/ja,null,UNAVAILABLE}
[junit4] 2> 1696052 T9348 c:control_collection s:shard1 x:collection1 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:46292 46292
[junit4] 2> 1696185 T9349 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:46292 46292
[junit4] 2> 1696186 T9349 oasc.ZkTestServer$ZKServerMain.runFromConfig WARN Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 5 /solr/aliases.json
[junit4] 2> 5 /solr/clusterstate.json
[junit4] 2> 4 /solr/configs/conf1
[junit4] 2> 3 /solr/collections/collection1/state.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 2 /solr/overseer_elect/election/93807640987828231-127.0.0.1:46312__dok%2Fja-n_0000000001
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard1/election/93807640987828231-core_node1-n_0000000000
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 4 /solr/live_nodes
[junit4] 2> 3 /solr/overseer/queue
[junit4] 2> 3 /solr/overseer/collection-queue-work
[junit4] 2>
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=RecoveryZkTest -Dtests.method=test -Dtests.seed=70695C437378C6C8 -Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=sr_CS -Dtests.timezone=America/Santo_Domingo -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[junit4] FAILURE 171s J1 | RecoveryZkTest.test <<<
[junit4] > Throwable #1: java.lang.AssertionError: shard1 is not consistent. Got 917 from http://127.0.0.1:46312/_dok/ja/collection1lastClient and got 245 from http://127.0.0.1:46324/_dok/ja/collection1
[junit4] > at __randomizedtesting.SeedInfo.seed([70695C437378C6C8:F83D6399DD84AB30]:0)
[junit4] > at org.apache.solr.cloud.RecoveryZkTest.test(RecoveryZkTest.java:123)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:960)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:935)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 1696198 T9348 c:control_collection s:shard1 x:collection1 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.RecoveryZkTest 70695C437378C6C8-001
[junit4] 2> 170732 T9347 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=FastCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST, chunkSize=7492, maxDocsPerChunk=4, blockSize=759), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST, chunkSize=7492, blockSize=759)), sim=DefaultSimilarity, locale=sr_CS, timezone=America/Santo_Domingo
[junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_65 (64-bit)/cpus=16,threads=1,free=123517192,total=402128896
[junit4] 2> NOTE: All tests run in this JVM: [TestObjectReleaseTracker, TestSortingResponseWriter, SimplePostToolTest, DirectSolrSpellCheckerTest, TestBlendedInfixSuggestions, CSVRequestHandlerTest, TermVectorComponentTest, TestReplicationHandlerBackup, TestReload, TestFoldingMultitermQuery, TermVectorComponentDistributedTest, SchemaVersionSpecificBehaviorTest, XmlUpdateRequestHandlerTest, TestSearcherReuse, ReplicationFactorTest, BlockDirectoryTest, TestCloudInspectUtil, BadComponentTest, RequestHandlersTest, ChaosMonkeyNothingIsSafeTest, TestUpdate, RemoteQueryErrorTest, UniqFieldsUpdateProcessorFactoryTest, ConvertedLegacyTest, TestFieldCollectionResource, TestLFUCache, EnumFieldTest, LeaderInitiatedRecoveryOnCommitTest, TestShortCircuitedRequests, CopyFieldTest, MinimalSchemaTest, TestUniqueKeyFieldResource, TestBinaryField, TestFastLRUCache, TestSort, QueryParsingTest, TestMaxScoreQueryParser, TestAnalyzedSuggestions, TestSolrConfigHandlerCloud, TestAddFieldRealTimeGet, ConcurrentDeleteAndCreateCollectionTest, TestSolrQueryParserDefaultOperatorResource, TestNRTOpen, SpatialHeatmapFacetsTest, TestIndexSearcher, TestManagedSchemaFieldResource, TestCoreContainer, TestReversedWildcardFilterFactory, TestBinaryResponseWriter, DistributedQueryElevationComponentTest, TestTolerantSearch, TestBulkSchemaConcurrent, XsltUpdateRequestHandlerTest, TestSolr4Spatial2, TestSystemIdResolver, SimpleFacetsTest, TestWordDelimiterFilterFactory, ZkControllerTest, TestCloudManagedSchemaConcurrent, TestCloudSchemaless, MultiThreadedOCPTest, TestConfigReload, AsyncMigrateRouteKeyTest, TestRebalanceLeaders, RecoveryZkTest]
[junit4] Completed [282/488] on J1 in 171.07s, 1 test, 1 failure <<< FAILURES!
[...truncated 653 lines...]
BUILD FAILED
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/build.xml:536: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/build.xml:484: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/build.xml:61: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/extra-targets.xml:39: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build.xml:229: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/common-build.xml:511: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/lucene/common-build.xml:1433: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/lucene/common-build.xml:991: There were test failures: 488 suites, 1958 tests, 1 failure, 71 ignored (26 assumptions)
Total time: 53 minutes 29 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Sending artifact delta relative to Lucene-Solr-Tests-5.x-Java7 #3101
Archived 5 artifacts
Archive block size is 32768
Received 0 blocks and 231128411 bytes
Compression is 0.0%
Took 43 sec
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-Tests-5.x-Java7 - Build # 3103 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-5.x-Java7/3103/
2 tests failed.
REGRESSION: org.apache.solr.cloud.ShardSplitTest.test
Error Message:
Wrong doc count on shard1_0. See SOLR-5309 expected:<178> but was:<177>
Stack Trace:
java.lang.AssertionError: Wrong doc count on shard1_0. See SOLR-5309 expected:<178> but was:<177>
at __randomizedtesting.SeedInfo.seed([278CBA37A9B41EBB:AFD885ED07487343]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.apache.solr.cloud.ShardSplitTest.checkDocCountsAndShardStates(ShardSplitTest.java:440)
at org.apache.solr.cloud.ShardSplitTest.splitByUniqueKeyTest(ShardSplitTest.java:222)
at org.apache.solr.cloud.ShardSplitTest.test(ShardSplitTest.java:84)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:960)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:935)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
REGRESSION: org.apache.solr.schema.TestCloudManagedSchemaConcurrent.test
Error Message:
Captured an uncaught exception in thread: Thread[id=5185, name=Thread-1864, state=RUNNABLE, group=TGRP-TestCloudManagedSchemaConcurrent]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=5185, name=Thread-1864, state=RUNNABLE, group=TGRP-TestCloudManagedSchemaConcurrent]
Caused by: java.lang.RuntimeException: org.apache.http.NoHttpResponseException: 127.0.0.1:63193 failed to respond
at __randomizedtesting.SeedInfo.seed([278CBA37A9B41EBB]:0)
at org.apache.solr.schema.TestCloudManagedSchemaConcurrent$PostDynamicFieldThread.run(TestCloudManagedSchemaConcurrent.java:611)
Caused by: org.apache.http.NoHttpResponseException: 127.0.0.1:63193 failed to respond
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:143)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
at org.apache.solr.util.RestTestHarness.getResponse(RestTestHarness.java:208)
at org.apache.solr.util.RestTestHarness.post(RestTestHarness.java:148)
at org.apache.solr.schema.TestCloudManagedSchemaConcurrent.addFieldPost(TestCloudManagedSchemaConcurrent.java:125)
at org.apache.solr.schema.TestCloudManagedSchemaConcurrent.access$200(TestCloudManagedSchemaConcurrent.java:45)
at org.apache.solr.schema.TestCloudManagedSchemaConcurrent$PostDynamicFieldThread.run(TestCloudManagedSchemaConcurrent.java:608)
Build Log:
[...truncated 10187 lines...]
[junit4] Suite: org.apache.solr.cloud.ShardSplitTest
[junit4] 2> Creating dataDir: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest 278CBA37A9B41EBB-001/init-core-data-001
[junit4] 2> 1087500 T3145 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4] 2> 1087510 T3145 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 1087511 T3146 oasc.ZkTestServer$2$1.setClientPort client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1087511 T3146 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 1087611 T3145 oasc.ZkTestServer.run start zk server on port:44754
[junit4] 2> 1087612 T3145 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1087613 T3145 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1087621 T3153 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@42ce9e52 name:ZooKeeperConnection Watcher:127.0.0.1:44754 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1087621 T3145 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1087622 T3145 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1087622 T3145 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 1087627 T3145 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1087628 T3145 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1087630 T3156 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@62f6e4cb name:ZooKeeperConnection Watcher:127.0.0.1:44754/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1087630 T3145 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1087631 T3145 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1087631 T3145 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 1087635 T3145 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 1087637 T3145 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 1087638 T3145 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 1087641 T3145 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1087642 T3145 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 1087645 T3145 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 1087646 T3145 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 1087649 T3145 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1087650 T3145 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1087652 T3145 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1087653 T3145 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 1087656 T3145 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1087656 T3145 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 1087658 T3145 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1087659 T3145 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 1087661 T3145 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 1087662 T3145 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 1087664 T3145 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1087665 T3145 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 1087667 T3145 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1087668 T3145 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1087670 T3145 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1087671 T3145 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 1087674 T3145 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1087674 T3145 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 1091362 T3145 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest 278CBA37A9B41EBB-001/control-001/cores/collection1
[junit4] 2> 1091372 T3145 oejs.Server.doStart jetty-9.2.10.v20150310
[junit4] 2> 1091392 T3145 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@36f845fd{/,null,AVAILABLE}
[junit4] 2> 1091395 T3145 oejs.AbstractConnector.doStart Started ServerConnector@2defe784{HTTP/1.1}{127.0.0.1:44753}
[junit4] 2> 1091396 T3145 oejs.Server.doStart Started @1097355ms
[junit4] 2> 1091410 T3145 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {coreRootDirectory=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest 278CBA37A9B41EBB-001/control-001/cores, hostContext=/, hostPort=44753, solr.data.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest 278CBA37A9B41EBB-001/tempDir-001/control/data}
[junit4] 2> 1091411 T3145 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@57bd06bf
[junit4] 2> 1091412 T3145 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest 278CBA37A9B41EBB-001/control-001/'
[junit4] 2> 1091500 T3145 oasc.SolrXmlConfig.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest 278CBA37A9B41EBB-001/control-001/solr.xml
[junit4] 2> 1091679 T3145 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest 278CBA37A9B41EBB-001/control-001/cores
[junit4] 2> 1091680 T3145 oasc.CoreContainer.<init> New CoreContainer 538863197
[junit4] 2> 1091680 T3145 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest 278CBA37A9B41EBB-001/control-001/]
[junit4] 2> 1091681 T3145 oasc.CoreContainer.load loading shared library: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest 278CBA37A9B41EBB-001/control-001/lib
[junit4] 2> 1091685 T3145 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest 278CBA37A9B41EBB-001/control-001/lib).
[junit4] 2> 1091743 T3145 oashc.HttpShardHandlerFactory.init created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 1091758 T3145 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1091760 T3145 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1091761 T3145 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1091761 T3145 oasc.CoreContainer.load Node Name: 127.0.0.1
[junit4] 2> 1091762 T3145 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:44754/solr
[junit4] 2> 1091762 T3145 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1091763 T3145 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1091764 T3145 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1091779 T3170 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1974bedf name:ZooKeeperConnection Watcher:127.0.0.1:44754 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1091780 T3145 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1091781 T3145 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1091785 T3145 n:127.0.0.1:44753_ oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1091788 T3173 n:127.0.0.1:44753_ oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5b4e9210 name:ZooKeeperConnection Watcher:127.0.0.1:44754/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1091789 T3145 n:127.0.0.1:44753_ oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1091792 T3145 n:127.0.0.1:44753_ oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 1091798 T3145 n:127.0.0.1:44753_ oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 1091803 T3145 n:127.0.0.1:44753_ oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 1091809 T3145 n:127.0.0.1:44753_ oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 1091815 T3145 n:127.0.0.1:44753_ oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 1091819 T3145 n:127.0.0.1:44753_ oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 1091824 T3145 n:127.0.0.1:44753_ oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 1091829 T3145 n:127.0.0.1:44753_ oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 1091839 T3145 n:127.0.0.1:44753_ oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44753_
[junit4] 2> 1091842 T3145 n:127.0.0.1:44753_ oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:44753_
[junit4] 2> 1091847 T3145 n:127.0.0.1:44753_ oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 1091852 T3145 n:127.0.0.1:44753_ oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 1091855 T3145 n:127.0.0.1:44753_ oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 1091858 T3145 n:127.0.0.1:44753_ oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:44753_
[junit4] 2> 1091859 T3145 n:127.0.0.1:44753_ oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 1091862 T3145 n:127.0.0.1:44753_ oasc.Overseer.start Overseer (id=93808562976849923-127.0.0.1:44753_-n_0000000000) starting
[junit4] 2> 1091866 T3145 n:127.0.0.1:44753_ oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 1091880 T3145 n:127.0.0.1:44753_ oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 1091881 T3175 n:127.0.0.1:44753_ oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 1091882 T3174 n:127.0.0.1:44753_ oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 1091888 T3145 n:127.0.0.1:44753_ oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1091896 T3145 n:127.0.0.1:44753_ oasc.CorePropertiesLocator.discover Looking for core definitions underneath /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest 278CBA37A9B41EBB-001/control-001/cores
[junit4] 2> 1091907 T3145 n:127.0.0.1:44753_ oasc.CoreDescriptor.<init> CORE DESCRIPTOR: {shard=, transient=false, config=solrconfig.xml, instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest 278CBA37A9B41EBB-001/control-001/cores/collection1, coreNodeName=, dataDir=data/, collection=control_collection, schema=schema.xml, loadOnStartup=true, absoluteInstDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest 278CBA37A9B41EBB-001/control-001/cores/collection1/, name=collection1}
[junit4] 2> 1091909 T3145 n:127.0.0.1:44753_ oasc.CorePropertiesLocator.discoverUnder Found core collection1 in /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest 278CBA37A9B41EBB-001/control-001/cores/collection1/
[junit4] 2> 1091909 T3145 n:127.0.0.1:44753_ oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1091940 T3177 n:127.0.0.1:44753_ c:control_collection x:collection1 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
[junit4] 2> 1091940 T3177 n:127.0.0.1:44753_ c:control_collection x:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1091942 T3177 n:127.0.0.1:44753_ oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1091942 T3173 n:127.0.0.1:44753_ oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1091943 T3174 n:127.0.0.1:44753_ oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:44753",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "node_name":"127.0.0.1:44753_",
[junit4] 2> "roles":null,
[junit4] 2> "numShards":"1",
[junit4] 2> "core":"collection1",
[junit4] 2> "operation":"state",
[junit4] 2> "shard":null} current state version: 0
[junit4] 2> 1091943 T3174 n:127.0.0.1:44753_ oasco.ReplicaMutator.updateState Update state numShards=1 message={
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:44753",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "node_name":"127.0.0.1:44753_",
[junit4] 2> "roles":null,
[junit4] 2> "numShards":"1",
[junit4] 2> "core":"collection1",
[junit4] 2> "operation":"state",
[junit4] 2> "shard":null}
[junit4] 2> 1091944 T3174 n:127.0.0.1:44753_ oasco.ClusterStateMutator.createCollection building a new cName: control_collection
[junit4] 2> 1091944 T3174 n:127.0.0.1:44753_ oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard1
[junit4] 2> 1091947 T3173 n:127.0.0.1:44753_ oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1092942 T3177 n:127.0.0.1:44753_ oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1092943 T3177 n:127.0.0.1:44753_ oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 1092944 T3177 n:127.0.0.1:44753_ oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1092944 T3177 n:127.0.0.1:44753_ oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 1092945 T3177 n:127.0.0.1:44753_ oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1092946 T3177 n:127.0.0.1:44753_ oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest 278CBA37A9B41EBB-001/control-001/cores/collection1/'
[junit4] 2> 1093005 T3177 n:127.0.0.1:44753_ oasc.Config.<init> loaded config solrconfig.xml with version 0
[junit4] 2> 1093035 T3177 n:127.0.0.1:44753_ oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
[junit4] 2> 1093086 T3177 n:127.0.0.1:44753_ oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.2.0
[junit4] 2> 1093200 T3177 n:127.0.0.1:44753_ oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1093202 T3177 n:127.0.0.1:44753_ oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 1093223 T3177 n:127.0.0.1:44753_ oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1093939 T3177 n:127.0.0.1:44753_ oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1093945 T3177 n:127.0.0.1:44753_ oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1093948 T3177 n:127.0.0.1:44753_ oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1093957 T3177 n:127.0.0.1:44753_ oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1093996 T3177 n:127.0.0.1:44753_ oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 1093996 T3177 n:127.0.0.1:44753_ x:collection1 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1093997 T3177 n:127.0.0.1:44753_ x:collection1 oasc.SolrCore.<init> [[collection1] ] Opening new SolrCore at [/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest 278CBA37A9B41EBB-001/control-001/cores/collection1/], dataDir=[null]
[junit4] 2> 1093997 T3177 n:127.0.0.1:44753_ x:collection1 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6a312a17
[junit4] 2> 1093999 T3177 n:127.0.0.1:44753_ x:collection1 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest 278CBA37A9B41EBB-001/control-001/cores/collection1/data
[junit4] 2> 1093999 T3177 n:127.0.0.1:44753_ x:collection1 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest 278CBA37A9B41EBB-001/control-001/cores/collection1/data/index/
[junit4] 2> 1093999 T3177 n:127.0.0.1:44753_ x:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest 278CBA37A9B41EBB-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1094000 T3177 n:127.0.0.1:44753_ x:collection1 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest 278CBA37A9B41EBB-001/control-001/cores/collection1/data/index
[junit4] 2> 1094001 T3177 n:127.0.0.1:44753_ x:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=45, maxMergeAtOnceExplicit=19, maxMergedSegmentMB=0.1015625, floorSegmentMB=2.134765625, forceMergeDeletesPctAllowed=2.306976370084981, segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 1094002 T3177 n:127.0.0.1:44753_ x:collection1 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@161df3ca lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@8705e1e),segFN=segments_1,generation=1}
[junit4] 2> 1094002 T3177 n:127.0.0.1:44753_ x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1094010 T3177 n:127.0.0.1:44753_ x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1094011 T3177 n:127.0.0.1:44753_ x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1094011 T3177 n:127.0.0.1:44753_ x:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1094012 T3177 n:127.0.0.1:44753_ x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1094012 T3177 n:127.0.0.1:44753_ x:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1094012 T3177 n:127.0.0.1:44753_ x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1094013 T3177 n:127.0.0.1:44753_ x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1094014 T3177 n:127.0.0.1:44753_ x:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1094014 T3177 n:127.0.0.1:44753_ x:collection1 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1094041 T3177 n:127.0.0.1:44753_ x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1094047 T3177 n:127.0.0.1:44753_ x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1094053 T3177 n:127.0.0.1:44753_ x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1094059 T3177 n:127.0.0.1:44753_ x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1094065 T3177 n:127.0.0.1:44753_ x:collection1 oasc.RequestHandlers.initHandlersFromConfig Registered paths: /replication,/admin/mbeans,/update/json/docs,/admin/system,standard,/admin/plugins,/update,/get,/admin/threads,/config,/admin/logging,/update/csv,/admin/ping,/admin/properties,/update/json,/admin/luke,/admin/segments,/admin/file,/schema
[junit4] 2> 1094069 T3177 n:127.0.0.1:44753_ x:collection1 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 1094073 T3177 n:127.0.0.1:44753_ x:collection1 oasu.UpdateHandler.<init> Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1094074 T3177 n:127.0.0.1:44753_ x:collection1 oasu.UpdateLog.init Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10
[junit4] 2> 1094082 T3177 n:127.0.0.1:44753_ x:collection1 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1094082 T3177 n:127.0.0.1:44753_ x:collection1 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1094083 T3177 n:127.0.0.1:44753_ x:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=11, maxMergeAtOnceExplicit=33, maxMergedSegmentMB=47.107421875, floorSegmentMB=1.8994140625, forceMergeDeletesPctAllowed=19.06293411367766, segmentsPerTier=33.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 1094084 T3177 n:127.0.0.1:44753_ x:collection1 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@161df3ca lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@8705e1e),segFN=segments_1,generation=1}
[junit4] 2> 1094085 T3177 n:127.0.0.1:44753_ x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1094085 T3177 n:127.0.0.1:44753_ x:collection1 oass.SolrIndexSearcher.<init> Opening Searcher@57df0d6a[collection1] main
[junit4] 2> 1094086 T3177 n:127.0.0.1:44753_ x:collection1 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 1094087 T3177 n:127.0.0.1:44753_ x:collection1 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1094087 T3177 n:127.0.0.1:44753_ x:collection1 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 1094088 T3177 n:127.0.0.1:44753_ x:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1094089 T3177 n:127.0.0.1:44753_ x:collection1 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 1094089 T3177 n:127.0.0.1:44753_ x:collection1 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1094090 T3177 n:127.0.0.1:44753_ x:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 1094090 T3177 n:127.0.0.1:44753_ x:collection1 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1094091 T3177 n:127.0.0.1:44753_ x:collection1 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 1094091 T3177 n:127.0.0.1:44753_ x:collection1 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 1094092 T3178 n:127.0.0.1:44753_ x:collection1 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@57df0d6a[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1094093 T3177 n:127.0.0.1:44753_ x:collection1 oasc.ZkController.getConfDirListeners watch zkdir /configs/conf1
[junit4] 2> 1094094 T3177 n:127.0.0.1:44753_ x:collection1 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1094095 T3181 n:127.0.0.1:44753_ c:control_collection s:shard1 x:collection1 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:44753 collection:control_collection shard:shard1
[junit4] 2> 1094096 T3145 n:127.0.0.1:44753_ oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0
[junit4] 2> 1094096 T3145 n:127.0.0.1:44753_ oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1094098 T3181 n:127.0.0.1:44753_ c:control_collection s:shard1 x:collection1 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 1094102 T3145 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1094104 T3145 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1094108 T3181 n:127.0.0.1:44753_ c:control_collection s:shard1 x:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 1094109 T3184 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@36af3f68 name:ZooKeeperConnection Watcher:127.0.0.1:44754/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1094109 T3145 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1094110 T3145 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1094110 T3145 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1094113 T3173 n:127.0.0.1:44753_ oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1094113 T3181 n:127.0.0.1:44753_ c:control_collection s:shard1 x:collection1 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 1094113 T3181 n:127.0.0.1:44753_ c:control_collection s:shard1 x:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C488 name=collection1 org.apache.solr.core.SolrCore@1edeadb0 url=http://127.0.0.1:44753/collection1 node=127.0.0.1:44753_ C488_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:44753, node_name=127.0.0.1:44753_, core=collection1}
[junit4] 2> 1094114 T3181 n:127.0.0.1:44753_ c:control_collection s:shard1 x:collection1 C488 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:44753/collection1/
[junit4] 2> 1094114 T3174 n:127.0.0.1:44753_ oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state version: 1
[junit4] 2> 1094114 T3181 n:127.0.0.1:44753_ c:control_collection s:shard1 x:collection1 C488 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 1094115 T3181 n:127.0.0.1:44753_ c:control_collection s:shard1 x:collection1 C488 oasc.SyncStrategy.syncToMe http://127.0.0.1:44753/collection1/ has no replicas
[junit4] 2> 1094115 T3181 n:127.0.0.1:44753_ c:control_collection s:shard1 x:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:44753/collection1/ shard1
[junit4] 2> 1094116 T3181 n:127.0.0.1:44753_ c:control_collection s:shard1 x:collection1 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 1094116 T3173 n:127.0.0.1:44753_ oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1094116 T3184 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
[junit4] 2> 1094119 T3145 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 1094125 T3173 n:127.0.0.1:44753_ oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1094126 T3174 n:127.0.0.1:44753_ oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:44753",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 2
[junit4] 2> 1094232 T3173 n:127.0.0.1:44753_ oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1094232 T3184 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1094278 T3181 n:127.0.0.1:44753_ c:control_collection s:shard1 x:collection1 oasc.ZkController.register We are http://127.0.0.1:44753/collection1/ and leader is http://127.0.0.1:44753/collection1/
[junit4] 2> 1094279 T3181 n:127.0.0.1:44753_ c:control_collection s:shard1 x:collection1 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:44753
[junit4] 2> 1094279 T3181 n:127.0.0.1:44753_ c:control_collection s:shard1 x:collection1 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 1094280 T3181 n:127.0.0.1:44753_ c:control_collection s:shard1 x:collection1 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
[junit4] 2> 1094280 T3181 n:127.0.0.1:44753_ c:control_collection s:shard1 x:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1094282 T3173 n:127.0.0.1:44753_ oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1094283 T3174 n:127.0.0.1:44753_ oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:44753",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "node_name":"127.0.0.1:44753_",
[junit4] 2> "roles":null,
[junit4] 2> "numShards":"2",
[junit4] 2> "core":"collection1",
[junit4] 2> "operation":"state",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core_node_name":"core_node1"} current state version: 3
[junit4] 2> 1094285 T3174 n:127.0.0.1:44753_ oasco.ReplicaMutator.updateState Update state numShards=2 message={
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:44753",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "node_name":"127.0.0.1:44753_",
[junit4] 2> "roles":null,
[junit4] 2> "numShards":"2",
[junit4] 2> "core":"collection1",
[junit4] 2> "operation":"state",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 1094390 T3184 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1094390 T3173 n:127.0.0.1:44753_ oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1098490 T3145 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest 278CBA37A9B41EBB-001/shard-1-001/cores/collection1
[junit4] 2> 1098502 T3145 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1 in directory /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest 278CBA37A9B41EBB-001/shard-1-001
[junit4] 2> 1098504 T3145 oejs.Server.doStart jetty-9.2.10.v20150310
[junit4] 2> 1098509 T3145 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@52739a9c{/,null,AVAILABLE}
[junit4] 2> 1098511 T3145 oejs.AbstractConnector.doStart Started ServerConnector@591c576d{HTTP/1.1}{127.0.0.1:44819}
[junit4] 2> 1098512 T3145 oejs.Server.doStart Started @1104471ms
[junit4] 2> 1098512 T3145 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {hostPort=44819, coreRootDirectory=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest 278CBA37A9B41EBB-001/shard-1-001/cores, solrconfig=solrconfig.xml, solr.data.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest 278CBA37A9B41EBB-001/tempDir-001/jetty1, hostContext=/}
[junit4] 2> 1098513 T3145 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@57bd06bf
[junit4] 2> 1098514 T3145 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest 278CBA37A9B41EBB-001/shard-1-001/'
[junit4] 2> 1098678 T3145 oasc.SolrXmlConfig.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest 278CBA37A9B41EBB-001/shard-1-001/solr.xml
[junit4] 2> 1098849 T3145 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest 278CBA37A9B41EBB-001/shard-1-001/cores
[junit4] 2> 1098850 T3145 oasc.CoreContainer.<init> New CoreContainer 289374636
[junit4] 2> 1098850 T3145 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest 278CBA37A9B41EBB-001/shard-1-001/]
[junit4] 2> 1098851 T3145 oasc.CoreContainer.load loading shared library: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest 278CBA37A9B41EBB-001/shard-1-001/lib
[junit4] 2> 1098852 T3145 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest 278CBA37A9B41EBB-001/shard-1-001/lib).
[junit4] 2> 1098921 T3145 oashc.HttpShardHandlerFactory.init created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 1098945 T3145 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1098946 T3145 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1098947 T3145 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1098947 T3145 oasc.CoreContainer.load Node Name: 127.0.0.1
[junit4] 2> 1098948 T3145 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:44754/solr
[junit4] 2> 1098948 T3145 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1098948 T3145 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1098950 T3145 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1098966 T3198 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4d4b852b name:ZooKeeperConnection Watcher:127.0.0.1:44754 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1098966 T3145 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1098967 T3145 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1098971 T3145 n:127.0.0.1:44819_ oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1098974 T3201 n:127.0.0.1:44819_ oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3467719f name:ZooKeeperConnection Watcher:127.0.0.1:44754/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1098974 T3145 n:127.0.0.1:44819_ oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1098984 T3145 n:127.0.0.1:44819_ oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1099991 T3145 n:127.0.0.1:44819_ oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44819_
[junit4] 2> 1099993 T3145 n:127.0.0.1:44819_ oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:44819_
[junit4] 2> 1100000 T3145 n:127.0.0.1:44819_ oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 1100005 T3145 n:127.0.0.1:44819_ oasc.CorePropertiesLocator.discover Looking for core definitions underneath /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest 278CBA37A9B41EBB-001/shard-1-001/cores
[junit4] 2> 1100017 T3145 n:127.0.0.1:44819_ oasc.CoreDescriptor.<init> CORE DESCRIPTOR: {loadOnStartup=true, shard=, transient=false, coreNodeName=, config=solrconfig.xml, absoluteInstDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest 278CBA37A9B41EBB-001/shard-1-001/cores/collection1/, name=collection1, collection=collection1, instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest 278CBA37A9B41EBB-001/shard-1-001/cores/collection1, dataDir=data/, schema=schema.xml}
[junit4] 2> 1100017 T3145 n:127.0.0.1:44819_ oasc.CorePropertiesLocator.discoverUnder Found core collection1 in /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest 278CBA37A9B41EBB-001/shard-1-001/cores/collection1/
[junit4] 2> 1100018 T3145 n:127.0.0.1:44819_ oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1100020 T3202 n:127.0.0.1:44819_ c:collection1 x:collection1 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 1100020 T3202 n:127.0.0.1:44819_ c:collection1 x:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1100022 T3202 n:127.0.0.1:44819_ oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1100022 T3173 n:127.0.0.1:44753_ oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1100024 T3174 n:127.0.0.1:44753_ oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:44819",
[junit4] 2> "collection":"collection1",
[junit4] 2> "node_name":"127.0.0.1:44819_",
[junit4] 2> "roles":null,
[junit4] 2> "numShards":"2",
[junit4] 2> "core":"collection1",
[junit4] 2> "operation":"state",
[junit4] 2> "shard":null} current state version: 4
[junit4] 2> 1100025 T3174 n:127.0.0.1:44753_ oasco.ReplicaMutator.updateState Update state numShards=2 message={
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:44819",
[junit4] 2> "collection":"collection1",
[junit4] 2> "node_name":"127.0.0.1:44819_",
[junit4] 2> "roles":null,
[junit4] 2> "numShards":"2",
[junit4] 2> "core":"collection1",
[junit4] 2> "operation":"state",
[junit4] 2> "shard":null}
[junit4] 2> 1100025 T3174 n:127.0.0.1:44753_ oasco.ClusterStateMutator.createCollection building a new cName: collection1
[junit4] 2> 1100025 T3174 n:127.0.0.1:44753_ oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard1
[junit4] 2> 1100028 T3173 n:127.0.0.1:44753_ oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1100028 T3184 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1100028 T3201 n:127.0.0.1:44819_ oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1101022 T3202 n:127.0.0.1:44819_ oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1101023 T3202 n:127.0.0.1:44819_ oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 1101024 T3202 n:127.0.0.1:44819_ oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1101058 T3202 n:127.0.0.1:44819_ oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1101059 T3202 n:127.0.0.1:44819_ oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1101059 T3202 n:127.0.0.1:44819_ oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest 278CBA37A9B41EBB-001/shard-1-001/cores/collection1/'
[junit4] 2> 1101123 T3202 n:127.0.0.1:44819_ oasc.Config.<init> loaded config solrconfig.xml with version 0
[junit4] 2> 1101145 T3202 n:127.0.0.1:44819_ oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
[junit4] 2> 1101200 T3202 n:127.0.0.1:44819_ oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.2.0
[junit4] 2> 1101379 T3202 n:127.0.0.1:44819_ oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1101382 T3202 n:127.0.0.1:44819_ oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 1101403 T3202 n:127.0.0.1:44819_ oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1102088 T3202 n:127.0.0.1:44819_ oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1102091 T3202 n:127.0.0.1:44819_ oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1102095 T3202 n:127.0.0.1:44819_ oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1102105 T3202 n:127.0.0.1:44819_ oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1102156 T3202 n:127.0.0.1:44819_ oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 1102157 T3202 n:127.0.0.1:44819_ x:collection1 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1102157 T3202 n:127.0.0.1:44819_ x:collection1 oasc.SolrCore.<init> [[collection1] ] Opening new SolrCore at [/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest 278CBA37A9B41EBB-001/shard-1-001/cores/collection1/], dataDir=[null]
[junit4] 2> 1102158 T3202 n:127.0.0.1:44819_ x:collection1 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6a312a17
[junit4] 2> 1102159 T3202 n:127.0.0.1:44819_ x:collection1 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest 278CBA37A9B41EBB-001/shard-1-001/cores/collection1/data
[junit4] 2> 1102160 T3202 n:127.0.0.1:44819_ x:collection1 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest 278CBA37A9B41EBB-001/shard-1-001/cores/collection1/data/index/
[junit4] 2> 1102160 T3202 n:127.0.0.1:44819_ x:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest 278CBA37A9B41EBB-001/shard-1-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1102161 T3202 n:127.0.0.1:44819_ x:collection1 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest 278CBA37A9B41EBB-001/shard-1-001/cores/collection1/data/index
[junit4] 2> 1102161 T3202 n:127.0.0.1:44819_ x:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=45, maxMergeAtOnceExplicit=19, maxMergedSegmentMB=0.1015625, floorSegmentMB=2.134765625, forceMergeDeletesPctAllowed=2.306976370084981, segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 1102163 T3202 n:127.0.0.1:44819_ x:collection1 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@4f2e3bdb lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@645bcf79),segFN=segments_1,generation=1}
[junit4] 2> 1102163 T3202 n:127.0.0.1:44819_ x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1102186 T3202 n:127.0.0.1:44819_ x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1102187 T3202 n:127.0.0.1:44819_ x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1102188 T3202 n:127.0.0.1:44819_ x:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1102188 T3202 n:127.0.0.1:44819_ x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1102189 T3202 n:127.0.0.1:44819_ x:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1102189 T3202 n:127.0.0.1:44819_ x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1102190 T3202 n:127.0.0.1:44819_ x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1102191 T3202 n:127.0.0.1:44819_ x:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1102191 T3202 n:127.0.0.1:44819_ x:collection1 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1102235 T3202 n:127.0.0.1:44819_ x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1102239 T3202 n:127.0.0.1:44819_ x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1102242 T3202 n:127.0.0.1:44819_ x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1102244 T3202 n:127.0.0.1:44819_ x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1102253 T3202 n:127.0.0.1:44819_ x:collection1 oasc.RequestHandlers.initHandlersFromConfig Registered paths: /replication,/admin/mbeans,/update/json/docs,/admin/system,standard,/admin/plugins,/update,/get,/admin/threads,/config,/admin/logging,/update/csv,/admin/ping,/admin/properties,/update/json,/admin/luke,/admin/segments,/admin/file,/schema
[junit4] 2> 1102256 T3202 n:127.0.0.1:44819_ x:collection1 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 1102257 T3202 n:127.0.0.1:44819_ x:collection1 oasu.UpdateHandler.<init> Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1102258 T3202 n:127.0.0.1:44819_ x:collection1 oasu.UpdateLog.init Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10
[junit4] 2> 1102259 T3202 n:127.0.0.1:44819_ x:collection1 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1102260 T3202 n:127.0.0.1:44819_ x:collection1 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1102261 T3202 n:127.0.0.1:44819_ x:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=11, maxMergeAtOnceExplicit=33, maxMergedSegmentMB=47.107421875, floorSegmentMB=1.8994140625, forceMergeDeletesPctAllowed=19.06293411367766, segmentsPerTier=33.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 1102262 T3202 n:127.0.0.1:44819_ x:collection1 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@4f2e3bdb lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@645bcf79),segFN=segments_1,generation=1}
[junit4] 2> 1102262 T3202 n:127.0.0.1:44819_ x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1102263 T3202 n:127.0.0.1:44819_ x:collection1 oass.SolrIndexSearcher.<init> Opening Searcher@67f8cdaa[collection1] main
[junit4] 2> 1102263 T3202 n:127.0.0.1:44819_ x:collection1 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1102264 T3202 n:127.0.0.1:44819_ x:collection1 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1102265 T3202 n:127.0.0.1:44819_ x:collection1 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 1102265 T3202 n:127.0.0.1:44819_ x:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1102265 T3202 n:127.0.0.1:44819_ x:collection1 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 1102266 T3202 n:127.0.0.1:44819_ x:collection1 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1102266 T3202 n:127.0.0.1:44819_ x:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 1102267 T3202 n:127.0.0.1:44819_ x:collection1 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1102267 T3202 n:127.0.0.1:44819_ x:collection1 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 1102267 T3202 n:127.0.0.1:44819_ x:collection1 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 1102268 T3203 n:127.0.0.1:44819_ x:collection1 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@67f8cdaa[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1102269 T3202 n:127.0.0.1:44819_ x:collection1 oasc.ZkController.getConfDirListeners watch zkdir /configs/conf1
[junit4] 2> 1102270 T3202 n:127.0.0.1:44819_ x:collection1 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1102271 T3206 n:127.0.0.1:44819_ c:collection1 s:shard1 x:collection1 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:44819 collection:collection1 shard:shard1
[junit4] 2> 1102271 T3145 n:127.0.0.1:44819_ oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0
[junit4] 2> 1102272 T3145 n:127.0.0.1:44819_ oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1102273 T3206 n:127.0.0.1:44819_ c:collection1 s:shard1 x:collection1 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 1102279 T3206 n:127.0.0.1:44819_ c:collection1 s:shard1 x:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 1102282 T3173 n:127.0.0.1:44753_ oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1102283 T3206 n:127.0.0.1:44819_ c:collection1 s:shard1 x:collection1 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 1102283 T3206 n:127.0.0.1:44819_ c:collection1 s:shard1 x:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C489 name=collection1 org.apache.solr.core.SolrCore@6beb84c0 url=http://127.0.0.1:44819/collection1 node=127.0.0.1:44819_ C489_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:44819, node_name=127.0.0.1:44819_, core=collection1}
[junit4] 2> 1102283 T3206 n:127.0.0.1:44819_ c:collection1 s:shard1 x:collection1 C489 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:44819/collection1/
[junit4] 2> 1102283 T3174 n:127.0.0.1:44753_ oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1"} current state version: 5
[junit4] 2> 1102284 T3206 n:127.0.0.1:44819_ c:collection1 s:shard1 x:collection1 C489 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 1102284 T3206 n:127.0.0.1:44819_ c:collection1 s:shard1 x:collection1 C489 oasc.SyncStrategy.syncToMe http://127.0.0.1:44819/collection1/ has no replicas
[junit4] 2> 1102285 T3206 n:127.0.0.1:44819_ c:collection1 s:shard1 x:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:44819/collection1/ shard1
[junit4] 2> 1102285 T3206 n:127.0.0.1:44819_ c:collection1 s:shard1 x:collection1 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 1102286 T3173 n:127.0.0.1:44753_ oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1102287 T3201 n:127.0.0.1:44819_ oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1102286 T3184 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1102296 T3173 n:127.0.0.1:44753_ oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1102297 T3174 n:127.0.0.1:44753_ oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "base_url":"http://127.0.0.1:44819",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 6
[junit4] 2> 1102407 T3173 n:127.0.0.1:44753_ oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1102407 T3184 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1102407 T3201 n:127.0.0.1:44819_ oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1102450 T3206 n:127.0.0.1:44819_ c:collection1 s:shard1 x:collection1 oasc.ZkController.register We are http://127.0.0.1:44819/collection1/ and leader is http://127.0.0.1:44819/collection1/
[junit4] 2> 1102450 T3206 n:127.0.0.1:44819_ c:collection1 s:shard1 x:collection1 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:44819
[junit4] 2> 1102451 T3206 n:127.0.0.1:44819_ c:collection1 s:shard1 x:collection1 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 1102451 T3206 n:127.0.0.1:44819_ c:collection1 s:shard1 x:collection1 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 1102451 T3206 n:127.0.0.1:44819_ c:collection1 s:shard1 x:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1102454 T3173 n:127.0.0.1:44753_ oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1102455 T3174 n:127.0.0.1:44753_ oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:44819",
[junit4] 2> "collection":"collection1",
[junit4] 2> "node_name":"127.0.0.1:44819_",
[junit4] 2> "roles":null,
[junit4] 2> "numShards":"2",
[junit4] 2> "core":"collection1",
[junit4] 2> "operation":"state",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core_node_name":"core_node1"} current state version: 7
[junit4] 2> 1102456 T3174 n:127.0.0.1:44753_ oasco.ReplicaMutator.updateState Update state numShards=2 message={
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:44819",
[junit4] 2> "collection":"collection1",
[junit4] 2> "node_name":"127.0.0.1:44819_",
[junit4] 2> "roles":null,
[junit4] 2> "numShards":"2",
[junit4] 2> "core":"collection1",
[junit4] 2> "operation":"state",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 1102561 T3184 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1102561 T3173 n:127.0.0.1:44753_ oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1102561 T3201 n:127.0.0.1:44819_ oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1106325 T3145 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest 278CBA37A9B41EBB-001/shard-2-001/cores/collection1
[junit4] 2> 1106329 T3145 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2 in directory /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest 278CBA37A9B41EBB-001/shard-2-001
[junit4] 2> 1106330 T3145 oejs.Server.doStart jetty-9.2.10.v20150310
[junit4] 2> 1106333 T3145 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@259364b2{/,null,AVAILABLE}
[junit4] 2> 1106334 T3145 oejs.AbstractConnector.doStart Started ServerConnector@164f6fe2{HTTP/1.1}{127.0.0.1:44861}
[junit4] 2> 1106335 T3145 oejs.Server.doStart Started @1112294ms
[junit4] 2> 1106335 T3145 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {hostPort=44861, solr.data.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest 278CBA37A9B41EBB-001/tempDir-001/jetty2, coreRootDirectory=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest 278CBA37A9B41EBB-001/shard-2-001/cores, solrconfig=solrconfig.xml, hostContext=/}
[junit4] 2> 1106336 T3145 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@57bd06bf
[junit4] 2> 1106336 T3145 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest 278CBA37A9B41EBB-001/shard-2-001/'
[junit4] 2> 1106433 T3145 oasc.SolrXmlConfig.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest 278CBA37A9B41EBB-001/shard-2-001/solr.xml
[junit4] 2> 1106546 T3145 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest 278CBA37A9B41EBB-001/shard-2-001/cores
[junit4] 2> 1106547 T3145 oasc.CoreContainer.<init> New CoreContainer 24294069
[junit4] 2> 1106547 T3145 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest 278CBA37A9B41EBB-001/shard-2-001/]
[junit4] 2> 1106565 T3145 oasc.CoreContainer.load loading shared library: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest 278CBA37A9B41EBB-001/shard-2-001/lib
[junit4] 2> 1106568 T3145 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest 278CBA37A9B41EBB-001/shard-2-001/lib).
[junit4] 2> 1106609 T3145 oashc.HttpShardHandlerFactory.init created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 1106639 T3145 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1106641 T3145 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1106641 T3145 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1106642 T3145 oasc.CoreContainer.load Node Name: 127.0.0.1
[junit4] 2> 1106642 T3145 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:44754/solr
[junit4] 2> 1106643 T3145 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1106643 T3145 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1106645 T3145 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1106663 T3220 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3b33b555 name:ZooKeeperConnection Watcher:127.0.0.1:44754 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1106663 T3145 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1106664 T3145 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1106669 T3145 n:127.0.0.1:44861_ oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1106672 T3223 n:127.0.0.1:44861_ oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@55adc308 name:ZooKeeperConnection Watcher:127.0.0.1:44754/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1106672 T3145 n:127.0.0.1:44861_ oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1106681 T3145 n:127.0.0.1:44861_ oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1107689 T3145 n:127.0.0.1:44861_ oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44861_
[junit4] 2> 1107690 T3145 n:127.0.0.1:44861_ oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:44861_
[junit4] 2> 1107698 T3145 n:127.0.0.1:44861_ oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 1107702 T3145 n:127.0.0.1:44861_ oasc.CorePropertiesLocator.discover Looking for core definitions underneath /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest 278CBA37A9B41EBB-001/shard-2-001/cores
[junit4] 2> 1107708 T3145 n:127.0.0.1:44861_ oasc.CoreDescriptor.<init> CORE DESCRIPTOR: {loadOnStartup=true, schema=schema.xml, transient=false, shard=, name=collection1, config=solrconfig.xml, coreNodeName=, absoluteInstDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest 278CBA37A9B41EBB-001/shard-2-001/cores/collection1/, collection=collection1, instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest 278CBA37A9B41EBB-001/shard-2-001/cores/collection1, dataDir=data/}
[junit4] 2> 1107708 T3145 n:127.0.0.1:44861_ oasc.CorePropertiesLocator.discoverUnder Found core collection1 in /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest 278CBA37A9B41EBB-001/shard-2-001/cores/collection1/
[junit4] 2> 1107709 T3145 n:127.0.0.1:44861_ oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1107710 T3224 n:127.0.0.1:44861_ c:collection1 x:collection1 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 1107711 T3224 n:127.0.0.1:44861_ c:collection1 x:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1107712 T3173 n:127.0.0.1:44753_ oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1107712 T3224 n:127.0.0.1:44861_ oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1107713 T3174 n:127.0.0.1:44753_ oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:44861",
[junit4] 2> "collection":"collection1",
[junit4] 2> "node_name":"127.0.0.1:44861_",
[junit4] 2> "roles":null,
[junit4] 2> "numShards":"2",
[junit4] 2> "core":"collection1",
[junit4] 2> "operation":"state",
[junit4] 2> "shard":null} current state version: 8
[junit4] 2> 1107714 T3174 n:127.0.0.1:44753_ oasco.ReplicaMutator.updateState Update state numShards=2 message={
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:44861",
[junit4] 2> "collection":"collection1",
[junit4] 2> "node_name":"127.0.0.1:44861_",
[junit4] 2> "roles":null,
[junit4] 2> "numShards":"2",
[junit4] 2> "core":"collection1",
[junit4] 2> "operation":"state",
[junit4] 2> "shard":null}
[junit4] 2> 1107715 T3174 n:127.0.0.1:44753_ oasco.ReplicaMutator.updateState Collection already exists with numShards=2
[junit4] 2> 1107715 T3174 n:127.0.0.1:44753_ oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard2
[junit4] 2> 1107717 T3201 n:127.0.0.1:44819_ oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1107717 T3184 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1107717 T3173 n:127.0.0.1:44753_ oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1107717 T3223 n:127.0.0.1:44861_ oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1108714 T3224 n:127.0.0.1:44861_ oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1108714 T3224 n:127.0.0.1:44861_ oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 1108715 T3224 n:127.0.0.1:44861_ oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1108715 T3224 n:127.0.0.1:44861_ oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1108717 T3224 n:127.0.0.1:44861_ oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1108717 T3224 n:127.0.0.1:44861_ oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest 278CBA37A9B41EBB-001/shard-2-001/cores/collection1/'
[junit4] 2> 1108776 T3224 n:127.0.0.1:44861_ oasc.Config.<init> loaded config solrconfig.xml with version 0
[junit4] 2> 1108817 T3224 n:127.0.0.1:44861_ oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
[junit4] 2> 1108841 T3224 n:127.0.0.1:44861_ oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.2.0
[junit4] 2> 1108894 T3224 n:127.0.0.1:44861_ oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1108895 T3224 n:127.0.0.1:44861_ oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 1108906 T3224 n:127.0.0.1:44861_ oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1109611 T3224 n:127.0.0.1:44861_ oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1109617 T3224 n:127.0.0.1:44861_ oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1109621 T3224 n:127.0.0.1:44861_ oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1109630 T3224 n:127.0.0.1:44861_ oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1109664 T3224 n:127.0.0.1:44861_ oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 1109665 T3224 n:127.0.0.1:44861_ x:collection1 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1109666 T3224 n:127.0.0.1:44861_ x:collection1 oasc.SolrCore.<init> [[collection1] ] Opening new SolrCore at [/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest 278CBA37A9B41EBB-001/shard-2-001/cores/collection1/], dataDir=[null]
[junit4] 2> 1109666 T3224 n:127.0.0.1:44861_ x:collection1 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6a312a17
[junit4] 2> 1109667 T3224 n:127.0.0.1:44861_ x:collection1 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest 278CBA37A9B41EBB-001/shard-2-001/cores/collection1/data
[junit4] 2> 1109668 T3224 n:127.0.0.1:44861_ x:collection1 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/L
[...truncated too long message...]
<str name="type">string</str>
[junit4] > <bool name="stored">true</bool>
[junit4] > <bool name="omitNorms">true</bool>
[junit4] > <bool name="indexed">true</bool>
[junit4] > </lst>
[junit4] > <lst>
[junit4] > <str name="name">tlong</str>
[junit4] > <str name="type">tlong</str>
[junit4] > <bool name="stored">true</bool>
[junit4] > <bool name="indexed">true</bool>
[junit4] > </lst>
[junit4] > <lst>
[junit4] > <str name="name">uuid</str>
[junit4] > <str name="type">uuid</str>
[junit4] > <bool name="stored">true</bool>
[junit4] > </lst>
[junit4] > <lst>
[junit4] > <str name="name">wdf_nocase</str>
[junit4] > <str name="type">wdf_nocase</str>
[junit4] > <bool name="stored">true</bool>
[junit4] > <bool name="indexed">true</bool>
[junit4] > </lst>
[junit4] > <lst>
[junit4] > <str name="name">wdf_preserve</str>
[junit4] > <str name="type">wdf_preserve</str>
[junit4] > <bool name="stored">true</bool>
[junit4] > <bool name="indexed">true</bool>
[junit4] > </lst>
[junit4] > <lst>
[junit4] > <str name="name">weight</str>
[junit4] > <str name="type">float</str>
[junit4] > <bool name="stored">true</bool>
[junit4] > <bool name="multiValued">false</bool>
[junit4] > <bool name="indexed">true</bool>
[junit4] > </lst>
[junit4] > <lst>
[junit4] > <str name="name">whitetok</str>
[junit4] > <str name="type">whitetok</str>
[junit4] > <bool name="stored">true</bool>
[junit4] > <bool name="indexed">true</bool>
[junit4] > </lst>
[junit4] > <lst>
[junit4] > <str name="name">work</str>
[junit4] > <str name="type">xy</str>
[junit4] > <bool name="stored">true</bool>
[junit4] > <bool name="multiValued">false</bool>
[junit4] > <bool name="indexed">true</bool>
[junit4] > </lst>
[junit4] > <lst>
[junit4] > <str name="name">work_ll</str>
[junit4] > <str name="type">latLon</str>
[junit4] > <bool name="stored">true</bool>
[junit4] > <bool name="multiValued">false</bool>
[junit4] > <bool name="indexed">true</bool>
[junit4] > </lst>
[junit4] > <lst>
[junit4] > <str name="name">x</str>
[junit4] > <str name="type">x</str>
[junit4] > <bool name="stored">true</bool>
[junit4] > <bool name="multiValued">false</bool>
[junit4] > <bool name="indexed">true</bool>
[junit4] > </lst>
[junit4] > </arr>
[junit4] > </response>
[junit4] > at org.apache.solr.schema.TestCloudManagedSchemaConcurrent.schemaLockTest(TestCloudManagedSchemaConcurrent.java:713)
[junit4] > at org.apache.solr.schema.TestCloudManagedSchemaConcurrent.test(TestCloudManagedSchemaConcurrent.java:253)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:960)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:935)
[junit4] > at java.lang.Thread.run(Thread.java:745)Throwable #2: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=5185, name=Thread-1864, state=RUNNABLE, group=TGRP-TestCloudManagedSchemaConcurrent]
[junit4] > Caused by: java.lang.RuntimeException: org.apache.http.NoHttpResponseException: 127.0.0.1:63193 failed to respond
[junit4] > at __randomizedtesting.SeedInfo.seed([278CBA37A9B41EBB]:0)
[junit4] > at org.apache.solr.schema.TestCloudManagedSchemaConcurrent$PostDynamicFieldThread.run(TestCloudManagedSchemaConcurrent.java:611)
[junit4] > Caused by: org.apache.http.NoHttpResponseException: 127.0.0.1:63193 failed to respond
[junit4] > at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:143)
[junit4] > at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
[junit4] > at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
[junit4] > at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
[junit4] > at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
[junit4] > at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
[junit4] > at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
[junit4] > at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
[junit4] > at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
[junit4] > at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
[junit4] > at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
[junit4] > at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
[junit4] > at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
[junit4] > at org.apache.solr.util.RestTestHarness.getResponse(RestTestHarness.java:208)
[junit4] > at org.apache.solr.util.RestTestHarness.post(RestTestHarness.java:148)
[junit4] > at org.apache.solr.schema.TestCloudManagedSchemaConcurrent.addFieldPost(TestCloudManagedSchemaConcurrent.java:125)
[junit4] > at org.apache.solr.schema.TestCloudManagedSchemaConcurrent.access$200(TestCloudManagedSchemaConcurrent.java:45)
[junit4] > at org.apache.solr.schema.TestCloudManagedSchemaConcurrent$PostDynamicFieldThread.run(TestCloudManagedSchemaConcurrent.java:608)
[junit4] 2> 1312936 T3275 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.schema.TestCloudManagedSchemaConcurrent 278CBA37A9B41EBB-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene50): {}, docValues:{}, sim=DefaultSimilarity, locale=ko, timezone=Antarctica/McMurdo
[junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_65 (64-bit)/cpus=16,threads=1,free=49561048,total=362283008
[junit4] 2> NOTE: All tests run in this JVM: [RulesTest, SpellPossibilityIteratorTest, TestStressLucene, TestFunctionQuery, TestRawResponseWriter, EchoParamsTest, TestSystemIdResolver, UpdateParamsTest, DirectUpdateHandlerTest, TestFreeTextSuggestions, TestSchemaSimilarityResource, DisMaxRequestHandlerTest, DirectSolrSpellCheckerTest, TestTrackingShardHandlerFactory, BadComponentTest, TestRequestStatusCollectionAPI, TestIndexSearcher, HdfsLockFactoryTest, TestInfoStreamLogging, TestFieldResource, TestSearchPerf, CoreMergeIndexesAdminHandlerTest, TestDistributedSearch, TestHdfsUpdateLog, SharedFSAutoReplicaFailoverUtilsTest, SolrIndexConfigTest, TestAnalyzeInfixSuggestions, TestReplicationHandler, SoftAutoCommitTest, TestSurroundQueryParser, RecoveryAfterSoftCommitTest, IgnoreCommitOptimizeUpdateProcessorFactoryTest, VMParamsZkACLAndCredentialsProvidersTest, TestExpandComponent, TestDefaultStatsCache, LukeRequestHandlerTest, SOLR749Test, PrimUtilsTest, SolrTestCaseJ4Test, PingRequestHandlerTest, DateRangeFieldTest, TestManagedSchemaFieldResource, TestMiniSolrCloudClusterSSL, TestFuzzyAnalyzedSuggestions, TestLRUCache, SimpleFacetsTest, TestCodecSupport, CSVRequestHandlerTest, TestMacros, CachingDirectoryFactoryTest, TestPerFieldSimilarity, CollectionReloadTest, TestBM25SimilarityFactory, TestBulkSchemaAPI, ConcurrentDeleteAndCreateCollectionTest, RollingRestartTest, SolrPluginUtilsTest, SpellCheckCollatorTest, TestJmxMonitoredMap, TestCloudManagedSchemaConcurrent]
[junit4] Completed [249/488] on J2 in 343.47s, 1 test, 1 error <<< FAILURES!
[...truncated 758 lines...]
BUILD FAILED
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/build.xml:536: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/build.xml:484: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/build.xml:61: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/extra-targets.xml:39: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build.xml:229: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/common-build.xml:511: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/lucene/common-build.xml:1433: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/lucene/common-build.xml:991: There were test failures: 488 suites, 1958 tests, 1 error, 1 failure, 71 ignored (26 assumptions)
Total time: 56 minutes 59 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Sending artifact delta relative to Lucene-Solr-Tests-5.x-Java7 #3101
Archived 5 artifacts
Archive block size is 32768
Received 0 blocks and 222497745 bytes
Compression is 0.0%
Took 46 sec
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure