You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2013/06/24 19:09:25 UTC
[JENKINS] Lucene-Solr-4.x-Linux (32bit/jdk1.8.0-ea-b93) - Build #
6219 - Failure!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/6219/
Java: 32bit/jdk1.8.0-ea-b93 -server -XX:+UseParallelGC
2 tests failed.
REGRESSION: org.apache.solr.cloud.RecoveryZkTest.testDistribSearch
Error Message:
expected:<228> but was:<50>
Stack Trace:
java.lang.AssertionError: expected:<228> but was:<50>
at __randomizedtesting.SeedInfo.seed([B34D49CB18AA1670:32ABC7D36FF5764C]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.cloud.RecoveryZkTest.doTest(RecoveryZkTest.java:108)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:491)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:724)
REGRESSION: org.apache.solr.cloud.SyncSliceTest.testDistribSearch
Error Message:
shard1 is not consistent. Got 305 from http://127.0.0.1:55817/collection1lastClient and got 234 from http://127.0.0.1:55964/collection1
Stack Trace:
java.lang.AssertionError: shard1 is not consistent. Got 305 from http://127.0.0.1:55817/collection1lastClient and got 234 from http://127.0.0.1:55964/collection1
at __randomizedtesting.SeedInfo.seed([B34D49CB18AA1670:32ABC7D36FF5764C]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1018)
at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:238)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:491)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:724)
Build Log:
[...truncated 9443 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.SyncSliceTest
[junit4:junit4] 2> 28499 T46 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4] 2> 28506 T46 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-SyncSliceTest-1372092783440
[junit4:junit4] 2> 28510 T46 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 28512 T47 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 28712 T46 oasc.ZkTestServer.run start zk server on port:44481
[junit4:junit4] 2> 28755 T46 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 29092 T53 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1bb6856 name:ZooKeeperConnection Watcher:127.0.0.1:44481 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 29092 T46 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 29093 T46 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 29117 T46 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 29119 T55 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1a69866 name:ZooKeeperConnection Watcher:127.0.0.1:44481/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 29119 T46 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 29121 T46 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 29126 T46 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 29130 T46 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 29134 T46 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 29139 T46 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 29139 T46 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 29146 T46 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 29146 T46 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 29151 T46 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 29151 T46 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 29155 T46 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 29155 T46 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 29159 T46 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 29159 T46 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 29163 T46 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 29163 T46 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 29168 T46 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 29168 T46 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 29175 T46 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 29176 T46 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 29182 T46 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 29182 T46 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 29404 T46 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 29498 T46 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:39579
[junit4:junit4] 2> 29513 T46 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 29514 T46 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 29514 T46 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1372092784123
[junit4:junit4] 2> 29515 T46 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1372092784123/solr.xml
[junit4:junit4] 2> 29516 T46 oasc.CoreContainer.<init> New CoreContainer 6197123
[junit4:junit4] 2> 29516 T46 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1372092784123/'
[junit4:junit4] 2> 29517 T46 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1372092784123/'
[junit4:junit4] 2> 29598 T46 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 29598 T46 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 29598 T46 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 29599 T46 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 29599 T46 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 29600 T46 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 29619 T46 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 29620 T46 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 29621 T46 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 29641 T46 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 29944 T46 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 29945 T46 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:44481/solr
[junit4:junit4] 2> 29952 T46 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 29953 T46 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 29956 T68 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b1eef0 name:ZooKeeperConnection Watcher:127.0.0.1:44481 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 29957 T46 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 29961 T46 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 29972 T46 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 29975 T70 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1738b89 name:ZooKeeperConnection Watcher:127.0.0.1:44481/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 29975 T46 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 29981 T46 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 29991 T46 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 30000 T46 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 30004 T46 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39579_
[junit4:junit4] 2> 30007 T46 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:39579_
[junit4:junit4] 2> 30012 T46 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 30028 T46 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 30032 T46 oasc.Overseer.start Overseer (id=89921472665485315-127.0.0.1:39579_-n_0000000000) starting
[junit4:junit4] 2> 30041 T46 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 30054 T72 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 30063 T46 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 30071 T46 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 30074 T46 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 30085 T71 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 30102 T73 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 30102 T73 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 31591 T71 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 31593 T71 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "node_name":"127.0.0.1:39579_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:39579",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard_state":"active"}
[junit4:junit4] 2> 31593 T71 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 31596 T71 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 31607 T70 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 32108 T73 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1372092784123/collection1
[junit4:junit4] 2> 32109 T73 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 32111 T73 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 32111 T73 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 32115 T73 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1372092784123/collection1/'
[junit4:junit4] 2> 32116 T73 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1372092784123/collection1/lib/README' to classloader
[junit4:junit4] 2> 32116 T73 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1372092784123/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 32164 T73 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 32212 T73 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 32214 T73 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 32230 T73 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 32602 T73 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4:junit4] 2> 32602 T73 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4:junit4] 2> 32611 T73 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 32620 T73 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 32624 T73 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 32651 T73 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 32655 T73 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 32658 T73 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 32661 T73 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 32661 T73 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 32661 T73 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 32662 T73 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 32662 T73 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 32663 T73 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 32671 T73 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1372092784123/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1372092783440/control/data/
[junit4:junit4] 2> 32673 T73 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@9fe090
[junit4:junit4] 2> 32673 T73 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 32674 T73 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/control/data
[junit4:junit4] 2> 32674 T73 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1372092783440/control/data/index/
[junit4:junit4] 2> 32675 T73 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1372092783440/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 32675 T73 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/control/data/index
[junit4:junit4] 2> 32681 T73 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6f06ac; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 32681 T73 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 32700 T73 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 32701 T73 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 32701 T73 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 32702 T73 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 32702 T73 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 32702 T73 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 32703 T73 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 32703 T73 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 32703 T73 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 32705 T73 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 32708 T73 oass.SolrIndexSearcher.<init> Opening Searcher@14c07e5 main
[junit4:junit4] 2> 32716 T73 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 32716 T73 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 32719 T74 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@14c07e5 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 32720 T73 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 32721 T73 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:39579 collection:control_collection shard:shard1
[junit4:junit4] 2> 32725 T73 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4] 2> 32733 T73 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 32745 T73 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 32749 T73 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 32749 T73 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 32751 T73 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:39579/collection1/
[junit4:junit4] 2> 32751 T73 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 32752 T73 oasc.SyncStrategy.syncToMe http://127.0.0.1:39579/collection1/ has no replicas
[junit4:junit4] 2> 32752 T73 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:39579/collection1/
[junit4:junit4] 2> 32752 T73 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 33112 T71 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 33122 T70 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 33161 T73 oasc.ZkController.register We are http://127.0.0.1:39579/collection1/ and leader is http://127.0.0.1:39579/collection1/
[junit4:junit4] 2> 33163 T73 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:39579
[junit4:junit4] 2> 33163 T73 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 33163 T73 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 33163 T73 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 33165 T73 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 33168 T46 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 33168 T46 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 33184 T46 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 33190 T46 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 33192 T46 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 33194 T77 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6d4b1b name:ZooKeeperConnection Watcher:127.0.0.1:44481/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 33194 T46 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 33195 T46 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 33199 T46 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 33273 T46 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 33275 T46 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:55817
[junit4:junit4] 2> 33276 T46 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 33277 T46 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 33277 T46 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1372092788133
[junit4:junit4] 2> 33278 T46 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1372092788133/solr.xml
[junit4:junit4] 2> 33278 T46 oasc.CoreContainer.<init> New CoreContainer 17424964
[junit4:junit4] 2> 33279 T46 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1372092788133/'
[junit4:junit4] 2> 33280 T46 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1372092788133/'
[junit4:junit4] 2> 33330 T46 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 33331 T46 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 33331 T46 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 33332 T46 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 33332 T46 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 33333 T46 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 33333 T46 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 33334 T46 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 33334 T46 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 33335 T46 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 33341 T46 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 33342 T46 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:44481/solr
[junit4:junit4] 2> 33343 T46 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 33344 T46 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 33346 T88 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a3aeea name:ZooKeeperConnection Watcher:127.0.0.1:44481 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 33346 T46 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 33348 T46 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 33354 T46 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 33356 T90 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@18d4cdc name:ZooKeeperConnection Watcher:127.0.0.1:44481/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 33356 T46 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 33361 T46 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 34365 T46 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55817_
[junit4:junit4] 2> 34366 T46 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55817_
[junit4:junit4] 2> 34369 T70 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 34370 T77 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 34370 T90 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 34371 T70 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 34377 T91 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 34377 T91 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 34630 T71 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 34631 T71 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "node_name":"127.0.0.1:39579_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:39579",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:39579__collection1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard_state":"active"}
[junit4:junit4] 2> 34635 T71 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "node_name":"127.0.0.1:55817_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:55817",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard_state":"active"}
[junit4:junit4] 2> 34635 T71 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 1
[junit4:junit4] 2> 34635 T71 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 34640 T70 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 34640 T77 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 34640 T90 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 35379 T91 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1372092788133/collection1
[junit4:junit4] 2> 35379 T91 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 35380 T91 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 35380 T91 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 35382 T91 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1372092788133/collection1/'
[junit4:junit4] 2> 35383 T91 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty1-1372092788133/collection1/lib/README' to classloader
[junit4:junit4] 2> 35383 T91 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty1-1372092788133/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 35410 T91 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 35441 T91 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 35443 T91 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 35457 T91 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 35781 T91 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4:junit4] 2> 35781 T91 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4:junit4] 2> 35782 T91 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 35794 T91 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 35797 T91 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 35817 T91 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 35821 T91 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 35825 T91 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 35826 T91 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 35826 T91 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 35827 T91 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 35828 T91 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 35828 T91 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 35829 T91 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 35829 T91 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1372092788133/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty1/
[junit4:junit4] 2> 35829 T91 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@9fe090
[junit4:junit4] 2> 35830 T91 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 35830 T91 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty1
[junit4:junit4] 2> 35831 T91 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty1/index/
[junit4:junit4] 2> 35831 T91 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 35832 T91 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty1/index
[junit4:junit4] 2> 35837 T91 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@157e3e; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 35837 T91 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 35840 T91 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 35841 T91 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 35841 T91 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 35842 T91 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 35843 T91 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 35843 T91 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 35843 T91 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 35844 T91 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 35845 T91 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 35847 T91 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 35850 T91 oass.SolrIndexSearcher.<init> Opening Searcher@1940589 main
[junit4:junit4] 2> 35851 T91 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 35851 T91 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 35856 T92 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1940589 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 35858 T91 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 35858 T91 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:55817 collection:collection1 shard:shard1
[junit4:junit4] 2> 35859 T91 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 35867 T91 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 35870 T91 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 35871 T91 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 35871 T91 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:55817/collection1/
[junit4:junit4] 2> 35871 T91 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 35871 T91 oasc.SyncStrategy.syncToMe http://127.0.0.1:55817/collection1/ has no replicas
[junit4:junit4] 2> 35871 T91 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:55817/collection1/
[junit4:junit4] 2> 35872 T91 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 36150 T71 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 36159 T90 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 36159 T70 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 36159 T77 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 36179 T91 oasc.ZkController.register We are http://127.0.0.1:55817/collection1/ and leader is http://127.0.0.1:55817/collection1/
[junit4:junit4] 2> 36180 T91 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:55817
[junit4:junit4] 2> 36180 T91 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 36180 T91 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 36180 T91 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 36182 T91 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 36183 T46 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 36183 T46 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 36184 T46 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 36263 T46 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 36265 T46 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:36706
[junit4:junit4] 2> 36266 T46 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 36266 T46 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 36267 T46 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1372092791120
[junit4:junit4] 2> 36267 T46 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1372092791120/solr.xml
[junit4:junit4] 2> 36267 T46 oasc.CoreContainer.<init> New CoreContainer 31551511
[junit4:junit4] 2> 36268 T46 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1372092791120/'
[junit4:junit4] 2> 36268 T46 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1372092791120/'
[junit4:junit4] 2> 36316 T46 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 36316 T46 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 36316 T46 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 36317 T46 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 36317 T46 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 36317 T46 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 36317 T46 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 36318 T46 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 36318 T46 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 36318 T46 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 36322 T46 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 36323 T46 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:44481/solr
[junit4:junit4] 2> 36323 T46 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 36324 T46 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 36325 T104 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1fd994e name:ZooKeeperConnection Watcher:127.0.0.1:44481 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 36326 T46 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 36328 T46 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 36331 T46 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 36332 T106 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@17abc44 name:ZooKeeperConnection Watcher:127.0.0.1:44481/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 36332 T46 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 36336 T46 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 37340 T46 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36706_
[junit4:junit4] 2> 37341 T46 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:36706_
[junit4:junit4] 2> 37344 T90 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 37345 T77 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 37345 T70 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 37345 T77 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 37345 T106 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 37345 T70 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 37346 T90 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 37351 T107 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 37352 T107 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 37667 T71 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 37668 T71 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "node_name":"127.0.0.1:55817_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:55817",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:55817__collection1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard_state":"active"}
[junit4:junit4] 2> 37673 T71 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "node_name":"127.0.0.1:36706_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:36706",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard_state":"active"}
[junit4:junit4] 2> 37673 T71 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 37673 T71 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 37678 T77 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 37678 T90 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 37678 T70 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 37678 T106 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 38353 T107 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1372092791120/collection1
[junit4:junit4] 2> 38353 T107 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 38354 T107 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 38354 T107 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 38356 T107 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1372092791120/collection1/'
[junit4:junit4] 2> 38356 T107 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty2-1372092791120/collection1/lib/README' to classloader
[junit4:junit4] 2> 38357 T107 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty2-1372092791120/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 38382 T107 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 38412 T107 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 38413 T107 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 38425 T107 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 38731 T107 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4:junit4] 2> 38731 T107 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4:junit4] 2> 38732 T107 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 38740 T107 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 38742 T107 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 38761 T107 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 38764 T107 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 38767 T107 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 38769 T107 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 38769 T107 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 38769 T107 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 38770 T107 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 38771 T107 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 38771 T107 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 38771 T107 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1372092791120/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty2/
[junit4:junit4] 2> 38771 T107 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@9fe090
[junit4:junit4] 2> 38772 T107 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 38772 T107 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty2
[junit4:junit4] 2> 38772 T107 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty2/index/
[junit4:junit4] 2> 38773 T107 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 38773 T107 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty2/index
[junit4:junit4] 2> 38776 T107 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@49f599; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 38776 T107 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 38778 T107 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 38779 T107 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 38779 T107 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 38780 T107 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 38780 T107 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 38780 T107 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 38781 T107 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 38781 T107 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 38781 T107 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 38783 T107 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 38786 T107 oass.SolrIndexSearcher.<init> Opening Searcher@224773 main
[junit4:junit4] 2> 38786 T107 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 38786 T107 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 38791 T108 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@224773 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 38793 T107 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 38793 T107 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:36706 collection:collection1 shard:shard1
[junit4:junit4] 2> 38798 T107 oasc.ZkController.register We are http://127.0.0.1:36706/collection1/ and leader is http://127.0.0.1:55817/collection1/
[junit4:junit4] 2> 38798 T107 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:36706
[junit4:junit4] 2> 38798 T107 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 38799 T107 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C68 name=collection1 org.apache.solr.core.SolrCore@1348132 url=http://127.0.0.1:36706/collection1 node=127.0.0.1:36706_ C68_STATE=coll:collection1 core:collection1 props:{core=collection1, state=down, node_name=127.0.0.1:36706_, base_url=http://127.0.0.1:36706, collection=collection1}
[junit4:junit4] 2> 38802 T109 C68 P36706 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 38802 T107 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 38803 T109 C68 P36706 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 38803 T109 C68 P36706 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 38803 T109 C68 P36706 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 38803 T46 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 38804 T46 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 38804 T109 C68 P36706 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 38804 T46 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 38877 T46 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 38879 T46 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:55964
[junit4:junit4] 2> 38880 T46 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 38881 T46 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 38881 T46 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1372092793741
[junit4:junit4] 2> 38881 T46 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1372092793741/solr.xml
[junit4:junit4] 2> 38881 T46 oasc.CoreContainer.<init> New CoreContainer 21529259
[junit4:junit4] 2> 38882 T46 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1372092793741/'
[junit4:junit4] 2> 38882 T46 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1372092793741/'
[junit4:junit4] 2> 38929 T46 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 38929 T46 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 38930 T46 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 38930 T46 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 38930 T46 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 38930 T46 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 38931 T46 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 38931 T46 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 38931 T46 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 38932 T46 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 38935 T46 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 38936 T46 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:44481/solr
[junit4:junit4] 2> 38936 T46 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 38937 T46 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 38939 T121 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f96b96 name:ZooKeeperConnection Watcher:127.0.0.1:44481 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 38939 T46 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 38941 T46 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 38949 T46 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 38953 T123 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f13c14 name:ZooKeeperConnection Watcher:127.0.0.1:44481/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 38953 T46 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 38958 T46 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 39039 T83 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:36706__collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 39186 T71 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 39189 T71 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "node_name":"127.0.0.1:36706_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:36706",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:36706__collection1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard_state":"active"}
[junit4:junit4] 2> 39200 T77 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 39201 T90 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 39201 T123 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 39201 T70 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 39200 T106 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 39962 T46 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55964_
[junit4:junit4] 2> 39963 T46 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55964_
[junit4:junit4] 2> 39966 T106 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 39966 T77 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 39966 T90 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 39966 T123 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 39969 T70 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 39969 T70 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 39969 T90 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 39969 T106 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 39970 T77 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 39976 T123 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 39977 T124 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 39977 T124 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 40040 T83 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:36706__collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 40041 T83 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={wt=javabin&coreNodeName=127.0.0.1:36706__collection1&state=recovering&core=collection1&version=2&onlyIfLeader=true&action=PREPRECOVERY&nodeName=127.0.0.1:36706_&checkLive=true} status=0 QTime=1003
[junit4:junit4] 2> 40709 T71 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 40710 T71 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "node_name":"127.0.0.1:55964_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:55964",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard_state":"active"}
[junit4:junit4] 2> 40710 T71 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 40710 T71 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 40715 T106 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 40715 T90 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 40716 T70 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 40715 T123 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 40715 T77 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 40979 T124 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1372092793741/collection1
[junit4:junit4] 2> 40979 T124 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 40980 T124 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 40980 T124 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 40982 T124 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1372092793741/collection1/'
[junit4:junit4] 2> 40982 T124 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty3-1372092793741/collection1/lib/README' to classloader
[junit4:junit4] 2> 40983 T124 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty3-1372092793741/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 41029 T124 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 41075 T124 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 41076 T124 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 41086 T124 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 41477 T124 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4:junit4] 2> 41477 T124 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4:junit4] 2> 41478 T124 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 41488 T124 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 41490 T124 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 41513 T124 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 41518 T124 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 41523 T124 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 41524 T124 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 41524 T124 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 41525 T124 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 41526 T124 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 41526 T124 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 41526 T124 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 41527 T124 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1372092793741/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty3/
[junit4:junit4] 2> 41527 T124 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@9fe090
[junit4:junit4] 2> 41527 T124 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 41528 T124 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty3
[junit4:junit4] 2> 41528 T124 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty3/index/
[junit4:junit4] 2> 41528 T124 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 41528 T124 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty3/index
[junit4:junit4] 2> 41531 T124 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@11715c3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 41532 T124 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 41534 T124 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 41534 T124 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 41534 T124 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 41535 T124 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 41535 T124 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 41536 T124 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 41536 T124 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 41536 T124 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 41537 T124 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 41539 T124 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 41541 T124 oass.SolrIndexSearcher.<init> Opening Searcher@10e6763 main
[junit4:junit4] 2> 41542 T124 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 41542 T124 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 41547 T125 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@10e6763 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 41549 T124 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 41549 T124 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:55964 collection:collection1 shard:shard1
[junit4:junit4] 2> 41553 T124 oasc.ZkController.register We are http://127.0.0.1:55964/collection1/ and leader is http://127.0.0.1:55817/collection1/
[junit4:junit4] 2> 41554 T124 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:55964
[junit4:junit4] 2> 41554 T124 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 41554 T124 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C69 name=collection1 org.apache.solr.core.SolrCore@1e8f7c4 url=http://127.0.0.1:55964/collection1 node=127.0.0.1:55964_ C69_STATE=coll:collection1 core:collection1 props:{core=collection1, state=down, node_name=127.0.0.1:55964_, base_url=http://127.0.0.1:55964, collection=collection1}
[junit4:junit4] 2> 41554 T126 C69 P55964 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 41555 T126 C69 P55964 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 41555 T124 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 41555 T126 C69 P55964 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 41555 T126 C69 P55964 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 41556 T46 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 41557 T46 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 41557 T126 C69 P55964 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 41557 T46 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 41563 T85 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:55964__collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 41647 T46 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 41650 T46 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:40573
[junit4:junit4] 2> 41651 T46 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 41651 T46 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 41651 T46 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1372092796495
[junit4:junit4] 2> 41652 T46 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1372092796495/solr.xml
[junit4:junit4] 2> 41652 T46 oasc.CoreContainer.<init> New CoreContainer 14101475
[junit4:junit4] 2> 41652 T46 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1372092796495/'
[junit4:junit4] 2> 41653 T46 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1372092796495/'
[junit4:junit4] 2> 41694 T46 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 41694 T46 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 41695 T46 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 41696 T46 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 41696 T46 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 41697 T46 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 41697 T46 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 41697 T46 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 41697 T46 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 41698 T46 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 41703 T46 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 41703 T46 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:44481/solr
[junit4:junit4] 2> 41703 T46 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 41704 T46 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 41706 T138 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b28ec1 name:ZooKeeperConnection Watcher:127.0.0.1:44481 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 41706 T46 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 41708 T46 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 41711 T46 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 41713 T140 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3f3f85 name:ZooKeeperConnection Watcher:127.0.0.1:44481/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 41713 T46 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 41716 T46 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> ASYNC NEW_CORE C70 name=collection1 org.apache.solr.core.SolrCore@1348132 url=http://127.0.0.1:36706/collection1 node=127.0.0.1:36706_ C70_STATE=coll:collection1 core:collection1 props:{core=collection1, state=recovering, node_name=127.0.0.1:36706_, base_url=http://127.0.0.1:36706, collection=collection1, shard=shard1}
[junit4:junit4] 2> 42072 T109 C70 P36706 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:55817/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 42077 T109 C70 P36706 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4] 2> 42082 T109 C70 P36706 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:36706 START replicas=[http://127.0.0.1:55817/collection1/] nUpdates=100
[junit4:junit4] 2> 42085 T109 C70 P36706 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 42086 T109 C70 P36706 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 42086 T109 C70 P36706 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 42086 T109 C70 P36706 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 42086 T109 C70 P36706 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 42087 T109 C70 P36706 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:55817/collection1/. core=collection1
[junit4:junit4] 2> 42087 T109 C70 P36706 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C71 name=collection1 org.apache.solr.core.SolrCore@18bcc8a url=http://127.0.0.1:55817/collection1 node=127.0.0.1:55817_ C71_STATE=coll:collection1 core:collection1 props:{core=collection1, state=active, node_name=127.0.0.1:55817_, base_url=http://127.0.0.1:55817, collection=collection1, shard=shard1, leader=true}
[junit4:junit4] 2> 42110 T83 C71 P55817 oasc.SolrCore.execute [collection1] webapp= path=/get params={wt=javabin&qt=/get&version=2&distrib=false&getVersions=100} status=0 QTime=1
[junit4:junit4] 2> 42117 T84 C71 P55817 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 42119 T84 C71 P55817 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@157e3e; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 42120 T84 C71 P55817 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 42130 T84 C71 P55817 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@157e3e; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@157e3e; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> 42130 T84 C71 P55817 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 42131 T84 C71 P55817 oass.SolrIndexSearcher.<init> Opening Searcher@8c3fa4 realtime
[junit4:junit4] 2> 42131 T84 C71 P55817 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 42132 T84 C71 P55817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2&commit_end_point=true&waitSearcher=true&commit=true&openSearcher=false&softCommit=false} {commit=} 0 23
[junit4:junit4] 2> 42160 T109 C70 P36706 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 42160 T109 C70 P36706 oascsi.HttpClientUtil.createClient Creating new http client, config:connTimeout=5000&socketTimeout=20000&allowCompression=false&maxConnections=10000&maxConnectionsPerHost=10000
[junit4:junit4] 2> 42170 T109 C70 P36706 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 42188 T83 C71 P55817 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 42189 T83 C71 P55817 oasc.SolrCore.execute [collection1] webapp= path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=17
[junit4:junit4] 2> 42190 T109 C70 P36706 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 42191 T109 C70 P36706 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 42191 T109 C70 P36706 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 42194 T84 C71 P55817 oasc.SolrCore.execute [collection1] webapp= path=/replication params={qt=/replication&wt=javabin&version=2&generation=2&command=filelist} status=0 QTime=1
[junit4:junit4] 2> 42195 T109 C70 P36706 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 42196 T109 C70 P36706 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty2/index.20130624125317129
[junit4:junit4] 2> 42197 T109 C70 P36706 oash.SnapPuller.fetchLatestIndex Starting download to NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty2/index.20130624125317129 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1c5d22e; maxCacheMB=48.0 maxMergeSizeMB=4.0) fullCopy=false
[junit4:junit4] 2> 42203 T86 C71 P55817 oasc.SolrCore.execute [collection1] webapp= path=/replication params={wt=filestream&qt=/replication&file=segments_2&generation=2&command=filecontent&checksum=true} status=0 QTime=1
[junit4:junit4] 2> 42208 T109 C70 P36706 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 42221 T71 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 42222 T71 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "node_name":"127.0.0.1:55964_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:55964",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:55964__collection1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard_state":"active"}
[junit4:junit4] 2> 42227 T140 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 42227 T123 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 42227 T70 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 42232 T77 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 42232 T90 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 42227 T106 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 42237 T109 C70 P36706 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 42238 T109 C70 P36706 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 42243 T109 C70 P36706 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@49f599; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@49f599; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> 42244 T109 C70 P36706 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 42245 T109 C70 P36706 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 42246 T109 C70 P36706 oass.SolrIndexSearcher.<init> Opening Searcher@16fd96c main
[junit4:junit4] 2> 42247 T108 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@16fd96c main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 42248 T109 C70 P36706 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty2/index.20130624125317129 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty2/index.20130624125317129;done=true>>]
[junit4:junit4] 2> 42249 T109 C70 P36706 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty2/index.20130624125317129
[junit4:junit4] 2> 42249 T109 C70 P36706 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty2/index.20130624125317129
[junit4:junit4] 2> 42250 T109 C70 P36706 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 42251 T109 C70 P36706 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 42251 T109 C70 P36706 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 42252 T109 C70 P36706 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 42253 T109 C70 P36706 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 42564 T85 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:55964__collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 42565 T85 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={wt=javabin&coreNodeName=127.0.0.1:55964__collection1&state=recovering&core=collection1&version=2&onlyIfLeader=true&action=PREPRECOVERY&nodeName=127.0.0.1:55964_&checkLive=true} status=0 QTime=1002
[junit4:junit4] 2> 42720 T46 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40573_
[junit4:junit4] 2> 42721 T46 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:40573_
[junit4:junit4] 2> 42723 T90 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 42724 T123 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 42724 T106 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 42724 T140 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 42725 T106 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 42724 T77 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 42725 T70 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 42726 T70 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 42726 T90 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 42728 T123 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 42728 T77 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 42729 T140 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 42733 T143 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 42734 T143 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 43739 T71 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 43740 T71 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "node_name":"127.0.0.1:36706_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:36706",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:36706__collection1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard_state":"active"}
[junit4:junit4] 2> 43744 T71 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "node_name":"127.0.0.1:40573_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:40573",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard_state":"active"}
[junit4:junit4] 2> 43744 T71 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 43744 T71 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 43760 T140 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 43760 T106 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 43760 T70 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 43760 T77 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 43760 T90 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 43760 T123 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> C69_STATE=coll:collection1 core:collection1 props:{core=collection1, state=recovering, node_name=127.0.0.1:55964_, base_url=http://127.0.0.1:55964, collection=collection1, shard=shard1}
[junit4:junit4] 2> 44566 T126 C69 P55964 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:55817/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 44566 T126 C69 P55964 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:55964 START replicas=[http://127.0.0.1:55817/collection1/] nUpdates=100
[junit4:junit4] 2> 44567 T126 C69 P55964 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 44568 T126 C69 P55964 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 44568 T126 C69 P55964 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 44568 T126 C69 P55964 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 44568 T126 C69 P55964 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 44568 T126 C69 P55964 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:55817/collection1/. core=collection1
[junit4:junit4] 2> 44569 T126 C69 P55964 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 44570 T84 C71 P55817 oasc.SolrCore.execute [collection1] webapp= path=/get params={wt=javabin&qt=/get&version=2&distrib=false&getVersions=100} status=0 QTime=0
[junit4:junit4] 2> 44574 T86 C71 P55817 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 44580 T86 C71 P55817 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@157e3e; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@157e3e; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> 44580 T86 C71 P55817 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 44581 T86 C71 P55817 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 44581 T86 C71 P55817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2&commit_end_point=true&waitSearcher=true&commit=true&openSearcher=false&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 44582 T126 C69 P55964 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 44583 T126 C69 P55964 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 44586 T85 C71 P55817 oasc.SolrCore.execute [collection1] webapp= path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=1
[junit4:junit4] 2> 44587 T126 C69 P55964 oash.SnapPuller.fetchLatestIndex Master's generation: 3
[junit4:junit4] 2> 44587 T126 C69 P55964 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 44587 T126 C69 P55964 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 44589 T84 C71 P55817 oasc.SolrCore.execute [collection1] webapp= path=/replication params={qt=/replication&wt=javabin&version=2&generation=3&command=filelist} status=0 QTime=0
[junit4:junit4] 2> 44590 T126 C69 P55964 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 44591 T126 C69 P55964 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty3/index.20130624125319524
[junit4:junit4] 2> 44591 T126 C69 P55964 oash.SnapPuller.fetchLatestIndex Starting download to NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty3/index.20130624125319524 lockFactory=org.apache.lucene.store.NativeFSLockFactory@efdf43; maxCacheMB=48.0 maxMergeSizeMB=4.0) fullCopy=false
[junit4:junit4] 2> 44594 T86 C71 P55817 oasc.SolrCore.execute [collection1] webapp= path=/replication params={wt=filestream&qt=/replication&file=segments_3&generation=3&command=filecontent&checksum=true} status=0 QTime=0
[junit4:junit4] 2> 44596 T126 C69 P55964 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 44598 T126 C69 P55964 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 44599 T126 C69 P55964 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 44600 T126 C69 P55964 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@11715c3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@11715c3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> 44601 T126 C69 P55964 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 44601 T126 C69 P55964 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 44601 T126 C69 P55964 oass.SolrIndexSearcher.<init> Opening Searcher@1ebca7c main
[junit4:junit4] 2> 44602 T125 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1ebca7c main{StandardDirectoryReader(segments_3:1:nrt)}
[junit4:junit4] 2> 44603 T126 C69 P55964 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty3/index.20130624125319524 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty3/index.20130624125319524;done=true>>]
[junit4:junit4] 2> 44603 T126 C69 P55964 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty3/index.20130624125319524
[junit4:junit4] 2> 44603 T126 C69 P55964 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty3/index.20130624125319524
[junit4:junit4] 2> 44604 T126 C69 P55964 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 44604 T126 C69 P55964 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 44604 T126 C69 P55964 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 44604 T126 C69 P55964 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 44606 T126 C69 P55964 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 44736 T143 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1372092796495/collection1
[junit4:junit4] 2> 44736 T143 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 44737 T143 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 44737 T143 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 44739 T143 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1372092796495/collection1/'
[junit4:junit4] 2> 44739 T143 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty4-1372092796495/collection1/lib/README' to classloader
[junit4:junit4] 2> 44739 T143 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty4-1372092796495/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 44767 T143 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 44804 T143 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 44806 T143 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 44815 T143 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 45209 T143 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4:junit4] 2> 45209 T143 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4:junit4] 2> 45210 T143 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 45217 T143 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 45219 T143 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 45241 T143 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 45245 T143 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 45249 T143 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 45251 T143 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 45251 T143 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 45251 T143 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 45253 T143 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 45253 T143 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 45253 T143 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 45254 T143 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1372092796495/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty4/
[junit4:junit4] 2> 45254 T143 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@9fe090
[junit4:junit4] 2> 45255 T143 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 45255 T143 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty4
[junit4:junit4] 2> 45256 T143 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty4/index/
[junit4:junit4] 2> 45256 T143 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 45256 T143 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty4/index
[junit4:junit4] 2> 45269 T71 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 45270 T71 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "node_name":"127.0.0.1:55964_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:55964",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:55964__collection1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard_state":"active"}
[junit4:junit4] 2> 45281 T143 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1fb57ee; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 45282 T143 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 45285 T143 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 45285 T106 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 45285 T123 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 45285 T77 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 45285 T90 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 45285 T70 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 45286 T143 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 45286 T140 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 45287 T143 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 45289 T143 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 45289 T143 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 45290 T143 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 45293 T143 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 45294 T143 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 45294 T143 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 45297 T143 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 45300 T143 oass.SolrIndexSearcher.<init> Opening Searcher@14b4af4 main
[junit4:junit4] 2> 45301 T143 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 45302 T143 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 45307 T146 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@14b4af4 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 45310 T143 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 45310 T143 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:40573 collection:collection1 shard:shard1
[junit4:junit4] 2> 45313 T143 oasc.ZkController.register We are http://127.0.0.1:40573/collection1/ and leader is http://127.0.0.1:55817/collection1/
[junit4:junit4] 2> 45314 T143 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:40573
[junit4:junit4] 2> 45314 T143 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 45314 T143 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C72 name=collection1 org.apache.solr.core.SolrCore@2ac6e1 url=http://127.0.0.1:40573/collection1 node=127.0.0.1:40573_ C72_STATE=coll:collection1 core:collection1 props:{core=collection1, state=down, node_name=127.0.0.1:40573_, base_url=http://127.0.0.1:40573, collection=collection1}
[junit4:junit4] 2> 45315 T147 C72 P40573 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 45315 T147 C72 P40573 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 45315 T143 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 45315 T147 C72 P40573 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 45316 T147 C72 P40573 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 45316 T46 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 45317 T46 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 45317 T46 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 45318 T147 C72 P40573 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 45322 T46 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 45324 T46 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 2> 45324 T46 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 2> 45326 T46 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 45326 T84 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:40573__collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 46328 T46 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 46793 T71 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 46794 T71 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "node_name":"127.0.0.1:40573_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:40573",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:40573__collection1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard_state":"active"}
[junit4:junit4] 2> 46799 T106 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 46799 T77 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 46799 T140 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 46799 T70 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 46799 T90 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 46799 T123 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 47327 T84 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:40573__collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 47328 T84 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={wt=javabin&coreNodeName=127.0.0.1:40573__collection1&state=recovering&core=collection1&version=2&onlyIfLeader=true&action=PREPRECOVERY&nodeName=127.0.0.1:40573_&checkLive=true} status=0 QTime=2002
[junit4:junit4] 2> 47331 T46 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 48333 T46 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C72_STATE=coll:collection1 core:collection1 props:{core=collection1, state=recovering, node_name=127.0.0.1:40573_, base_url=http://127.0.0.1:40573, collection=collection1, shard=shard1}
[junit4:junit4] 2> 49328 T147 C72 P40573 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:55817/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 49329 T147 C72 P40573 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:40573 START replicas=[http://127.0.0.1:55817/collection1/] nUpdates=100
[junit4:junit4] 2> 49329 T147 C72 P40573 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 49329 T147 C72 P40573 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 49329 T147 C72 P40573 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 49330 T147 C72 P40573 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 49330 T147 C72 P40573 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 49330 T147 C72 P40573 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:55817/collection1/. core=collection1
[junit4:junit4] 2> 49330 T147 C72 P40573 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C73 name=collection1 org.apache.solr.core.SolrCore@18bcc8a url=http://127.0.0.1:55817/collection1 node=127.0.0.1:55817_ C73_STATE=coll:collection1 core:collection1 props:{core=collection1, state=active, node_name=127.0.0.1:55817_, base_url=http://127.0.0.1:55817, collection=collection1, shard=shard1, leader=true}
[junit4:junit4] 2> 49332 T85 C73 P55817 oasc.SolrCore.execute [collection1] webapp= path=/get params={wt=javabin&qt=/get&version=2&distrib=false&getVersions=100} status=0 QTime=0
[junit4:junit4] 2> 49335 T86 C73 P55817 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 49335 T46 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 49340 T86 C73 P55817 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=3
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@157e3e; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@157e3e; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@157e3e; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> 49340 T86 C73 P55817 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4:junit4] 2> 49341 T86 C73 P55817 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 49341 T86 C73 P55817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2&commit_end_point=true&waitSearcher=true&commit=true&openSearcher=false&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> 49342 T147 C72 P40573 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 49342 T147 C72 P40573 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 49345 T84 C73 P55817 oasc.SolrCore.execute [collection1] webapp= path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
[junit4:junit4] 2> 49346 T147 C72 P40573 oash.SnapPuller.fetchLatestIndex Master's generation: 4
[junit4:junit4] 2> 49346 T147 C72 P40573 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 49346 T147 C72 P40573 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 49348 T86 C73 P55817 oasc.SolrCore.execute [collection1] webapp= path=/replication params={qt=/replication&wt=javabin&version=2&generation=4&command=filelist} status=0 QTime=0
[junit4:junit4] 2> 49349 T147 C72 P40573 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 49350 T147 C72 P40573 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty4/index.20130624125324282
[junit4:junit4] 2> 49350 T147 C72 P40573 oash.SnapPuller.fetchLatestIndex Starting download to NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty4/index.20130624125324282 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5eab26; maxCacheMB=48.0 maxMergeSizeMB=4.0) fullCopy=false
[junit4:junit4] 2> 49353 T83 C73 P55817 oasc.SolrCore.execute [collection1] webapp= path=/replication params={wt=filestream&qt=/replication&file=segments_4&generation=4&command=filecontent&checksum=true} status=0 QTime=0
[junit4:junit4] 2> 49354 T147 C72 P40573 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 49356 T147 C72 P40573 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 49356 T147 C72 P40573 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 49358 T147 C72 P40573 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1fb57ee; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1fb57ee; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> 49358 T147 C72 P40573 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4:junit4] 2> 49359 T147 C72 P40573 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 49359 T147 C72 P40573 oass.SolrIndexSearcher.<init> Opening Searcher@2c2411 main
[junit4:junit4] 2> 49360 T146 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2c2411 main{StandardDirectoryReader(segments_4:1:nrt)}
[junit4:junit4] 2> 49360 T147 C72 P40573 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty4/index.20130624125324282 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty4/index.20130624125324282;done=true>>]
[junit4:junit4] 2> 49360 T147 C72 P40573 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty4/index.20130624125324282
[junit4:junit4] 2> 49361 T147 C72 P40573 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty4/index.20130624125324282
[junit4:junit4] 2> 49361 T147 C72 P40573 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 49361 T147 C72 P40573 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 49361 T147 C72 P40573 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 49361 T147 C72 P40573 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 49363 T147 C72 P40573 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 49807 T71 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 49808 T71 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "node_name":"127.0.0.1:40573_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:40573",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:40573__collection1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard_state":"active"}
[junit4:junit4] 2> 49830 T123 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 49830 T106 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 49830 T90 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 49830 T77 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 49831 T70 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 49831 T140 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 50337 T46 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 50338 T46 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> ASYNC NEW_CORE C74 name=collection1 org.apache.solr.core.SolrCore@d691 url=http://127.0.0.1:39579/collection1 node=127.0.0.1:39579_ C74_STATE=coll:control_collection core:collection1 props:{core=collection1, state=active, node_name=127.0.0.1:39579_, base_url=http://127.0.0.1:39579, collection=control_collection, shard=shard1, leader=true}
[junit4:junit4] 2> 50345 T66 C74 P39579 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 50347 T66 C74 P39579 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6f06ac; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 50348 T66 C74 P39579 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 50360 T66 C74 P39579 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6f06ac; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6f06ac; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> 50361 T66 C74 P39579 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 50361 T66 C74 P39579 oass.SolrIndexSearcher.<init> Opening Searcher@726d37 main
[junit4:junit4] 2> 50362 T66 C74 P39579 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 50362 T74 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@726d37 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 50363 T66 C74 P39579 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2&waitSearcher=true&commit=true&softCommit=false} {commit=} 0 18
[junit4:junit4] 2> 50373 T83 C73 P55817 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:55817/collection1/, StdNode: http://127.0.0.1:36706/collection1/, StdNode: http://127.0.0.1:55964/collection1/, StdNode: http://127.0.0.1:40573/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 50379 T84 C73 P55817 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> ASYNC NEW_CORE C75 name=collection1 org.apache.solr.core.SolrCore@1e8f7c4 url=http://127.0.0.1:55964/collection1 node=127.0.0.1:55964_ C75_STATE=coll:collection1 core:collection1 props:{core=collection1, state=active, node_name=127.0.0.1:55964_, base_url=http://127.0.0.1:55964, collection=collection1, shard=shard1}
[junit4:junit4] 2> 50383 T118 C75 P55964 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> C72_STATE=coll:collection1 core:collection1 props:{core=collection1, state=active, node_name=127.0.0.1:40573_, base_url=http://127.0.0.1:40573, collection=collection1, shard=shard1}
[junit4:junit4] 2> 50386 T134 C72 P40573 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> ASYNC NEW_CORE C76 name=collection1 org.apache.solr.core.SolrCore@1348132 url=http://127.0.0.1:36706/collection1 node=127.0.0.1:36706_ C76_STATE=coll:collection1 core:collection1 props:{core=collection1, state=active, node_name=127.0.0.1:36706_, base_url=http://127.0.0.1:36706, collection=collection1, shard=shard1}
[junit4:junit4] 2> 50393 T102 C76 P36706 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 50400 T84 C73 P55817 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=4
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@157e3e; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@157e3e; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@157e3e; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@157e3e; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5}
[junit4:junit4] 2> 50401 T84 C73 P55817 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 5
[junit4:junit4] 2> 50401 T84 C73 P55817 oass.SolrIndexSearcher.<init> Opening Searcher@1349f40 main
[junit4:junit4] 2> 50402 T84 C73 P55817 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 50403 T92 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1349f40 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 50403 T84 C73 P55817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2&commit_end_point=true&waitSearcher=true&commit=true&expungeDeletes=false&softCommit=false} {commit=} 0 25
[junit4:junit4] 2> 50420 T134 C72 P40573 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1fb57ee; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1fb57ee; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5}
[junit4:junit4] 2> 50421 T134 C72 P40573 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 5
[junit4:junit4] 2> 50420 T118 C75 P55964 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@11715c3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@11715c3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> 50421 T118 C75 P55964 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4:junit4] 2> 50422 T134 C72 P40573 oass.SolrIndexSearcher.<init> Opening Searcher@d8dfa2 main
[junit4:junit4] 2> 50422 T118 C75 P55964 oass.SolrIndexSearcher.<init> Opening Searcher@765e24 main
[junit4:junit4] 2> 50422 T134 C72 P40573 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 50423 T118 C75 P55964 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 50423 T146 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@d8dfa2 main{StandardDirectoryReader(segments_4:1:nrt)}
[junit4:junit4] 2> 50424 T134 C72 P40573 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2&commit_end_point=true&waitSearcher=true&commit=true&expungeDeletes=false&softCommit=false} {commit=} 0 38
[junit4:junit4] 2> 50424 T125 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@765e24 main{StandardDirectoryReader(segments_3:1:nrt)}
[junit4:junit4] 2> 50425 T118 C75 P55964 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2&commit_end_point=true&waitSearcher=true&commit=true&expungeDeletes=false&softCommit=false} {commit=} 0 42
[junit4:junit4] 2> 50430 T102 C76 P36706 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@49f599; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@49f599; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> 50430 T102 C76 P36706 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 50431 T102 C76 P36706 oass.SolrIndexSearcher.<init> Opening Searcher@135dc84 main
[junit4:junit4] 2> 50432 T102 C76 P36706 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 50432 T108 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@135dc84 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 50433 T102 C76 P36706 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2&commit_end_point=true&waitSearcher=true&commit=true&expungeDeletes=false&softCommit=false} {commit=} 0 40
[junit4:junit4] 2> 50434 T83 C73 P55817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2&waitSearcher=true&commit=true&softCommit=false} {commit=} 0 62
[junit4:junit4] 2> 50435 T46 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 50439 T85 C73 P55817 oasc.SolrCore.execute [collection1] webapp= path=/select params={wt=javabin&version=2&distrib=false&tests=checkShardConsistency&rows=0&q=*:*} hits=0 status=0 QTime=1
[junit4:junit4] 2> 50442 T100 C76 P36706 oasc.SolrCore.execute [collection1] webapp= path=/select params={wt=javabin&version=2&distrib=false&tests=checkShardConsistency&rows=0&q=*:*} hits=0 status=0 QTime=1
[junit4:junit4] 2> 50445 T119 C75 P55964 oasc.SolrCore.execute [collection1] webapp= path=/select params={wt=javabin&version=2&distrib=false&tests=checkShardConsistency&rows=0&q=*:*} hits=0 status=0 QTime=1
[junit4:junit4] 2> 50447 T136 C72 P40573 oasc.SolrCore.execute [collection1] webapp= path=/select params={wt=javabin&version=2&distrib=false&tests=checkShardConsistency&rows=0&q=*:*} hits=0 status=0 QTime=0
[junit4:junit4] 2> 52489 T65 C74 P39579 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1438743587619602432)} 0 23
[junit4:junit4] 2> ASYNC NEW_CORE C77 name=collection1 org.apache.solr.core.SolrCore@1348132 url=http://127.0.0.1:36706/collection1 node=127.0.0.1:36706_ C77_STATE=coll:collection1 core:collection1 props:{core=collection1, state=active, node_name=127.0.0.1:36706_, base_url=http://127.0.0.1:36706, collection=collection1, shard=shard1}
[junit4:junit4] 2> 52506 T101 C77 P36706 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={_version_=-1438743587648962560&wt=javabin&update.distrib=FROMLEADER&version=2&update.from=http://127.0.0.1:55817/collection1/} {deleteByQuery=*:* (-1438743587648962560)} 0 1
[junit4:junit4] 2> ASYNC NEW_CORE C78 name=collection1 org.apache.solr.core.SolrCore@1e8f7c4 url=http://127.0.0.1:55964/collection1 node=127.0.0.1:55964_ C78_STATE=coll:collection1 core:collection1 props:{core=collection1, state=active, node_name=127.0.0.1:55964_, base_url=http://127.0.0.1:55964, collection=collection1, shard=shard1}
[junit4:junit4] 2> 52507 T119 C78 P55964 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={_version_=-1438743587648962560&wt=javabin&update.distrib=FROMLEADER&version=2&update.from=http://127.0.0.1:55817/collection1/} {deleteByQuery=*:* (-1438743587648962560)} 0 1
[junit4:junit4] 2> ASYNC NEW_CORE C79 name=collection1 org.apache.solr.core.SolrCore@2ac6e1 url=http://127.0.0.1:40573/collection1 node=127.0.0.1:40573_ C79_STATE=coll:collection1 core:collection1 props:{core=collection1, state=active, node_name=127.0.0.1:40573_, base_url=http://127.0.0.1:40573, collection=collection1, shard=shard1}
[junit4:junit4] 2> 52506 T134 C79 P40573 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={_version_=-1438743587648962560&wt=javabin&update.distrib=FROMLEADER&version=2&update.from=http://127.0.0.1:55817/collection1/} {deleteByQuery=*:* (-1438743587648962560)} 0 1
[junit4:junit4] 2> ASYNC NEW_CORE C80 name=collection1 org.apache.solr.core.SolrCore@18bcc8a url=http://127.0.0.1:55817/collection1 node=127.0.0.1:55817_ C80_STATE=coll:collection1 core:collection1 props:{core=collection1, state=active, node_name=127.0.0.1:55817_, base_url=http://127.0.0.1:55817, collection=collection1, shard=shard1, leader=true}
[junit4:junit4] 2> 52508 T85 C80 P55817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&update.distrib=TOLEADER&version=2} {deleteByQuery=*:* (-1438743587648962560)} 0 6
[junit4:junit4] 2> 52509 T117 C78 P55964 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {deleteByQuery=*:*} 0 17
[junit4:junit4] 2> ASYNC NEW_CORE C81 name=collection1 org.apache.solr.core.SolrCore@d691 url=http://127.0.0.1:39579/collection1 node=127.0.0.1:39579_ C81_STATE=coll:control_collection core:collection1 props:{core=collection1, state=active, node_name=127.0.0.1:39579_, base_url=http://127.0.0.1:39579, collection=control_collection, shard=shard1, leader=true}
[junit4:junit4] 2> 52523 T66 C81 P39579 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[0 (1438743587659448320)]} 0 11
[junit4:junit4] 2> 52536 T136 C79 P40573 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:55817/collection1/} {add=[0 (1438743587675176960)]} 0 3
[junit4:junit4] 2> 52537 T100 C77 P36706 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:55817/collection1/} {add=[0 (1438743587675176960)]} 0 4
[junit4:junit4] 2> 52537 T118 C78 P55964 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:55817/collection1/} {add=[0 (1438743587675176960)]} 0 4
[junit4:junit4] 2> 52538 T84 C80 P55817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[0 (1438743587675176960)]} 0 12
[junit4:junit4] 2> 52543 T63 C81 P39579 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[1 (1438743587689857024)]} 0 2
[junit4:junit4] 2> 52556 T135 C79 P40573 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:55817/collection1/} {add=[1 (1438743587698245632)]} 0 2
[junit4:junit4] 2> 52556 T102 C77 P36706 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:55817/collection1/} {add=[1 (1438743587698245632)]} 0 2
[junit4:junit4] 2> 52556 T116 C78 P55964 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:55817/collection1/} {add=[1 (1438743587698245632)]} 0 2
[junit4:junit4] 2> 52558 T86 C80 P55817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:36706/collection1/} {add=[1 (1438743587698245632)]} 0 9
[junit4:junit4] 2> 52558 T99 C77 P36706 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[1]} 0 13
[junit4:junit4] 2> 52563 T64 C81 P39579 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[2 (1438743587710828544)]} 0 2
[junit4:junit4] 2> 52572 T84 C80 P55817 oasup.DistributedUpdateProcessor.setupRequest test.distrib.skip.servers was found and contains:[http://127.0.0.1:36706/collection1/]
[junit4:junit4] 2> 52572 T84 C80 P55817 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:36706/collection1/ against:[http://127.0.0.1:36706/collection1/] result:true
[junit4:junit4] 2> 52572 T84 C80 P55817 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:55964/collection1/ against:[http://127.0.0.1:36706/collection1/] result:false
[junit4:junit4] 2> 52573 T84 C80 P55817 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:40573/collection1/ against:[http://127.0.0.1:36706/collection1/] result:false
[junit4:junit4] 2> 52579 T136 C79 P40573 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={test.distrib.skip.servers=http://127.0.0.1:36706/collection1/&wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:55817/collection1/} {add=[2 (1438743587723411456)]} 0 2
[junit4:junit4] 2> 52579 T119 C78 P55964 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={test.distrib.skip.servers=http://127.0.0.1:36706/collection1/&wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:55817/collection1/} {add=[2 (1438743587723411456)]} 0 2
[junit4:junit4] 2> 52580 T84 C80 P55817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={test.distrib.skip.servers=http://127.0.0.1:36706/collection1/&wt=javabin&update.distrib=TOLEADER&version=2&distrib.from=http://127.0.0.1:40573/collection1/} {add=[2 (1438743587723411456)]} 0 9
[junit4:junit4] 2> 52580 T134 C79 P40573 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={test.distrib.skip.servers=http://127.0.0.1:36706/collection1/&wt=javabin&version=2} {add=[2]} 0 12
[junit4:junit4] 2> 52585 T65 C81 P39579 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[3 (1438743587734945792)]} 0 2
[junit4:junit4] 2> 52588 T83 C80 P55817 oasup.DistributedUpdateProcessor.setupRequest test.distrib.skip.servers was found and contains:[http://127.0.0.1:36706/collection1/, http://127.0.0.1:55964/collection1/]
[junit4:junit4] 2> 52589 T83 C80 P55817 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:36706/collection1/ against:[http://127.0.0.1:36706/collection1/, http://127.0.0.1:55964/collection1/] result:true
[junit4:junit4] 2> 52589 T83 C80 P55817 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:55964/collection1/ against:[http://127.0.0.1:36706/collection1/, http://127.0.0.1:55964/collection1/] result:true
[junit4:junit4] 2> 52590 T83 C80 P55817 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:40573/collection1/ against:[http://127.0.0.1:36706/collection1/, http://127.0.0.1:55964/collection1/] result:false
[junit4:junit4] 2> 52596 T135 C79 P40573 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={test.distrib.skip.servers=http://127.0.0.1:36706/collection1/&wt=javabin&update.distrib=FROMLEADER&version=2&distrib.from=http://127.0.0.1:55817/collection1/} {add=[3 (1438743587741237248)]} 0 1
[junit4:junit4] 2> 52596 T83 C80 P55817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={test.distrib.skip.servers=http://127.0.0.1:36706/collection1/&test.distrib.skip.servers=http://127.0.0.1:55964/collection1/&wt=javabin&version=2} {add=[3 (1438743587741237248)]} 0 8
[junit4:junit4] 2> 52599 T66 C81 P39579 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 52660 T66 C81 P39579 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6f06ac; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6f06ac; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> 52660 T66 C81 P39579 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 52684 T66 C81 P39579 oass.SolrIndexSearcher.<init> Opening Searcher@914d0f main
[junit4:junit4] 2> 52685 T66 C81 P39579 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 52686 T74 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@914d0f main{StandardDirectoryReader(segments_3:3:nrt _0(4.4):c4)}
[junit4:junit4] 2> 52686 T66 C81 P39579 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2&waitSearcher=true&commit=true&softCommit=false} {commit=} 0 87
[junit4:junit4] 2> 52690 T101 C77 P36706 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:55817/collection1/, StdNode: http://127.0.0.1:36706/collection1/, StdNode: http://127.0.0.1:55964/collection1/, StdNode: http://127.0.0.1:40573/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 52693 T86 C80 P55817 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 52694 T136 C79 P40573 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 52694 T117 C78 P55964 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 52694 T100 C77 P36706 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 52730 T100 C77 P36706 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@49f599; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@49f599; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> 52730 T86 C80 P55817 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=5
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@157e3e; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@157e3e; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@157e3e; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@157e3e; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@157e3e; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_6,generation=6}
[junit4:junit4] 2> 52731 T100 C77 P36706 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4:junit4] 2> 52731 T86 C80 P55817 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 6
[junit4:junit4] 2> 52734 T100 C77 P36706 oass.SolrIndexSearcher.<init> Opening Searcher@14b8220 main
[junit4:junit4] 2> 52734 T86 C80 P55817 oass.SolrIndexSearcher.<init> Opening Searcher@f7574c main
[junit4:junit4] 2> 52735 T86 C80 P55817 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 52736 T108 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@14b8220 main{StandardDirectoryReader(segments_4:3:nrt _0(4.4):c2)}
[junit4:junit4] 2> 52736 T100 C77 P36706 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 52737 T100 C77 P36706 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2&commit_end_point=true&waitSearcher=true&commit=true&expungeDeletes=false&softCommit=false} {commit=} 0 43
[junit4:junit4] 2> 52737 T92 oasc.JmxMonitoredMap.put WARN Failed to register info bean: searcher javax.management.InstanceAlreadyExistsException: solr/collection1:type=searcher,id=org.apache.solr.search.SolrIndexSearcher
[junit4:junit4] 2> at com.sun.jmx.mbeanserver.Repository.addMBean(Repository.java:437)
[junit4:junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerWithRepository(DefaultMBeanServerInterceptor.java:1898)
[junit4:junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:966)
[junit4:junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)
[junit4:junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)
[junit4:junit4] 2> at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:513)
[junit4:junit4] 2> at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:140)
[junit4:junit4] 2> at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:51)
[junit4:junit4] 2> at org.apache.solr.search.SolrIndexSearcher.register(SolrIndexSearcher.java:298)
[junit4:junit4] 2> at org.apache.solr.core.SolrCore.registerSearcher(SolrCore.java:1846)
[junit4:junit4] 2> at org.apache.solr.core.SolrCore.access$000(SolrCore.java:135)
[junit4:junit4] 2> at org.apache.solr.core.SolrCore$7.call(SolrCore.java:1723)
[junit4:junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:724)
[junit4:junit4] 2>
[junit4:junit4] 2> 52739 T92 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@f7574c main{StandardDirectoryReader(segments_6:3:nrt _0(4.4):c4)}
[junit4:junit4] 2> 52740 T136 C79 P40573 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1fb57ee; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1fb57ee; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_6,generation=6}
[junit4:junit4] 2> 52740 T117 C78 P55964 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@11715c3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1372092783440/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@11715c3; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5}
[junit4:junit4] 2> 52740 T86 C80 P55817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2&commit_end_point=true&waitSearcher=true&commit=true&expungeDeletes=false&softCommit=false} {commit=} 0 48
[junit4:junit4] 2> 52741 T117 C78 P55964 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 5
[junit4:junit4] 2> 52740 T136 C79 P40573 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 6
[junit4:junit4] 2> 52744 T117 C78 P55964 oass.SolrIndexSearcher.<init> Opening Searcher@acc279 main
[junit4:junit4] 2> 52744 T136 C79 P40573 oass.SolrIndexSearcher.<init> Opening Searcher@6a5d2 main
[junit4:junit4] 2> 52745 T117 C78 P55964 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 52745 T136 C79 P40573 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 52746 T125 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@acc279 main{StandardDirectoryReader(segments_5:3:nrt _0(4.4):c3)}
[junit4:junit4] 2> 52746 T146 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6a5d2 main{StandardDirectoryReader(segments_6:3:nrt _0(4.4):c4)}
[junit4:junit4] 2> 52746 T117 C78 P55964 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2&commit_end_point=true&waitSearcher=true&commit=true&expungeDeletes=false&softCommit=false} {commit=} 0 52
[junit4:junit4] 2> 52747 T136 C79 P40573 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2&commit_end_point=true&waitSearcher=true&commit=true&expungeDeletes=false&softCommit=false} {commit=} 0 53
[junit4:junit4] 2> 52747 T101 C77 P36706 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2&waitSearcher=true&commit=true&softCommit=false} {commit=} 0 58
[junit4:junit4] 2> 52748 T46 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):230
[junit4:junit4] 2> 52749 T46 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 52750 T46 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> 52754 T85 C80 P55817 oasc.SolrCore.execute [collection1] webapp= path=/select params={wt=javabin&version=2&distrib=false&tests=checkShardConsistency&rows=0&q=*:*} hits=4 status=0 QTime=1
[junit4:junit4] 2> 52757 T102 C77 P36706 oasc.SolrCore.execute [collection1] webapp= path=/select params={wt=javabin&version=2&distrib=false&tests=checkShardConsistency&rows=0&q=*:*} hits=2 status=0 QTime=0
[junit4:junit4] 2> 52761 T118 C78 P55964 oasc.SolrCore.execute [collection1] webapp= path=/select params={wt=javabin&version=2&distrib=false&tests=checkShardConsistency&rows=0&q=*:*} hits=3 status=0 QTime=0
[junit4:junit4] 2> 52765 T134 C79 P40573 oasc.SolrCore.execute [collection1] webapp= path=/select params={wt=javabin&version=2&distrib=false&tests=checkShardConsistency&rows=0&q=*:*} hits=4 status=0 QTime=0
[junit4:junit4] 2> 52768 T46 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 52778 T119 oasha.CollectionsHandler.handleSyncShardAction Syncing shard : wt=javabin&version=2&action=SYNCSHARD&shard=shard1&collection=collection1
[junit4:junit4] 2> 52778 T119 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 52785 T84 oasha.CoreAdminHandler.handleRequestSyncAction I have been requested to sync up my shard
[junit4:junit4] 2> 52786 T84 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:55817/collection1/
[junit4:junit4] 2> 52786 T84 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:55817 START replicas=[http://127.0.0.1:36706/collection1/, http://127.0.0.1:55964/collection1/, http://127.0.0.1:40573/collection1/] nUpdates=100
[junit4:junit4] 2> 52792 T99 C77 P36706 oasc.SolrCore.execute [collection1] webapp= path=/get params={wt=javabin&qt=/get&version=2&distrib=false&getVersions=100} status=0 QTime=2
[junit4:junit4] 2> 52792 T135 C79 P40573 oasc.SolrCore.execute [collection1] webapp= path=/get params={wt=javabin&qt=/get&version=2&distrib=false&getVersions=100} status=0 QTime=2
[junit4:junit4] 2> 52792 T117 C78 P55964 oasc.SolrCore.execute [collection1] webapp= path=/get params={wt=javabin&qt=/get&version=2&distrib=false&getVersions=100} status=0 QTime=3
[junit4:junit4] 2> 52793 T84 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:55817 Received 3 versions from 127.0.0.1:36706/collection1/
[junit4:junit4] 2> 52794 T84 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:55817 Our versions are newer. ourLowThreshold=1438743587648962560 otherHigh=1438743587698245632
[junit4:junit4] 2> 52794 T84 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:55817 Received 5 versions from 127.0.0.1:40573/collection1/
[junit4:junit4] 2> 52795 T84 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:55817 Our versions are newer. ourLowThreshold=1438743587648962560 otherHigh=1438743587723411456
[junit4:junit4] 2> 52795 T84 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:55817 Received 4 versions from 127.0.0.1:55964/collection1/
[junit4:junit4] 2> 52795 T84 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:55817 Our versions are newer. ourLowThreshold=1438743587648962560 otherHigh=1438743587723411456
[junit4:junit4] 2> 52796 T84 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:55817 DONE. sync succeeded
[junit4:junit4] 2> 52796 T84 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 52797 T84 oasc.SyncStrategy.syncToMe http://127.0.0.1:55817/collection1/: try and ask http://127.0.0.1:36706/collection1/ to sync
[junit4:junit4] 2> 52798 T84 oasc.SyncStrategy.syncToMe http://127.0.0.1:55817/collection1/: try and ask http://127.0.0.1:55964/collection1/ to sync
[junit4:junit4] 2> 52798 T84 oasc.SyncStrategy.syncToMe http://127.0.0.1:55817/collection1/: try and ask http://127.0.0.1:40573/collection1/ to sync
[junit4:junit4] 2> 52805 T101 C77 P36706 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:36706 START replicas=[http://127.0.0.1:55817/collection1/] nUpdates=100
[junit4:junit4] 2> 52806 T116 C78 P55964 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:55964 START replicas=[http://127.0.0.1:55817/collection1/] nUpdates=100
[junit4:junit4] 2> 52806 T133 C79 P40573 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:40573 START replicas=[http://127.0.0.1:55817/collection1/] nUpdates=100
[junit4:junit4] 2> 52808 T83 C80 P55817 oasc.SolrCore.execute [collection1] webapp= path=/get params={wt=javabin&qt=/get&version=2&distrib=false&getVersions=100} status=0 QTime=0
[junit4:junit4] 2> 52808 T86 C80 P55817 oasc.SolrCore.execute [collection1] webapp= path=/get params={wt=javabin&qt=/get&version=2&distrib=false&getVersions=100} status=0 QTime=0
[junit4:junit4] 2> 52809 T116 C78 P55964 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:55964 Received 5 versions from 127.0.0.1:55817/collection1/
[junit4:junit4] 2> 52809 T101 C77 P36706 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:36706 Received 5 versions from 127.0.0.1:55817/collection1/
[junit4:junit4] 2> 52810 T83 C80 P55817 oasc.SolrCore.execute [collection1] webapp= path=/get params={wt=javabin&qt=/get&version=2&distrib=false&getVersions=100} status=0 QTime=0
[junit4:junit4] 2> 52810 T116 C78 P55964 oasu.PeerSync.requestUpdates PeerSync: core=collection1 url=http://127.0.0.1:55964 Requesting updates from 127.0.0.1:55817/collection1/n=1 versions=[1438743587741237248]
[junit4:junit4] 2> 52810 T101 C77 P36706 oasu.PeerSync.requestUpdates PeerSync: core=collection1 url=http://127.0.0.1:36706 Requesting updates from 127.0.0.1:55817/collection1/n=2 versions=[1438743587741237248, 1438743587723411456]
[junit4:junit4] 2> 52811 T133 C79 P40573 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:40573 Received 5 versions from 127.0.0.1:55817/collection1/
[junit4:junit4] 2> 52812 T133 C79 P40573 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:40573 Our versions are newer. ourLowThreshold=1438743587648962560 otherHigh=1438743587723411456
[junit4:junit4] 2> 52812 T133 C79 P40573 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:40573 DONE. sync succeeded
[junit4:junit4] 2> 52812 T133 C79 P40573 oasc.SolrCore.execute [collection1] webapp= path=/get params={wt=javabin&qt=/get&version=2&distrib=false&getVersions=100&sync=http://127.0.0.1:55817/collection1/} status=0 QTime=6
[junit4:junit4] 2> 52814 T85 C80 P55817 oasc.SolrCore.execute [collection1] webapp= path=/get params={wt=javabin&qt=/get&version=2&distrib=false&getUpdates=1438743587741237248} status=0 QTime=1
[junit4:junit4] 2> 52814 T84 oasc.SyncStrategy.syncToMe http://127.0.0.1:55817/collection1/: sync completed with http://127.0.0.1:40573/collection1/
[junit4:junit4] 2> 52814 T86 C80 P55817 oasc.SolrCore.execute [collection1] webapp= path=/get params={wt=javabin&qt=/get&version=2&distrib=false&getUpdates=1438743587741237248,1438743587723411456} status=0 QTime=1
[junit4:junit4] 2> 52818 T116 C78 P55964 oasup.LogUpdateProcessor.finish [collection1] {add=[3 (1438743587741237248)]} 0 3
[junit4:junit4] 2> 52819 T116 C78 P55964 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:55964 DONE. sync succeeded
[junit4:junit4] 2> 52819 T116 C78 P55964 oasc.SolrCore.execute [collection1] webapp= path=/get params={wt=javabin&qt=/get&version=2&distrib=false&getVersions=100&sync=http://127.0.0.1:55817/collection1/} status=0 QTime=13
[junit4:junit4] 2> 52820 T84 oasc.SyncStrategy.syncToMe http://127.0.0.1:55817/collection1/: sync completed with http://127.0.0.1:55964/collection1/
[junit4:junit4] 2> 52820 T101 C77 P36706 oasup.LogUpdateProcessor.finish [collection1] {add=[2 (1438743587723411456), 3 (1438743587741237248)]} 0 5
[junit4:junit4] 2> 52821 T101 C77 P36706 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:36706 DONE. sync succeeded
[junit4:junit4] 2> 52821 T101 C77 P36706 oasc.SolrCore.execute [collection1] webapp= path=/get params={wt=javabin&qt=/get&version=2&distrib=false&getVersions=100&sync=http://127.0.0.1:55817/collection1/} status=0 QTime=17
[junit4:junit4] 2> 52822 T84 oasc.SyncStrategy.syncToMe http://127.0.0.1:55817/collection1/: sync completed with http://127.0.0.1:36706/collection1/
[junit4:junit4] 2> 52822 T84 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={wt=javabin&core=collection1&version=2&action=REQUESTSYNCSHARD&collection=collection1&shard=shard1} status=0 QTime=37
[junit4:junit4] 2> 52823 T119 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/collections params={wt=javabin&version=2&action=SYNCSHARD&shard=shard1&collection=collection1} status=0 QTime=47
[junit4:junit4] 2> 52824 T46
[...truncated too long message...]
junit4:junit4] 2> "base_url":"http://127.0.0.1:45846",
[junit4:junit4] 2> "node_name":"127.0.0.1:45846_",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:45846__collection1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "state":"down"}
[junit4:junit4] 2> 651515 T1757 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:45846",
[junit4:junit4] 2> "node_name":"127.0.0.1:45846_",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:45846__collection1",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "state":"down"}
[junit4:junit4] 2> 651521 T1741 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 651550 T1659 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 42815
[junit4:junit4] 2> 651551 T1659 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=6527720
[junit4:junit4] 2> 651697 T1681 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 651697 T1681 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 651697 T1681 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 652552 T1659 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 652553 T1659 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 652555 T1659 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@12079ef
[junit4:junit4] 2> 652562 T1659 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=43,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=62,cumulative_deletesById=42,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 652563 T1659 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 652563 T1659 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 652564 T1659 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 652565 T1659 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 652566 T1659 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 652566 T1659 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.RecoveryZkTest-1372093298889/jetty2/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.RecoveryZkTest-1372093298889/jetty2/index;done=false>>]
[junit4:junit4] 2> 652566 T1659 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.RecoveryZkTest-1372093298889/jetty2/index
[junit4:junit4] 2> 652567 T1659 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.RecoveryZkTest-1372093298889/jetty2 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.RecoveryZkTest-1372093298889/jetty2;done=false>>]
[junit4:junit4] 2> 652567 T1659 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.RecoveryZkTest-1372093298889/jetty2
[junit4:junit4] 2> 652568 T1757 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89921506436186122-127.0.0.1:42815_-n_0000000003) am no longer a leader.
[junit4:junit4] 2> 652569 T1741 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 652569 T1741 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 652569 T1741 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 652591 T1659 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
[junit4:junit4] 2> 652647 T1659 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4] 2> 652649 T1659 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:57072 57072
[junit4:junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4] 1> safe stop:
[junit4:junit4] 1> safe stop:
[junit4:junit4] 1> safe stop:
[junit4:junit4] 1> safe stop:
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=RecoveryZkTest -Dtests.method=testDistribSearch -Dtests.seed=B34D49CB18AA1670 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=en_AU -Dtests.timezone=US/Pacific -Dtests.file.encoding=UTF-8
[junit4:junit4] FAILURE 110s J1 | RecoveryZkTest.testDistribSearch <<<
[junit4:junit4] > Throwable #1: java.lang.AssertionError: expected:<228> but was:<50>
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([B34D49CB18AA1670:32ABC7D36FF5764C]:0)
[junit4:junit4] > at org.apache.solr.cloud.RecoveryZkTest.doTest(RecoveryZkTest.java:108)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:724)
[junit4:junit4] 2> 652661 T1659 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 109711 T1658 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 3 leaked thread(s).
[junit4:junit4] 2> 652786 T1701 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 652786 T1701 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 652786 T1701 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> NOTE: test params are: codec=Appending, sim=RandomSimilarityProvider(queryNorm=true,coord=yes): {}, locale=en_AU, timezone=US/Pacific
[junit4:junit4] 2> NOTE: Linux 3.2.0-48-generic i386/Oracle Corporation 1.8.0-ea (32-bit)/cpus=8,threads=3,free=84157776,total=302055424
[junit4:junit4] 2> NOTE: All tests run in this JVM: [DOMUtilTest, TestCoreDiscovery, SolrTestCaseJ4Test, SimplePostToolTest, CoreContainerCoreInitFailuresTest, TestDefaultSearchFieldResource, SampleTest, TestUtils, TestZkChroot, SolrIndexConfigTest, TestPropInject, TestSolrJ, CachingDirectoryFactoryTest, TestHashPartitioner, TestRecovery, SolrCmdDistributorTest, SolrCoreCheckLockOnStartupTest, TestMaxScoreQueryParser, OpenExchangeRatesOrgProviderTest, TestMergePolicyConfig, DocValuesMultiTest, TestBM25SimilarityFactory, NotRequiredUniqueKeyTest, IndexReaderFactoryTest, DateMathParserTest, TestSolrXMLSerializer, TestSolrXmlPersistence, StandardRequestHandlerTest, ClusterStateTest, TestQuerySenderNoQuery, TestSchemaVersionResource, HighlighterConfigTest, TestCSVResponseWriter, TestQueryTypes, TestLuceneMatchVersion, RequestHandlersTest, DebugComponentTest, SuggesterWFSTTest, TestRangeQuery, TestBinaryResponseWriter, TestManagedSchema, TestJmxIntegration, NumericFieldsTest, TestNumberUtils, TestFastOutputStream, TestElisionMultitermQuery, OpenCloseCoreStressTest, DocumentAnalysisRequestHandlerTest, TestSolr4Spatial, TestRTGBase, TestSolrQueryParserResource, ConvertedLegacyTest, SolrPluginUtilsTest, XsltUpdateRequestHandlerTest, EchoParamsTest, TestPartialUpdateDeduplication, CurrencyFieldOpenExchangeTest, HighlighterTest, TestStressLucene, TestSuggestSpellingConverter, TestUpdate, TestAnalyzedSuggestions, DistanceFunctionTest, SpellPossibilityIteratorTest, PathHierarchyTokenizerFactoryTest, TestDFRSimilarityFactory, TestWordDelimiterFilterFactory, TestComponentsName, ZkNodePropsTest, TimeZoneUtilsTest, TestLMJelinekMercerSimilarityFactory, SpellCheckComponentTest, BasicDistributedZkTest, ChaosMonkeySafeLeaderTest, BasicDistributedZk2Test, CollectionsAPIDistributedZkTest, LeaderElectionIntegrationTest, BasicZkTest, RecoveryZkTest]
[junit4:junit4] Completed on J1 in 110.23s, 1 test, 1 failure <<< FAILURES!
[...truncated 433 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:392: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:372: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:181: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:437: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1246: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:890: There were test failures: 298 suites, 1256 tests, 2 failures, 16 ignored (7 assumptions)
Total time: 36 minutes 58 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.8.0-ea-b93 -server -XX:+UseParallelGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure