You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2013/06/22 14:34:45 UTC
[JENKINS] Lucene-Solr-4.x-Linux (64bit/jdk1.7.0_25) - Build # 6183
- Still Failing!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/6183/
Java: 64bit/jdk1.7.0_25 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC
1 tests failed.
REGRESSION: org.apache.solr.cloud.SyncSliceTest.testDistribSearch
Error Message:
shard1 is not consistent. Got 305 from http://127.0.0.1:44824/e_t/collection1lastClient and got 249 from http://127.0.0.1:39874/e_t/collection1
Stack Trace:
java.lang.AssertionError: shard1 is not consistent. Got 305 from http://127.0.0.1:44824/e_t/collection1lastClient and got 249 from http://127.0.0.1:39874/e_t/collection1
at __randomizedtesting.SeedInfo.seed([BC174470A104C5EC:3DF1CA68D65BA5D0]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1018)
at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:238)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:724)
Build Log:
[...truncated 9694 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.SyncSliceTest
[junit4:junit4] 2> 780879 T2179 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /e_t/
[junit4:junit4] 2> 780883 T2179 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-SyncSliceTest-1371904103237
[junit4:junit4] 2> 780884 T2179 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 780884 T2180 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 780984 T2179 oasc.ZkTestServer.run start zk server on port:35303
[junit4:junit4] 2> 780985 T2179 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 780988 T2186 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@479e1bf5 name:ZooKeeperConnection Watcher:127.0.0.1:35303 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 780988 T2179 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 780988 T2179 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 780990 T2179 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 780991 T2188 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1d551e98 name:ZooKeeperConnection Watcher:127.0.0.1:35303/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 780992 T2179 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 780992 T2179 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 780997 T2179 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 780999 T2179 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 781000 T2179 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 781002 T2179 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 781002 T2179 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 781004 T2179 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 781005 T2179 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 781007 T2179 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 781007 T2179 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 781008 T2179 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 781009 T2179 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 781010 T2179 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 781011 T2179 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 781012 T2179 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 781013 T2179 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 781014 T2179 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 781014 T2179 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 781016 T2179 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 781016 T2179 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 781018 T2179 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 781018 T2179 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 781081 T2179 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 781099 T2179 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:58087
[junit4:junit4] 2> 781100 T2179 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 781100 T2179 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 781100 T2179 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1371904103373
[junit4:junit4] 2> 781101 T2179 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1371904103373/solr.xml
[junit4:junit4] 2> 781101 T2179 oasc.CoreContainer.<init> New CoreContainer 977602485
[junit4:junit4] 2> 781101 T2179 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1371904103373/'
[junit4:junit4] 2> 781101 T2179 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1371904103373/'
[junit4:junit4] 2> 781147 T2179 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 781147 T2179 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 781147 T2179 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 781148 T2179 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 781148 T2179 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 781148 T2179 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 781148 T2179 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 781149 T2179 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 781149 T2179 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 781149 T2179 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 781152 T2179 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 781152 T2179 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:35303/solr
[junit4:junit4] 2> 781153 T2179 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 781153 T2179 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 781154 T2199 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3170b49b name:ZooKeeperConnection Watcher:127.0.0.1:35303 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 781155 T2179 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 781156 T2179 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 781159 T2179 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 781160 T2201 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5f826513 name:ZooKeeperConnection Watcher:127.0.0.1:35303/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 781160 T2179 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 781161 T2179 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 781163 T2179 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 781164 T2179 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 781165 T2179 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58087_e_t
[junit4:junit4] 2> 781166 T2179 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:58087_e_t
[junit4:junit4] 2> 781168 T2179 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 781171 T2179 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 781172 T2179 oasc.Overseer.start Overseer (id=89909107309871107-127.0.0.1:58087_e_t-n_0000000000) starting
[junit4:junit4] 2> 781177 T2179 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 781179 T2203 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 781180 T2179 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 781181 T2179 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 781182 T2179 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 781184 T2202 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 781186 T2204 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 781186 T2204 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 782686 T2202 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 782687 T2202 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:58087_e_t",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:58087/e_t"}
[junit4:junit4] 2> 782687 T2202 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 782687 T2202 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 782689 T2201 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 783187 T2204 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1371904103373/collection1
[junit4:junit4] 2> 783188 T2204 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 783188 T2204 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 783188 T2204 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 783190 T2204 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1371904103373/collection1/'
[junit4:junit4] 2> 783190 T2204 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1371904103373/collection1/lib/README' to classloader
[junit4:junit4] 2> 783190 T2204 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1371904103373/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 783215 T2204 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 783256 T2204 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 783257 T2204 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 783263 T2204 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 783625 T2204 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4:junit4] 2> 783625 T2204 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4:junit4] 2> 783625 T2204 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 783631 T2204 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 783633 T2204 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 783643 T2204 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 783645 T2204 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 783648 T2204 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 783648 T2204 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 783649 T2204 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 783649 T2204 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 783650 T2204 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 783650 T2204 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 783650 T2204 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 783656 T2204 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1371904103373/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1371904103236/control/data/
[junit4:junit4] 2> 783656 T2204 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7e229394
[junit4:junit4] 2> 783657 T2204 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 783657 T2204 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/control/data
[junit4:junit4] 2> 783657 T2204 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1371904103236/control/data/index/
[junit4:junit4] 2> 783657 T2204 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1371904103236/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 783658 T2204 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/control/data/index
[junit4:junit4] 2> 783660 T2204 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/control/data/index,segFN=segments_1,generation=1}
[junit4:junit4] 2> 783661 T2204 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 783662 T2204 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 783663 T2204 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 783663 T2204 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 783663 T2204 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 783664 T2204 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 783664 T2204 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 783664 T2204 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 783665 T2204 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 783665 T2204 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 783667 T2204 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 783670 T2204 oass.SolrIndexSearcher.<init> Opening Searcher@7aa51b70 main
[junit4:junit4] 2> 783670 T2204 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 783670 T2204 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 783674 T2205 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7aa51b70 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 783675 T2204 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 783675 T2204 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:58087/e_t collection:control_collection shard:shard1
[junit4:junit4] 2> 783676 T2204 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 783680 T2204 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 783682 T2204 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 783682 T2204 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 783682 T2204 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:58087/e_t/collection1/
[junit4:junit4] 2> 783682 T2204 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 783682 T2204 oasc.SyncStrategy.syncToMe http://127.0.0.1:58087/e_t/collection1/ has no replicas
[junit4:junit4] 2> 783683 T2204 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:58087/e_t/collection1/
[junit4:junit4] 2> 783683 T2204 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 784192 T2202 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 784202 T2201 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 784238 T2204 oasc.ZkController.register We are http://127.0.0.1:58087/e_t/collection1/ and leader is http://127.0.0.1:58087/e_t/collection1/
[junit4:junit4] 2> 784238 T2204 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:58087/e_t
[junit4:junit4] 2> 784238 T2204 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 784239 T2204 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 784239 T2204 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 784245 T2204 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 784246 T2179 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 784246 T2179 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 784247 T2179 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 784249 T2179 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 784250 T2179 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 784252 T2208 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6bd2c9b4 name:ZooKeeperConnection Watcher:127.0.0.1:35303/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 784253 T2179 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 784254 T2179 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 784255 T2179 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 784315 T2179 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 784317 T2179 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:44824
[junit4:junit4] 2> 784318 T2179 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 784319 T2179 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 784319 T2179 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1371904106609
[junit4:junit4] 2> 784319 T2179 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1371904106609/solr.xml
[junit4:junit4] 2> 784320 T2179 oasc.CoreContainer.<init> New CoreContainer 1410430286
[junit4:junit4] 2> 784320 T2179 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1371904106609/'
[junit4:junit4] 2> 784320 T2179 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1371904106609/'
[junit4:junit4] 2> 784365 T2179 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 784365 T2179 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 784366 T2179 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 784366 T2179 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 784366 T2179 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 784366 T2179 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 784367 T2179 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 784367 T2179 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 784367 T2179 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 784367 T2179 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 784370 T2179 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 784370 T2179 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:35303/solr
[junit4:junit4] 2> 784371 T2179 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 784371 T2179 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 784373 T2219 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@311e4da1 name:ZooKeeperConnection Watcher:127.0.0.1:35303 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 784373 T2179 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 784374 T2179 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 784377 T2179 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 784379 T2221 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ec0cefe name:ZooKeeperConnection Watcher:127.0.0.1:35303/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 784379 T2179 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 784381 T2179 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 785383 T2179 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44824_e_t
[junit4:junit4] 2> 785385 T2179 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:44824_e_t
[junit4:junit4] 2> 785387 T2208 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 785387 T2221 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 785387 T2201 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 785388 T2201 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 785391 T2222 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 785392 T2222 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 785710 T2202 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 785711 T2202 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:58087_e_t_collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:58087_e_t",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:58087/e_t"}
[junit4:junit4] 2> 785713 T2202 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:44824_e_t",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:44824/e_t"}
[junit4:junit4] 2> 785714 T2202 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 1
[junit4:junit4] 2> 785714 T2202 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 785716 T2201 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 785716 T2221 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 785716 T2208 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 786393 T2222 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1371904106609/collection1
[junit4:junit4] 2> 786393 T2222 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 786394 T2222 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 786394 T2222 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 786395 T2222 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1371904106609/collection1/'
[junit4:junit4] 2> 786395 T2222 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty1-1371904106609/collection1/lib/README' to classloader
[junit4:junit4] 2> 786395 T2222 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty1-1371904106609/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 786420 T2222 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 786454 T2222 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 786455 T2222 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 786459 T2222 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 787952 T3 oasc.CoreContainer.finalize ERROR CoreContainer was not shutdown prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!! instance=530158209
[junit4:junit4] 2> 787953 T3 oasc.CoreContainer.finalize ERROR CoreContainer was not shutdown prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!! instance=192869350
[junit4:junit4] 2> 787953 T3 oasc.CoreContainer.finalize ERROR CoreContainer was not shutdown prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!! instance=39188805
[junit4:junit4] 2> 788228 T2222 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4:junit4] 2> 788229 T2222 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4:junit4] 2> 788229 T2222 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 788235 T2222 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 788237 T2222 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 788246 T2222 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 788248 T2222 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 788251 T2222 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 788251 T2222 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 788251 T2222 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 788252 T2222 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 788252 T2222 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 788252 T2222 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 788253 T2222 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 788253 T2222 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1371904106609/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty1/
[junit4:junit4] 2> 788253 T2222 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7e229394
[junit4:junit4] 2> 788253 T2222 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 788254 T2222 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty1
[junit4:junit4] 2> 788254 T2222 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty1/index/
[junit4:junit4] 2> 788254 T2222 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 788255 T2222 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty1/index
[junit4:junit4] 2> 788257 T2222 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty1/index,segFN=segments_1,generation=1}
[junit4:junit4] 2> 788257 T2222 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 788259 T2222 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 788259 T2222 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 788260 T2222 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 788260 T2222 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 788261 T2222 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 788261 T2222 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 788261 T2222 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 788262 T2222 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 788262 T2222 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 788264 T2222 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 788267 T2222 oass.SolrIndexSearcher.<init> Opening Searcher@3ccc0576 main
[junit4:junit4] 2> 788267 T2222 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 788268 T2222 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 788271 T2223 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3ccc0576 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 788273 T2222 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 788273 T2222 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:44824/e_t collection:collection1 shard:shard1
[junit4:junit4] 2> 788274 T2222 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 788278 T2222 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 788279 T2222 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 788279 T2222 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 788279 T2222 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:44824/e_t/collection1/
[junit4:junit4] 2> 788279 T2222 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 788280 T2222 oasc.SyncStrategy.syncToMe http://127.0.0.1:44824/e_t/collection1/ has no replicas
[junit4:junit4] 2> 788280 T2222 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:44824/e_t/collection1/
[junit4:junit4] 2> 788280 T2222 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 789447 T2202 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 789455 T2201 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 789455 T2208 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 789455 T2221 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 789486 T2222 oasc.ZkController.register We are http://127.0.0.1:44824/e_t/collection1/ and leader is http://127.0.0.1:44824/e_t/collection1/
[junit4:junit4] 2> 789486 T2222 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:44824/e_t
[junit4:junit4] 2> 789487 T2222 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 789487 T2222 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 789487 T2222 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 789488 T2222 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 789489 T2179 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 789490 T2179 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 789490 T2179 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 789554 T2179 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 789556 T2179 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:56367
[junit4:junit4] 2> 789557 T2179 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 789557 T2179 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 789557 T2179 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1371904111845
[junit4:junit4] 2> 789557 T2179 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1371904111845/solr.xml
[junit4:junit4] 2> 789558 T2179 oasc.CoreContainer.<init> New CoreContainer 1779347200
[junit4:junit4] 2> 789558 T2179 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1371904111845/'
[junit4:junit4] 2> 789558 T2179 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1371904111845/'
[junit4:junit4] 2> 789601 T2179 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 789601 T2179 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 789602 T2179 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 789602 T2179 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 789602 T2179 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 789602 T2179 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 789602 T2179 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 789603 T2179 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 789603 T2179 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 789603 T2179 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 789606 T2179 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 789606 T2179 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:35303/solr
[junit4:junit4] 2> 789606 T2179 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 789607 T2179 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 789609 T2235 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6844a2ba name:ZooKeeperConnection Watcher:127.0.0.1:35303 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 789609 T2179 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 789610 T2179 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 789613 T2179 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 789614 T2237 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@312e374d name:ZooKeeperConnection Watcher:127.0.0.1:35303/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 789614 T2179 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 789617 T2179 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 790619 T2179 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56367_e_t
[junit4:junit4] 2> 790620 T2179 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56367_e_t
[junit4:junit4] 2> 790622 T2201 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 790623 T2208 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 790623 T2237 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 790623 T2208 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 790623 T2201 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 790623 T2221 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 790623 T2221 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 790628 T2238 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 790628 T2238 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 790960 T2202 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 790961 T2202 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:44824_e_t_collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:44824_e_t",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:44824/e_t"}
[junit4:junit4] 2> 790963 T2202 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:56367_e_t",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:56367/e_t"}
[junit4:junit4] 2> 790964 T2202 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 790964 T2202 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 790967 T2221 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 790967 T2237 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 790967 T2208 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 790967 T2201 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 791629 T2238 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1371904111845/collection1
[junit4:junit4] 2> 791629 T2238 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 791630 T2238 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 791630 T2238 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 791631 T2238 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1371904111845/collection1/'
[junit4:junit4] 2> 791632 T2238 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty2-1371904111845/collection1/lib/README' to classloader
[junit4:junit4] 2> 791632 T2238 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty2-1371904111845/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 791654 T2238 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 791681 T2238 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 791682 T2238 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 791686 T2238 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 791971 T2238 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4:junit4] 2> 791971 T2238 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4:junit4] 2> 791972 T2238 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 791977 T2238 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 791979 T2238 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 791988 T2238 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 791991 T2238 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 791993 T2238 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 791994 T2238 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 791994 T2238 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 791994 T2238 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 791995 T2238 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 791995 T2238 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 791995 T2238 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 791995 T2238 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1371904111845/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty2/
[junit4:junit4] 2> 791995 T2238 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7e229394
[junit4:junit4] 2> 791996 T2238 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 791996 T2238 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty2
[junit4:junit4] 2> 791996 T2238 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty2/index/
[junit4:junit4] 2> 791996 T2238 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 791997 T2238 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty2/index
[junit4:junit4] 2> 791999 T2238 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty2/index,segFN=segments_1,generation=1}
[junit4:junit4] 2> 791999 T2238 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 792001 T2238 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 792001 T2238 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 792002 T2238 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 792002 T2238 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 792003 T2238 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 792003 T2238 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 792003 T2238 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 792003 T2238 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 792004 T2238 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 792006 T2238 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 792008 T2238 oass.SolrIndexSearcher.<init> Opening Searcher@39d53a3 main
[junit4:junit4] 2> 792009 T2238 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 792009 T2238 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 792013 T2239 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@39d53a3 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 792015 T2238 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 792015 T2238 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:56367/e_t collection:collection1 shard:shard1
[junit4:junit4] 2> 792018 T2238 oasc.ZkController.register We are http://127.0.0.1:56367/e_t/collection1/ and leader is http://127.0.0.1:44824/e_t/collection1/
[junit4:junit4] 2> 792018 T2238 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:56367/e_t
[junit4:junit4] 2> 792018 T2238 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 792018 T2238 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C3020 name=collection1 org.apache.solr.core.SolrCore@dcd56b4 url=http://127.0.0.1:56367/e_t/collection1 node=127.0.0.1:56367_e_t C3020_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:56367_e_t, base_url=http://127.0.0.1:56367/e_t}
[junit4:junit4] 2> 792018 T2240 C3020 P56367 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 792019 T2238 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 792019 T2240 C3020 P56367 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 792019 T2240 C3020 P56367 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 792019 T2240 C3020 P56367 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 792020 T2179 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 792020 T2179 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 792020 T2240 C3020 P56367 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 792020 T2179 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 792024 T2216 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:56367_e_t_collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 792095 T2179 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 792098 T2179 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:39874
[junit4:junit4] 2> 792098 T2179 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 792099 T2179 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 792099 T2179 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1371904114376
[junit4:junit4] 2> 792099 T2179 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1371904114376/solr.xml
[junit4:junit4] 2> 792099 T2179 oasc.CoreContainer.<init> New CoreContainer 426062260
[junit4:junit4] 2> 792100 T2179 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1371904114376/'
[junit4:junit4] 2> 792100 T2179 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1371904114376/'
[junit4:junit4] 2> 792141 T2179 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 792141 T2179 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 792142 T2179 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 792142 T2179 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 792142 T2179 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 792142 T2179 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 792142 T2179 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 792143 T2179 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 792143 T2179 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 792143 T2179 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 792146 T2179 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 792146 T2179 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:35303/solr
[junit4:junit4] 2> 792146 T2179 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 792147 T2179 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 792149 T2252 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5d77a747 name:ZooKeeperConnection Watcher:127.0.0.1:35303 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 792150 T2179 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 792151 T2179 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 792154 T2179 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 792155 T2254 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@18df98cc name:ZooKeeperConnection Watcher:127.0.0.1:35303/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 792155 T2179 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 792157 T2179 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 792497 T2202 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 792498 T2202 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:56367_e_t_collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:56367_e_t",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:56367/e_t"}
[junit4:junit4] 2> 792501 T2254 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 792501 T2208 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 792501 T2201 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 792501 T2237 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 792501 T2221 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 793024 T2216 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:56367_e_t_collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 793025 T2216 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:56367_e_t_collection1&state=recovering&nodeName=127.0.0.1:56367_e_t&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1001
[junit4:junit4] 2> 793159 T2179 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39874_e_t
[junit4:junit4] 2> 793160 T2179 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:39874_e_t
[junit4:junit4] 2> 793162 T2237 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 793162 T2201 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 793162 T2221 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 793162 T2201 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 793162 T2208 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 793162 T2254 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 793162 T2208 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 793162 T2221 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 793168 T2237 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 793168 T2254 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 793173 T2255 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 793173 T2255 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 794005 T2202 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 794005 T2202 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:39874_e_t",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:39874/e_t"}
[junit4:junit4] 2> 794006 T2202 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 794006 T2202 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 794009 T2201 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 794009 T2254 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 794010 T2237 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 794009 T2208 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 794009 T2221 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 794174 T2255 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1371904114376/collection1
[junit4:junit4] 2> 794174 T2255 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 794175 T2255 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 794175 T2255 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 794176 T2255 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1371904114376/collection1/'
[junit4:junit4] 2> 794177 T2255 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty3-1371904114376/collection1/lib/README' to classloader
[junit4:junit4] 2> 794177 T2255 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty3-1371904114376/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 794212 T2255 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 794249 T2255 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 794250 T2255 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 794254 T2255 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 794572 T2255 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4:junit4] 2> 794572 T2255 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4:junit4] 2> 794572 T2255 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 794578 T2255 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 794580 T2255 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 794590 T2255 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 794593 T2255 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 794595 T2255 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 794596 T2255 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 794596 T2255 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 794597 T2255 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 794597 T2255 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 794598 T2255 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 794598 T2255 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 794598 T2255 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1371904114376/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty3/
[junit4:junit4] 2> 794598 T2255 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7e229394
[junit4:junit4] 2> 794599 T2255 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 794599 T2255 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty3
[junit4:junit4] 2> 794599 T2255 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty3/index/
[junit4:junit4] 2> 794599 T2255 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 794600 T2255 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty3/index
[junit4:junit4] 2> 794603 T2255 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty3/index,segFN=segments_1,generation=1}
[junit4:junit4] 2> 794603 T2255 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 794605 T2255 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 794605 T2255 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 794606 T2255 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 794606 T2255 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 794606 T2255 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 794607 T2255 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 794607 T2255 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 794607 T2255 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 794608 T2255 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 794610 T2255 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 794612 T2255 oass.SolrIndexSearcher.<init> Opening Searcher@7ae6a5c5 main
[junit4:junit4] 2> 794613 T2255 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 794613 T2255 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 794618 T2256 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7ae6a5c5 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 794620 T2255 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 794621 T2255 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:39874/e_t collection:collection1 shard:shard1
[junit4:junit4] 2> 794623 T2255 oasc.ZkController.register We are http://127.0.0.1:39874/e_t/collection1/ and leader is http://127.0.0.1:44824/e_t/collection1/
[junit4:junit4] 2> 794623 T2255 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:39874/e_t
[junit4:junit4] 2> 794624 T2255 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 794624 T2255 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C3021 name=collection1 org.apache.solr.core.SolrCore@1196c7b6 url=http://127.0.0.1:39874/e_t/collection1 node=127.0.0.1:39874_e_t C3021_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:39874_e_t, base_url=http://127.0.0.1:39874/e_t}
[junit4:junit4] 2> 794624 T2257 C3021 P39874 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 794625 T2255 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 794625 T2257 C3021 P39874 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 794625 T2257 C3021 P39874 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 794625 T2257 C3021 P39874 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 794626 T2179 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 794626 T2179 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 794626 T2257 C3021 P39874 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 794626 T2179 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 794630 T2216 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:39874_e_t_collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 794690 T2179 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 794692 T2179 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:47823
[junit4:junit4] 2> 794693 T2179 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 794693 T2179 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 794694 T2179 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1371904116982
[junit4:junit4] 2> 794694 T2179 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1371904116982/solr.xml
[junit4:junit4] 2> 794694 T2179 oasc.CoreContainer.<init> New CoreContainer 1742386999
[junit4:junit4] 2> 794694 T2179 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1371904116982/'
[junit4:junit4] 2> 794695 T2179 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1371904116982/'
[junit4:junit4] 2> 794732 T2179 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 794733 T2179 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 794733 T2179 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 794733 T2179 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 794733 T2179 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 794733 T2179 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 794734 T2179 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 794734 T2179 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 794734 T2179 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 794734 T2179 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 794737 T2179 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 794737 T2179 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:35303/solr
[junit4:junit4] 2> 794738 T2179 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 794738 T2179 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 794740 T2269 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6789b136 name:ZooKeeperConnection Watcher:127.0.0.1:35303 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 794741 T2179 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 794742 T2179 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 794745 T2179 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 794746 T2271 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@606a0554 name:ZooKeeperConnection Watcher:127.0.0.1:35303/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 794746 T2179 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 794749 T2179 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> ASYNC NEW_CORE C3022 name=collection1 org.apache.solr.core.SolrCore@dcd56b4 url=http://127.0.0.1:56367/e_t/collection1 node=127.0.0.1:56367_e_t C3022_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:56367_e_t, base_url=http://127.0.0.1:56367/e_t}
[junit4:junit4] 2> 795026 T2240 C3022 P56367 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:44824/e_t/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 795026 T2240 C3022 P56367 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:56367/e_t START replicas=[http://127.0.0.1:44824/e_t/collection1/] nUpdates=100
[junit4:junit4] 2> 795026 T2240 C3022 P56367 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 795027 T2240 C3022 P56367 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 795027 T2240 C3022 P56367 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 795027 T2240 C3022 P56367 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 795027 T2240 C3022 P56367 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 795027 T2240 C3022 P56367 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:44824/e_t/collection1/. core=collection1
[junit4:junit4] 2> 795027 T2240 C3022 P56367 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C3023 name=collection1 org.apache.solr.core.SolrCore@7e463875 url=http://127.0.0.1:44824/e_t/collection1 node=127.0.0.1:44824_e_t C3023_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:44824_e_t, base_url=http://127.0.0.1:44824/e_t, leader=true}
[junit4:junit4] 2> 795031 T2217 C3023 P44824 oasc.SolrCore.execute [collection1] webapp=/e_t path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 795033 T2214 C3023 P44824 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 795036 T2214 C3023 P44824 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty1/index,segFN=segments_1,generation=1}
[junit4:junit4] 2> 795036 T2214 C3023 P44824 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 795045 T2214 C3023 P44824 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty1/index,segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty1/index,segFN=segments_2,generation=2}
[junit4:junit4] 2> 795045 T2214 C3023 P44824 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 795046 T2214 C3023 P44824 oass.SolrIndexSearcher.<init> Opening Searcher@6b4f4a68 realtime
[junit4:junit4] 2> 795046 T2214 C3023 P44824 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 795046 T2214 C3023 P44824 oasup.LogUpdateProcessor.finish [collection1] webapp=/e_t path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 13
[junit4:junit4] 2> 795047 T2240 C3022 P56367 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 795047 T2240 C3022 P56367 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 795049 T2214 C3023 P44824 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 795049 T2214 C3023 P44824 oasc.SolrCore.execute [collection1] webapp=/e_t path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 795050 T2240 C3022 P56367 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 795050 T2240 C3022 P56367 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 795050 T2240 C3022 P56367 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 795052 T2215 C3023 P44824 oasc.SolrCore.execute [collection1] webapp=/e_t path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=1
[junit4:junit4] 2> 795053 T2240 C3022 P56367 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 795053 T2240 C3022 P56367 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty2/index.20130622092837406
[junit4:junit4] 2> 795054 T2240 C3022 P56367 oash.SnapPuller.fetchLatestIndex Starting download to org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty2/index.20130622092837406 lockFactory=org.apache.lucene.store.NativeFSLockFactory@48e11e4a fullCopy=false
[junit4:junit4] 2> 795056 T2217 C3023 P44824 oasc.SolrCore.execute [collection1] webapp=/e_t path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 795057 T2240 C3022 P56367 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 795065 T2240 C3022 P56367 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 795065 T2240 C3022 P56367 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 795067 T2240 C3022 P56367 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty2/index,segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty2/index,segFN=segments_2,generation=2}
[junit4:junit4] 2> 795067 T2240 C3022 P56367 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 795068 T2240 C3022 P56367 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 795068 T2240 C3022 P56367 oass.SolrIndexSearcher.<init> Opening Searcher@1b5f14d main
[junit4:junit4] 2> 795069 T2239 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1b5f14d main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 795069 T2240 C3022 P56367 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty2/index.20130622092837406 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty2/index.20130622092837406;done=true>>]
[junit4:junit4] 2> 795069 T2240 C3022 P56367 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty2/index.20130622092837406
[junit4:junit4] 2> 795070 T2240 C3022 P56367 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty2/index.20130622092837406
[junit4:junit4] 2> 795070 T2240 C3022 P56367 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 795070 T2240 C3022 P56367 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 795070 T2240 C3022 P56367 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 795070 T2240 C3022 P56367 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 795072 T2240 C3022 P56367 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 795513 T2202 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 795514 T2202 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:39874_e_t_collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:39874_e_t",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:39874/e_t"}
[junit4:junit4] 2> 795517 T2202 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:56367_e_t_collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:56367_e_t",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:56367/e_t"}
[junit4:junit4] 2> 795538 T2201 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 795538 T2237 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 795538 T2208 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 795538 T2254 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 795538 T2221 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 795538 T2271 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 795630 T2216 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:39874_e_t_collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 795631 T2216 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:39874_e_t_collection1&state=recovering&nodeName=127.0.0.1:39874_e_t&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1001
[junit4:junit4] 2> 795751 T2179 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47823_e_t
[junit4:junit4] 2> 795752 T2179 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:47823_e_t
[junit4:junit4] 2> 795753 T2237 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 795754 T2201 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 795754 T2201 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 795754 T2271 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 795754 T2254 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 795754 T2221 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 795754 T2254 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 795754 T2271 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 795754 T2208 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 795755 T2237 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 795755 T2221 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 795755 T2208 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 795760 T2274 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 795760 T2274 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 797043 T2202 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 797043 T2202 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:47823_e_t",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:47823/e_t"}
[junit4:junit4] 2> 797044 T2202 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 797044 T2202 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 797047 T2201 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 797047 T2221 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 797047 T2237 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 797047 T2254 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 797047 T2208 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 797047 T2271 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> C3021_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:39874_e_t, base_url=http://127.0.0.1:39874/e_t}
[junit4:junit4] 2> 797632 T2257 C3021 P39874 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:44824/e_t/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 797632 T2257 C3021 P39874 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:39874/e_t START replicas=[http://127.0.0.1:44824/e_t/collection1/] nUpdates=100
[junit4:junit4] 2> 797632 T2257 C3021 P39874 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 797632 T2257 C3021 P39874 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 797632 T2257 C3021 P39874 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 797633 T2257 C3021 P39874 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 797633 T2257 C3021 P39874 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 797633 T2257 C3021 P39874 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:44824/e_t/collection1/. core=collection1
[junit4:junit4] 2> 797633 T2257 C3021 P39874 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 797634 T2216 C3023 P44824 oasc.SolrCore.execute [collection1] webapp=/e_t path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 797636 T2217 C3023 P44824 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 797645 T2217 C3023 P44824 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty1/index,segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty1/index,segFN=segments_3,generation=3}
[junit4:junit4] 2> 797645 T2217 C3023 P44824 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 797646 T2217 C3023 P44824 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 797646 T2217 C3023 P44824 oasup.LogUpdateProcessor.finish [collection1] webapp=/e_t path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 10
[junit4:junit4] 2> 797647 T2257 C3021 P39874 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 797647 T2257 C3021 P39874 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 797648 T2215 C3023 P44824 oasc.SolrCore.execute [collection1] webapp=/e_t path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4] 2> 797649 T2257 C3021 P39874 oash.SnapPuller.fetchLatestIndex Master's generation: 3
[junit4:junit4] 2> 797649 T2257 C3021 P39874 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 797649 T2257 C3021 P39874 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 797651 T2216 C3023 P44824 oasc.SolrCore.execute [collection1] webapp=/e_t path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=3&version=2} status=0 QTime=0
[junit4:junit4] 2> 797651 T2257 C3021 P39874 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 797652 T2257 C3021 P39874 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty3/index.20130622092840005
[junit4:junit4] 2> 797653 T2257 C3021 P39874 oash.SnapPuller.fetchLatestIndex Starting download to org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty3/index.20130622092840005 lockFactory=org.apache.lucene.store.NativeFSLockFactory@492778a6 fullCopy=false
[junit4:junit4] 2> ASYNC NEW_CORE C3024 name=collection1 org.apache.solr.core.SolrCore@7e463875 url=http://127.0.0.1:44824/e_t/collection1 node=127.0.0.1:44824_e_t C3024_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:44824_e_t, base_url=http://127.0.0.1:44824/e_t, leader=true}
[junit4:junit4] 2> 797661 T2217 C3024 P44824 oasc.SolrCore.execute [collection1] webapp=/e_t path=/replication params={file=segments_3&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=3} status=0 QTime=0
[junit4:junit4] 2> ASYNC NEW_CORE C3025 name=collection1 org.apache.solr.core.SolrCore@1196c7b6 url=http://127.0.0.1:39874/e_t/collection1 node=127.0.0.1:39874_e_t C3025_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:39874_e_t, base_url=http://127.0.0.1:39874/e_t}
[junit4:junit4] 2> 797662 T2257 C3025 P39874 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 797666 T2257 C3025 P39874 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 797666 T2257 C3025 P39874 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 797668 T2257 C3025 P39874 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty3/index,segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty3/index,segFN=segments_3,generation=3}
[junit4:junit4] 2> 797668 T2257 C3025 P39874 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 797669 T2257 C3025 P39874 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 797669 T2257 C3025 P39874 oass.SolrIndexSearcher.<init> Opening Searcher@3ca1cdcb main
[junit4:junit4] 2> 797670 T2256 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3ca1cdcb main{StandardDirectoryReader(segments_3:1:nrt)}
[junit4:junit4] 2> 797671 T2257 C3025 P39874 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty3/index.20130622092840005 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty3/index.20130622092840005;done=true>>]
[junit4:junit4] 2> 797671 T2257 C3025 P39874 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty3/index.20130622092840005
[junit4:junit4] 2> 797671 T2257 C3025 P39874 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty3/index.20130622092840005
[junit4:junit4] 2> 797671 T2257 C3025 P39874 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 797671 T2257 C3025 P39874 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 797671 T2257 C3025 P39874 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 797672 T2257 C3025 P39874 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 797673 T2257 C3025 P39874 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 797761 T2274 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1371904116982/collection1
[junit4:junit4] 2> 797762 T2274 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 797763 T2274 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 797763 T2274 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 797764 T2274 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1371904116982/collection1/'
[junit4:junit4] 2> 797765 T2274 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty4-1371904116982/collection1/lib/README' to classloader
[junit4:junit4] 2> 797765 T2274 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty4-1371904116982/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 797794 T2274 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 797823 T2274 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 797824 T2274 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 797829 T2274 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 798137 T2274 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4:junit4] 2> 798137 T2274 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4:junit4] 2> 798138 T2274 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 798143 T2274 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 798145 T2274 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 798156 T2274 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 798158 T2274 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 798161 T2274 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 798161 T2274 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 798162 T2274 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 798162 T2274 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 798163 T2274 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 798163 T2274 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 798163 T2274 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 798163 T2274 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1371904116982/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty4/
[junit4:junit4] 2> 798163 T2274 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7e229394
[junit4:junit4] 2> 798164 T2274 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 798164 T2274 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty4
[junit4:junit4] 2> 798164 T2274 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty4/index/
[junit4:junit4] 2> 798165 T2274 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 798165 T2274 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty4/index
[junit4:junit4] 2> 798186 T2274 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty4/index,segFN=segments_1,generation=1}
[junit4:junit4] 2> 798187 T2274 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 798188 T2274 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 798189 T2274 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 798189 T2274 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 798190 T2274 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 798190 T2274 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 798190 T2274 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 798191 T2274 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 798192 T2274 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 798192 T2274 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 798194 T2274 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 798196 T2274 oass.SolrIndexSearcher.<init> Opening Searcher@1563a3fc main
[junit4:junit4] 2> 798197 T2274 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 798197 T2274 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 798203 T2277 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1563a3fc main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 798205 T2274 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 798205 T2274 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:47823/e_t collection:collection1 shard:shard1
[junit4:junit4] 2> 798208 T2274 oasc.ZkController.register We are http://127.0.0.1:47823/e_t/collection1/ and leader is http://127.0.0.1:44824/e_t/collection1/
[junit4:junit4] 2> 798208 T2274 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:47823/e_t
[junit4:junit4] 2> 798208 T2274 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 798209 T2274 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C3026 name=collection1 org.apache.solr.core.SolrCore@dbadbae url=http://127.0.0.1:47823/e_t/collection1 node=127.0.0.1:47823_e_t C3026_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:47823_e_t, base_url=http://127.0.0.1:47823/e_t}
[junit4:junit4] 2> 798209 T2278 C3026 P47823 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 798209 T2274 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 798210 T2278 C3026 P47823 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 798210 T2278 C3026 P47823 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 798210 T2278 C3026 P47823 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 798211 T2179 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 798211 T2179 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 798211 T2278 C3026 P47823 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 798211 T2179 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 798214 T2179 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 798215 T2216 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:47823_e_t_collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 798215 T2179 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 2> 798215 T2179 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 2> 798216 T2179 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 798551 T2202 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 798551 T2202 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:39874_e_t_collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:39874_e_t",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:39874/e_t"}
[junit4:junit4] 2> 798554 T2202 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:47823_e_t_collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:47823_e_t",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:47823/e_t"}
[junit4:junit4] 2> 798556 T2201 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 798557 T2254 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 798557 T2237 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 798556 T2221 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 798556 T2208 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 798556 T2271 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 799215 T2216 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:47823_e_t_collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 799216 T2216 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:47823_e_t_collection1&state=recovering&nodeName=127.0.0.1:47823_e_t&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1001
[junit4:junit4] 2> 799217 T2179 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 800219 T2179 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C3026_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:47823_e_t, base_url=http://127.0.0.1:47823/e_t}
[junit4:junit4] 2> 801216 T2278 C3026 P47823 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:44824/e_t/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 801217 T2278 C3026 P47823 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:47823/e_t START replicas=[http://127.0.0.1:44824/e_t/collection1/] nUpdates=100
[junit4:junit4] 2> 801217 T2278 C3026 P47823 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 801217 T2278 C3026 P47823 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 801217 T2278 C3026 P47823 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 801217 T2278 C3026 P47823 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 801217 T2278 C3026 P47823 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 801218 T2278 C3026 P47823 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:44824/e_t/collection1/. core=collection1
[junit4:junit4] 2> 801218 T2278 C3026 P47823 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C3027 name=collection1 org.apache.solr.core.SolrCore@7e463875 url=http://127.0.0.1:44824/e_t/collection1 node=127.0.0.1:44824_e_t C3027_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:44824_e_t, base_url=http://127.0.0.1:44824/e_t, leader=true}
[junit4:junit4] 2> 801219 T2214 C3027 P44824 oasc.SolrCore.execute [collection1] webapp=/e_t path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 801220 T2179 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 801221 T2217 C3027 P44824 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 801355 T2217 C3027 P44824 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=3
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty1/index,segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty1/index,segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty1/index,segFN=segments_4,generation=4}
[junit4:junit4] 2> 801355 T2217 C3027 P44824 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4:junit4] 2> 801355 T2217 C3027 P44824 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 801356 T2217 C3027 P44824 oasup.LogUpdateProcessor.finish [collection1] webapp=/e_t path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 135
[junit4:junit4] 2> 801357 T2278 C3026 P47823 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 801357 T2278 C3026 P47823 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 801359 T2214 C3027 P44824 oasc.SolrCore.execute [collection1] webapp=/e_t path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 801359 T2278 C3026 P47823 oash.SnapPuller.fetchLatestIndex Master's generation: 4
[junit4:junit4] 2> 801359 T2278 C3026 P47823 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 801359 T2278 C3026 P47823 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 801361 T2215 C3027 P44824 oasc.SolrCore.execute [collection1] webapp=/e_t path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=4&version=2} status=0 QTime=0
[junit4:junit4] 2> 801362 T2278 C3026 P47823 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 801363 T2278 C3026 P47823 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty4/index.20130622092843715
[junit4:junit4] 2> 801363 T2278 C3026 P47823 oash.SnapPuller.fetchLatestIndex Starting download to org.apache.lucene.store.MMapDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty4/index.20130622092843715 lockFactory=org.apache.lucene.store.NativeFSLockFactory@39defc07 fullCopy=false
[junit4:junit4] 2> 801365 T2217 C3027 P44824 oasc.SolrCore.execute [collection1] webapp=/e_t path=/replication params={file=segments_4&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=4} status=0 QTime=0
[junit4:junit4] 2> 801366 T2278 C3026 P47823 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 801368 T2278 C3026 P47823 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 801368 T2278 C3026 P47823 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 801370 T2278 C3026 P47823 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty4/index,segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty4/index,segFN=segments_4,generation=4}
[junit4:junit4] 2> 801370 T2278 C3026 P47823 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4:junit4] 2> 801370 T2278 C3026 P47823 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 801371 T2278 C3026 P47823 oass.SolrIndexSearcher.<init> Opening Searcher@4f95600e main
[junit4:junit4] 2> 801372 T2277 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4f95600e main{StandardDirectoryReader(segments_4:1:nrt)}
[junit4:junit4] 2> 801373 T2278 C3026 P47823 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty4/index.20130622092843715 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty4/index.20130622092843715;done=true>>]
[junit4:junit4] 2> 801373 T2278 C3026 P47823 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty4/index.20130622092843715
[junit4:junit4] 2> 801373 T2278 C3026 P47823 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty4/index.20130622092843715
[junit4:junit4] 2> 801373 T2278 C3026 P47823 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 801373 T2278 C3026 P47823 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 801373 T2278 C3026 P47823 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 801374 T2278 C3026 P47823 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 801375 T2278 C3026 P47823 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 801562 T2202 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 801563 T2202 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:47823_e_t_collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:47823_e_t",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:47823/e_t"}
[junit4:junit4] 2> 801566 T2201 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 801566 T2254 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 801566 T2208 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 801566 T2237 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 801566 T2221 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 801566 T2271 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 802221 T2179 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 802222 T2179 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> ASYNC NEW_CORE C3028 name=collection1 org.apache.solr.core.SolrCore@67fe6888 url=http://127.0.0.1:58087/e_t/collection1 node=127.0.0.1:58087_e_t C3028_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:58087_e_t, base_url=http://127.0.0.1:58087/e_t, leader=true}
[junit4:junit4] 2> 802228 T2195 C3028 P58087 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 802230 T2195 C3028 P58087 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/control/data/index,segFN=segments_1,generation=1}
[junit4:junit4] 2> 802230 T2195 C3028 P58087 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 802255 T2195 C3028 P58087 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/control/data/index,segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/control/data/index,segFN=segments_2,generation=2}
[junit4:junit4] 2> 802255 T2195 C3028 P58087 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 802256 T2195 C3028 P58087 oass.SolrIndexSearcher.<init> Opening Searcher@7f7293a1 main
[junit4:junit4] 2> 802256 T2195 C3028 P58087 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 802257 T2205 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7f7293a1 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 802258 T2195 C3028 P58087 oasup.LogUpdateProcessor.finish [collection1] webapp=/e_t path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 30
[junit4:junit4] 2> 802262 T2217 C3027 P44824 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:44824/e_t/collection1/, StdNode: http://127.0.0.1:56367/e_t/collection1/, StdNode: http://127.0.0.1:39874/e_t/collection1/, StdNode: http://127.0.0.1:47823/e_t/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 802265 T2214 C3027 P44824 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> ASYNC NEW_CORE C3029 name=collection1 org.apache.solr.core.SolrCore@dcd56b4 url=http://127.0.0.1:56367/e_t/collection1 node=127.0.0.1:56367_e_t C3029_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:56367_e_t, base_url=http://127.0.0.1:56367/e_t}
[junit4:junit4] 2> 802269 T2230 C3029 P56367 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> ASYNC NEW_CORE C3030 name=collection1 org.apache.solr.core.SolrCore@1196c7b6 url=http://127.0.0.1:39874/e_t/collection1 node=127.0.0.1:39874_e_t C3030_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:39874_e_t, base_url=http://127.0.0.1:39874/e_t}
[junit4:junit4] 2> 802269 T2247 C3030 P39874 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> C3026_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:47823_e_t, base_url=http://127.0.0.1:47823/e_t}
[junit4:junit4] 2> 802269 T2267 C3026 P47823 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 802285 T2214 C3027 P44824 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=4
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty1/index,segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty1/index,segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty1/index,segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty1/index,segFN=segments_5,generation=5}
[junit4:junit4] 2> 802285 T2214 C3027 P44824 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 5
[junit4:junit4] 2> 802286 T2214 C3027 P44824 oass.SolrIndexSearcher.<init> Opening Searcher@46c3397c main
[junit4:junit4] 2> 802286 T2214 C3027 P44824 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 802287 T2223 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@46c3397c main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 802287 T2214 C3027 P44824 oasup.LogUpdateProcessor.finish [collection1] webapp=/e_t path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 22
[junit4:junit4] 2> 802315 T2247 C3030 P39874 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty3/index,segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty3/index,segFN=segments_4,generation=4}
[junit4:junit4] 2> 802315 T2230 C3029 P56367 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty2/index,segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty2/index,segFN=segments_3,generation=3}
[junit4:junit4] 2> 802315 T2267 C3026 P47823 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty4/index,segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty4/index,segFN=segments_5,generation=5}
[junit4:junit4] 2> 802315 T2230 C3029 P56367 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 802315 T2247 C3030 P39874 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4:junit4] 2> 802316 T2267 C3026 P47823 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 5
[junit4:junit4] 2> 802317 T2230 C3029 P56367 oass.SolrIndexSearcher.<init> Opening Searcher@13aa07b1 main
[junit4:junit4] 2> 802317 T2247 C3030 P39874 oass.SolrIndexSearcher.<init> Opening Searcher@95b81ea main
[junit4:junit4] 2> 802317 T2267 C3026 P47823 oass.SolrIndexSearcher.<init> Opening Searcher@351c7e4a main
[junit4:junit4] 2> 802317 T2230 C3029 P56367 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 802318 T2267 C3026 P47823 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 802318 T2239 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@13aa07b1 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 802318 T2256 oasc.JmxMonitoredMap.put WARN Failed to register info bean: searcher javax.management.InstanceAlreadyExistsException: solr/collection1:type=searcher,id=org.apache.solr.search.SolrIndexSearcher
[junit4:junit4] 2> at com.sun.jmx.mbeanserver.Repository.addMBean(Repository.java:437)
[junit4:junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerWithRepository(DefaultMBeanServerInterceptor.java:1898)
[junit4:junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:966)
[junit4:junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)
[junit4:junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)
[junit4:junit4] 2> at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:522)
[junit4:junit4] 2> at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:140)
[junit4:junit4] 2> at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:51)
[junit4:junit4] 2> at org.apache.solr.search.SolrIndexSearcher.register(SolrIndexSearcher.java:298)
[junit4:junit4] 2> at org.apache.solr.core.SolrCore.registerSearcher(SolrCore.java:1846)
[junit4:junit4] 2> at org.apache.solr.core.SolrCore.access$000(SolrCore.java:135)
[junit4:junit4] 2> at org.apache.solr.core.SolrCore$7.call(SolrCore.java:1723)
[junit4:junit4] 2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
[junit4:junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:166)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:724)
[junit4:junit4] 2>
[junit4:junit4] 2> 802318 T2247 C3030 P39874 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 802319 T2230 C3029 P56367 oasup.LogUpdateProcessor.finish [collection1] webapp=/e_t path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 50
[junit4:junit4] 2> 802318 T2277 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@351c7e4a main{StandardDirectoryReader(segments_4:1:nrt)}
[junit4:junit4] 2> 802319 T2256 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@95b81ea main{StandardDirectoryReader(segments_3:1:nrt)}
[junit4:junit4] 2> 802320 T2267 C3026 P47823 oasup.LogUpdateProcessor.finish [collection1] webapp=/e_t path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 51
[junit4:junit4] 2> 802320 T2247 C3030 P39874 oasup.LogUpdateProcessor.finish [collection1] webapp=/e_t path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 51
[junit4:junit4] 2> 802320 T2217 C3027 P44824 oasup.LogUpdateProcessor.finish [collection1] webapp=/e_t path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 58
[junit4:junit4] 2> 802321 T2179 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 802323 T2215 C3027 P44824 oasc.SolrCore.execute [collection1] webapp=/e_t path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 802324 T2231 C3029 P56367 oasc.SolrCore.execute [collection1] webapp=/e_t path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 802326 T2249 C3030 P39874 oasc.SolrCore.execute [collection1] webapp=/e_t path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 802327 T2265 C3026 P47823 oasc.SolrCore.execute [collection1] webapp=/e_t path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 804332 T2197 C3028 P58087 oasup.LogUpdateProcessor.finish [collection1] webapp=/e_t path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1438545741541801984)} 0 2
[junit4:junit4] 2> 804339 T2265 C3026 P47823 oasup.LogUpdateProcessor.finish [collection1] webapp=/e_t path=/update params={update.distrib=FROMLEADER&_version_=-1438545741547044864&update.from=http://127.0.0.1:44824/e_t/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1438545741547044864)} 0 1
[junit4:junit4] 2> 804339 T2250 C3030 P39874 oasup.LogUpdateProcessor.finish [collection1] webapp=/e_t path=/update params={update.distrib=FROMLEADER&_version_=-1438545741547044864&update.from=http://127.0.0.1:44824/e_t/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1438545741547044864)} 0 1
[junit4:junit4] 2> 804339 T2230 C3029 P56367 oasup.LogUpdateProcessor.finish [collection1] webapp=/e_t path=/update params={update.distrib=FROMLEADER&_version_=-1438545741547044864&update.from=http://127.0.0.1:44824/e_t/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1438545741547044864)} 0 0
[junit4:junit4] 2> 804340 T2215 C3027 P44824 oasup.LogUpdateProcessor.finish [collection1] webapp=/e_t path=/update params={update.distrib=TOLEADER&wt=javabin&version=2} {deleteByQuery=*:* (-1438545741547044864)} 0 4
[junit4:junit4] 2> 804340 T2249 C3030 P39874 oasup.LogUpdateProcessor.finish [collection1] webapp=/e_t path=/update params={wt=javabin&version=2} {deleteByQuery=*:*} 0 6
[junit4:junit4] 2> 804345 T2194 C3028 P58087 oasup.LogUpdateProcessor.finish [collection1] webapp=/e_t path=/update params={wt=javabin&version=2} {add=[0 (1438545741554384896)]} 0 3
[junit4:junit4] 2> 804355 T2233 C3029 P56367 oasup.LogUpdateProcessor.finish [collection1] webapp=/e_t path=/update params={distrib.from=http://127.0.0.1:44824/e_t/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1438545741559627776)]} 0 2
[junit4:junit4] 2> 804355 T2247 C3030 P39874 oasup.LogUpdateProcessor.finish [collection1] webapp=/e_t path=/update params={distrib.from=http://127.0.0.1:44824/e_t/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1438545741559627776)]} 0 2
[junit4:junit4] 2> 804355 T2264 C3026 P47823 oasup.LogUpdateProcessor.finish [collection1] webapp=/e_t path=/update params={distrib.from=http://127.0.0.1:44824/e_t/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1438545741559627776)]} 0 2
[junit4:junit4] 2> 804356 T2216 C3027 P44824 oasup.LogUpdateProcessor.finish [collection1] webapp=/e_t path=/update params={distrib.from=http://127.0.0.1:56367/e_t/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[0 (1438545741559627776)]} 0 8
[junit4:junit4] 2> 804357 T2232 C3029 P56367 oasup.LogUpdateProcessor.finish [collection1] webapp=/e_t path=/update params={wt=javabin&version=2} {add=[0]} 0 11
[junit4:junit4] 2> 804360 T2195 C3028 P58087 oasup.LogUpdateProcessor.finish [collection1] webapp=/e_t path=/update params={wt=javabin&version=2} {add=[1 (1438545741571162112)]} 0 1
[junit4:junit4] 2> 804367 T2248 C3030 P39874 oasup.LogUpdateProcessor.finish [collection1] webapp=/e_t path=/update params={distrib.from=http://127.0.0.1:44824/e_t/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1438545741575356416)]} 0 1
[junit4:junit4] 2> 804367 T2266 C3026 P47823 oasup.LogUpdateProcessor.finish [collection1] webapp=/e_t path=/update params={distrib.from=http://127.0.0.1:44824/e_t/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1438545741575356416)]} 0 1
[junit4:junit4] 2> 804367 T2231 C3029 P56367 oasup.LogUpdateProcessor.finish [collection1] webapp=/e_t path=/update params={distrib.from=http://127.0.0.1:44824/e_t/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1438545741575356416)]} 0 1
[junit4:junit4] 2> 804368 T2214 C3027 P44824 oasup.LogUpdateProcessor.finish [collection1] webapp=/e_t path=/update params={distrib.from=http://127.0.0.1:47823/e_t/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[1 (1438545741575356416)]} 0 5
[junit4:junit4] 2> 804368 T2267 C3026 P47823 oasup.LogUpdateProcessor.finish [collection1] webapp=/e_t path=/update params={wt=javabin&version=2} {add=[1]} 0 7
[junit4:junit4] 2> 804371 T2197 C3028 P58087 oasup.LogUpdateProcessor.finish [collection1] webapp=/e_t path=/update params={wt=javabin&version=2} {add=[2 (1438545741583745024)]} 0 0
[junit4:junit4] 2> 804376 T2217 C3027 P44824 oasup.DistributedUpdateProcessor.setupRequest test.distrib.skip.servers was found and contains:[http://127.0.0.1:56367/e_t/collection1/]
[junit4:junit4] 2> 804376 T2217 C3027 P44824 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:56367/e_t/collection1/ against:[http://127.0.0.1:56367/e_t/collection1/] result:true
[junit4:junit4] 2> 804376 T2217 C3027 P44824 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:39874/e_t/collection1/ against:[http://127.0.0.1:56367/e_t/collection1/] result:false
[junit4:junit4] 2> 804376 T2217 C3027 P44824 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:47823/e_t/collection1/ against:[http://127.0.0.1:56367/e_t/collection1/] result:false
[junit4:junit4] 2> 804381 T2265 C3026 P47823 oasup.LogUpdateProcessor.finish [collection1] webapp=/e_t path=/update params={distrib.from=http://127.0.0.1:44824/e_t/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:56367/e_t/collection1/&wt=javabin&version=2} {add=[2 (1438545741590036480)]} 0 2
[junit4:junit4] 2> 804381 T2249 C3030 P39874 oasup.LogUpdateProcessor.finish [collection1] webapp=/e_t path=/update params={distrib.from=http://127.0.0.1:44824/e_t/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:56367/e_t/collection1/&wt=javabin&version=2} {add=[2 (1438545741590036480)]} 0 2
[junit4:junit4] 2> 804381 T2217 C3027 P44824 oasup.LogUpdateProcessor.finish [collection1] webapp=/e_t path=/update params={distrib.from=http://127.0.0.1:39874/e_t/collection1/&update.distrib=TOLEADER&test.distrib.skip.servers=http://127.0.0.1:56367/e_t/collection1/&wt=javabin&version=2} {add=[2 (1438545741590036480)]} 0 6
[junit4:junit4] 2> 804382 T2250 C3030 P39874 oasup.LogUpdateProcessor.finish [collection1] webapp=/e_t path=/update params={test.distrib.skip.servers=http://127.0.0.1:56367/e_t/collection1/&wt=javabin&version=2} {add=[2]} 0 8
[junit4:junit4] 2> 804385 T2194 C3028 P58087 oasup.LogUpdateProcessor.finish [collection1] webapp=/e_t path=/update params={wt=javabin&version=2} {add=[3 (1438545741597376512)]} 0 1
[junit4:junit4] 2> 804389 T2215 C3027 P44824 oasup.DistributedUpdateProcessor.setupRequest test.distrib.skip.servers was found and contains:[http://127.0.0.1:56367/e_t/collection1/]
[junit4:junit4] 2> 804389 T2215 C3027 P44824 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:56367/e_t/collection1/ against:[http://127.0.0.1:56367/e_t/collection1/] result:true
[junit4:junit4] 2> 804390 T2215 C3027 P44824 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:39874/e_t/collection1/ against:[http://127.0.0.1:56367/e_t/collection1/] result:false
[junit4:junit4] 2> 804390 T2215 C3027 P44824 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:47823/e_t/collection1/ against:[http://127.0.0.1:56367/e_t/collection1/] result:false
[junit4:junit4] 2> 804393 T2247 C3030 P39874 oasup.LogUpdateProcessor.finish [collection1] webapp=/e_t path=/update params={distrib.from=http://127.0.0.1:44824/e_t/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:56367/e_t/collection1/&wt=javabin&version=2} {add=[3 (1438545741603667968)]} 0 1
[junit4:junit4] 2> 804393 T2266 C3026 P47823 oasup.LogUpdateProcessor.finish [collection1] webapp=/e_t path=/update params={distrib.from=http://127.0.0.1:44824/e_t/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:56367/e_t/collection1/&wt=javabin&version=2} {add=[3 (1438545741603667968)]} 0 1
[junit4:junit4] 2> 804394 T2215 C3027 P44824 oasup.LogUpdateProcessor.finish [collection1] webapp=/e_t path=/update params={distrib.from=http://127.0.0.1:47823/e_t/collection1/&update.distrib=TOLEADER&test.distrib.skip.servers=http://127.0.0.1:56367/e_t/collection1/&wt=javabin&version=2} {add=[3 (1438545741603667968)]} 0 6
[junit4:junit4] 2> 804394 T2264 C3026 P47823 oasup.LogUpdateProcessor.finish [collection1] webapp=/e_t path=/update params={test.distrib.skip.servers=http://127.0.0.1:56367/e_t/collection1/&test.distrib.skip.servers=http://127.0.0.1:39874/e_t/collection1/&wt=javabin&version=2} {add=[3]} 0 7
[junit4:junit4] 2> 804396 T2195 C3028 P58087 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 804415 T2195 C3028 P58087 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/control/data/index,segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/control/data/index,segFN=segments_3,generation=3}
[junit4:junit4] 2> 804415 T2195 C3028 P58087 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 804417 T2195 C3028 P58087 oass.SolrIndexSearcher.<init> Opening Searcher@3f7e792e main
[junit4:junit4] 2> 804418 T2195 C3028 P58087 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 804418 T2205 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3f7e792e main{StandardDirectoryReader(segments_3:3:nrt _0(4.4):c4)}
[junit4:junit4] 2> 804419 T2195 C3028 P58087 oasup.LogUpdateProcessor.finish [collection1] webapp=/e_t path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 23
[junit4:junit4] 2> 804421 T2267 C3026 P47823 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:44824/e_t/collection1/, StdNode: http://127.0.0.1:56367/e_t/collection1/, StdNode: http://127.0.0.1:39874/e_t/collection1/, StdNode: http://127.0.0.1:47823/e_t/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 804423 T2248 C3030 P39874 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 804423 T2266 C3026 P47823 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 804423 T2216 C3027 P44824 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 804423 T2233 C3029 P56367 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 804465 T2233 C3029 P56367 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty2/index,segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty2/index,segFN=segments_4,generation=4}
[junit4:junit4] 2> 804465 T2233 C3029 P56367 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4:junit4] 2> 804465 T2216 C3027 P44824 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=5
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty1/index,segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty1/index,segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty1/index,segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty1/index,segFN=segments_5,generation=5}
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty1/index,segFN=segments_6,generation=6}
[junit4:junit4] 2> 804466 T2216 C3027 P44824 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 6
[junit4:junit4] 2> 804468 T2233 C3029 P56367 oass.SolrIndexSearcher.<init> Opening Searcher@50facf4e main
[junit4:junit4] 2> 804468 T2233 C3029 P56367 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 804468 T2216 C3027 P44824 oass.SolrIndexSearcher.<init> Opening Searcher@23c3754e main
[junit4:junit4] 2> 804469 T2216 C3027 P44824 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 804469 T2239 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@50facf4e main{StandardDirectoryReader(segments_4:3:nrt _0(4.4):c2)}
[junit4:junit4] 2> 804469 T2223 oasc.JmxMonitoredMap.put WARN Failed to register info bean: fieldValueCache javax.management.InstanceAlreadyExistsException: solr/collection1:type=fieldValueCache,id=org.apache.solr.search.FastLRUCache
[junit4:junit4] 2> at com.sun.jmx.mbeanserver.Repository.addMBean(Repository.java:437)
[junit4:junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerWithRepository(DefaultMBeanServerInterceptor.java:1898)
[junit4:junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:966)
[junit4:junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)
[junit4:junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)
[junit4:junit4] 2> at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:522)
[junit4:junit4] 2> at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:140)
[junit4:junit4] 2> at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:51)
[junit4:junit4] 2> at org.apache.solr.search.SolrIndexSearcher.register(SolrIndexSearcher.java:302)
[junit4:junit4] 2> at org.apache.solr.core.SolrCore.registerSearcher(SolrCore.java:1846)
[junit4:junit4] 2> at org.apache.solr.core.SolrCore.access$000(SolrCore.java:135)
[junit4:junit4] 2> at org.apache.solr.core.SolrCore$7.call(SolrCore.java:1723)
[junit4:junit4] 2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
[junit4:junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:166)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:724)
[junit4:junit4] 2>
[junit4:junit4] 2> 804470 T2233 C3029 P56367 oasup.LogUpdateProcessor.finish [collection1] webapp=/e_t path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 47
[junit4:junit4] 2> 804470 T2223 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@23c3754e main{StandardDirectoryReader(segments_6:3:nrt _0(4.4):c4)}
[junit4:junit4] 2> 804470 T2216 C3027 P44824 oasup.LogUpdateProcessor.finish [collection1] webapp=/e_t path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 47
[junit4:junit4] 2> 804485 T2266 C3026 P47823 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty4/index,segFN=segments_5,generation=5}
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty4/index,segFN=segments_6,generation=6}
[junit4:junit4] 2> 804485 T2266 C3026 P47823 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 6
[junit4:junit4] 2> 804487 T2266 C3026 P47823 oass.SolrIndexSearcher.<init> Opening Searcher@3f89f8eb main
[junit4:junit4] 2> 804488 T2266 C3026 P47823 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 804488 T2277 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3f89f8eb main{StandardDirectoryReader(segments_6:3:nrt _0(4.4):c4)}
[junit4:junit4] 2> 804489 T2266 C3026 P47823 oasup.LogUpdateProcessor.finish [collection1] webapp=/e_t path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 66
[junit4:junit4] 2> 804505 T2248 C3030 P39874 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty3/index,segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty3/index,segFN=segments_5,generation=5}
[junit4:junit4] 2> 804505 T2248 C3030 P39874 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 5
[junit4:junit4] 2> 804507 T2248 C3030 P39874 oass.SolrIndexSearcher.<init> Opening Searcher@5323f4ad main
[junit4:junit4] 2> 804508 T2248 C3030 P39874 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 804509 T2256 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5323f4ad main{StandardDirectoryReader(segments_5:3:nrt _0(4.4):c4)}
[junit4:junit4] 2> 804509 T2248 C3030 P39874 oasup.LogUpdateProcessor.finish [collection1] webapp=/e_t path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 86
[junit4:junit4] 2> 804510 T2267 C3026 P47823 oasup.LogUpdateProcessor.finish [collection1] webapp=/e_t path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 89
[junit4:junit4] 2> 804510 T2179 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):230
[junit4:junit4] 2> 804511 T2179 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 804511 T2179 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> 804513 T2214 C3027 P44824 oasc.SolrCore.execute [collection1] webapp=/e_t path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=0
[junit4:junit4] 2> 804516 T2232 C3029 P56367 oasc.SolrCore.execute [collection1] webapp=/e_t path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=2 status=0 QTime=0
[junit4:junit4] 2> 804518 T2249 C3030 P39874 oasc.SolrCore.execute [collection1] webapp=/e_t path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=0
[junit4:junit4] 2> 804520 T2264 C3026 P47823 oasc.SolrCore.execute [collection1] webapp=/e_t path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=0
[junit4:junit4] 2> 804521 T2179 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 804524 T2250 oasha.CollectionsHandler.handleSyncShardAction Syncing shard : shard=shard1&action=SYNCSHARD&collection=collection1&wt=javabin&version=2
[junit4:junit4] 2> 804524 T2250 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 804527 T2217 oasha.CoreAdminHandler.handleRequestSyncAction I have been requested to sync up my shard
[junit4:junit4] 2> 804527 T2217 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:44824/e_t/collection1/
[junit4:junit4] 2> 804528 T2217 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:44824/e_t START replicas=[http://127.0.0.1:56367/e_t/collection1/, http://127.0.0.1:39874/e_t/collection1/, http://127.0.0.1:47823/e_t/collection1/] nUpdates=100
[junit4:junit4] 2> 804529 T2231 C3029 P56367 oasc.SolrCore.execute [collection1] webapp=/e_t path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 804529 T2266 C3026 P47823 oasc.SolrCore.execute [collection1] webapp=/e_t path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 804530 T2217 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:44824/e_t Received 3 versions from 127.0.0.1:56367/e_t/collection1/
[junit4:junit4] 2> 804529 T2247 C3030 P39874 oasc.SolrCore.execute [collection1] webapp=/e_t path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 804530 T2217 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:44824/e_t Our versions are newer. ourLowThreshold=1438545741547044864 otherHigh=1438545741575356416
[junit4:junit4] 2> 804530 T2217 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:44824/e_t Received 5 versions from 127.0.0.1:47823/e_t/collection1/
[junit4:junit4] 2> 804531 T2217 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:44824/e_t Our versions are newer. ourLowThreshold=1438545741547044864 otherHigh=1438545741590036480
[junit4:junit4] 2> 804531 T2217 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:44824/e_t Received 5 versions from 127.0.0.1:39874/e_t/collection1/
[junit4:junit4] 2> 804531 T2217 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:44824/e_t Our versions are newer. ourLowThreshold=1438545741547044864 otherHigh=1438545741590036480
[junit4:junit4] 2> 804531 T2217 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:44824/e_t DONE. sync succeeded
[junit4:junit4] 2> 804531 T2217 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 804531 T2217 oasc.SyncStrategy.syncToMe http://127.0.0.1:44824/e_t/collection1/: try and ask http://127.0.0.1:56367/e_t/collection1/ to sync
[junit4:junit4] 2> 804532 T2217 oasc.SyncStrategy.syncToMe http://127.0.0.1:44824/e_t/collection1/: try and ask http://127.0.0.1:39874/e_t/collection1/ to sync
[junit4:junit4] 2> 804532 T2217 oasc.SyncStrategy.syncToMe http://127.0.0.1:44824/e_t/collection1/: try and ask http://127.0.0.1:47823/e_t/collection1/ to sync
[junit4:junit4] 2> 804533 T2230 C3029 P56367 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:56367/e_t START replicas=[http://127.0.0.1:44824/e_t/collection1/] nUpdates=100
[junit4:junit4] 2> 804533 T2248 C3030 P39874 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:39874/e_t START replicas=[http://127.0.0.1:44824/e_t/collection1/] nUpdates=100
[junit4:junit4] 2> 804534 T2267 C3026 P47823 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:47823/e_t START replicas=[http://127.0.0.1:44824/e_t/collection1/] nUpdates=100
[junit4:junit4] 2> 804535 T2216 C3027 P44824 oasc.SolrCore.execute [collection1] webapp=/e_t path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 804535 T2248 C3030 P39874 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:39874/e_t Received 5 versions from 127.0.0.1:44824/e_t/collection1/
[junit4:junit4] 2> 804535 T2214 C3027 P44824 oasc.SolrCore.execute [collection1] webapp=/e_t path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 804535 T2248 C3030 P39874 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:39874/e_t Our versions are newer. ourLowThreshold=1438545741547044864 otherHigh=1438545741590036480
[junit4:junit4] 2> 804536 T2248 C3030 P39874 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:39874/e_t DONE. sync succeeded
[junit4:junit4] 2> 804536 T2230 C3029 P56367 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:56367/e_t Received 5 versions from 127.0.0.1:44824/e_t/collection1/
[junit4:junit4] 2> 804536 T2215 C3027 P44824 oasc.SolrCore.execute [collection1] webapp=/e_t path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 804536 T2230 C3029 P56367 oasu.PeerSync.requestUpdates PeerSync: core=collection1 url=http://127.0.0.1:56367/e_t Requesting updates from 127.0.0.1:44824/e_t/collection1/n=2 versions=[1438545741603667968, 1438545741590036480]
[junit4:junit4] 2> 804537 T2267 C3026 P47823 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:47823/e_t Received 5 versions from 127.0.0.1:44824/e_t/collection1/
[junit4:junit4] 2> 804536 T2248 C3030 P39874 oasc.SolrCore.execute [collection1] webapp=/e_t path=/get params={sync=http://127.0.0.1:44824/e_t/collection1/&getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=3
[junit4:junit4] 2> 804537 T2267 C3026 P47823 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:47823/e_t Our versions are newer. ourLowThreshold=1438545741547044864 otherHigh=1438545741590036480
[junit4:junit4] 2> 804538 T2267 C3026 P47823 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:47823/e_t DONE. sync succeeded
[junit4:junit4] 2> 804537 T2217 oasc.SyncStrategy.syncToMe http://127.0.0.1:44824/e_t/collection1/: sync completed with http://127.0.0.1:39874/e_t/collection1/
[junit4:junit4] 2> 804538 T2267 C3026 P47823 oasc.SolrCore.execute [collection1] webapp=/e_t path=/get params={sync=http://127.0.0.1:44824/e_t/collection1/&getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=4
[junit4:junit4] 2> 804538 T2217 oasc.SyncStrategy.syncToMe http://127.0.0.1:44824/e_t/collection1/: sync completed with http://127.0.0.1:47823/e_t/collection1/
[junit4:junit4] 2> 804539 T2216 C3027 P44824 oasc.SolrCore.execute [collection1] webapp=/e_t path=/get params={distrib=false&getUpdates=1438545741603667968,1438545741590036480&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 804541 T2230 C3029 P56367 oasup.LogUpdateProcessor.finish [collection1] {add=[2 (1438545741590036480), 3 (1438545741603667968)]} 0 2
[junit4:junit4] 2> 804542 T2230 C3029 P56367 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:56367/e_t DONE. sync succeeded
[junit4:junit4] 2> 804542 T2230 C3029 P56367 oasc.SolrCore.execute [collection1] webapp=/e_t path=/get params={sync=http://127.0.0.1:44824/e_t/collection1/&getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=9
[junit4:junit4] 2> 804542 T2217 oasc.SyncStrategy.syncToMe http://127.0.0.1:44824/e_t/collection1/: sync completed with http://127.0.0.1:56367/e_t/collection1/
[junit4:junit4] 2> 804542 T2217 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={shard=shard1&action=REQUESTSYNCSHARD&core=collection1&collection=collection1&wt=javabin&version=2} status=0 QTime=15
[junit4:junit4] 2> 804543 T2250 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/collections params={shard=shard1&action=SYNCSHARD&collection=collection1&wt=javabin&version=2} status=0 QTime=19
[junit4:junit4] 2> 804543 T2179 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 2> 804543 T2179 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 2> 804544 T2179 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 804545 T2179 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> 804547 T2196 C3028 P58087 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 804575 T2196 C3028 P58087 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/control/data/index,segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/control/data/index,segFN=segments_4,generation=4}
[junit4:junit4] 2> 804576 T2196 C3028 P58087 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4:junit4] 2> 804577 T2196 C3028 P58087 oass.SolrIndexSearcher.<init> Opening Searcher@47ad06a6 main
[junit4:junit4] 2> 804577 T2196 C3028 P58087 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 804578 T2205 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@47ad06a6 main{StandardDirectoryReader(segments_3:3:nrt _0(4.4):c4)}
[junit4:junit4] 2> 804579 T2196 C3028 P58087 oasup.LogUpdateProcessor.finish [collection1] webapp=/e_t path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 32
[junit4:junit4] 2> 804581 T2233 C3029 P56367 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:44824/e_t/collection1/, StdNode: http://127.0.0.1:56367/e_t/collection1/, StdNode: http://127.0.0.1:39874/e_t/collection1/, StdNode: http://127.0.0.1:47823/e_t/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 804584 T2264 C3026 P47823 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 804584 T2249 C3030 P39874 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 804584 T2214 C3027 P44824 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 804586 T2231 C3029 P56367 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> ASYNC NEW_CORE C3031 name=collection1 org.apache.solr.core.SolrCore@1196c7b6 url=http://127.0.0.1:39874/e_t/collection1 node=127.0.0.1:39874_e_t C3031_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:39874_e_t, base_url=http://127.0.0.1:39874/e_t}
[junit4:junit4] 2> 804605 T2249 C3031 P39874 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty3/index,segFN=segments_5,generation=5}
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty3/index,segFN=segments_6,generation=6}
[junit4:junit4] 2> 804605 T2249 C3031 P39874 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 6
[junit4:junit4] 2> ASYNC NEW_CORE C3032 name=collection1 org.apache.solr.core.SolrCore@7e463875 url=http://127.0.0.1:44824/e_t/collection1 node=127.0.0.1:44824_e_t C3032_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:44824_e_t, base_url=http://127.0.0.1:44824/e_t, leader=true}
[junit4:junit4] 2> 804605 T2214 C3032 P44824 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=5
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty1/index,segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty1/index,segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty1/index,segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty1/index,segFN=segments_6,generation=6}
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371904103236/jetty1/index,segFN=segments_7,generation=7}
[junit4:junit4] 2> 804606 T2214 C3032 P44824 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 7
[junit4:junit4] 2> 804606 T2249 C3031 P39874 oass.SolrIndexSearcher.<init> Opening Searcher@5f440211 main
[junit4:junit4] 2> 804607 T2249 C3031 P39874 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 804607 T2214 C3032 P44824 oass.SolrIndexSearcher.<init> Opening Searcher@1a055558 main
[junit4:junit4] 2> 804608 T2214 C3032 P44824 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 804608 T2256 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5f440211 main{StandardDirectoryReader(segments_5:3:nrt _0(4.4):c4)}
[junit4:junit4] 2> 804609 T2223 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1a055558 main{StandardDirectoryReader(segments_6:3:nrt _0(4.4):c4)}
[junit4:junit4] 2> 804609 T2249 C3031 P39874 oasup.LogUpdateProcessor.finish [collection1] webapp=/e_t path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 26
[junit4:junit4] 2> 804609 T2214 C3032 P44824 oasup.LogUpdateProcessor.finish [collection1] webapp=/e_t path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 26
[junit4:junit4] 2> ASYNC NEW_CORE C3033 name=collection1 org.apache.solr.core.SolrCore@dbadbae url=http://127.0.0.1:47823/e_t/collection1 node=127.0.0.1:47823_e_t C3033_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:47823_e_t, base_url=http://127.0.0.1:47823/e_t}
[junit4:junit4] 2> 804615 T2264 C3033 P47823 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=/mnt
[...truncated too long message...]
[junit4:junit4] 1> /solr/live_nodes/127.0.0.1:44824_e_t (0)
[junit4:junit4] 1> /solr/live_nodes/127.0.0.1:58087_e_t (0)
[junit4:junit4] 1> /solr/live_nodes/127.0.0.1:47823_e_t (0)
[junit4:junit4] 1> /solr/live_nodes/127.0.0.1:39874_e_t (0)
[junit4:junit4] 1> /solr/overseer (3)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1>
[junit4:junit4] 1> /solr/overseer/queue (0)
[junit4:junit4] 1> /solr/overseer/queue-work (0)
[junit4:junit4] 1> /solr/overseer/collection-queue-work (0)
[junit4:junit4] 1> /solr/collections (2)
[junit4:junit4] 1> /solr/collections/collection1 (3)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {"configName":"conf1"}
[junit4:junit4] 1> /solr/collections/collection1/shards (0)
[junit4:junit4] 1> /solr/collections/collection1/leader_elect (1)
[junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard1 (1)
[junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard1/election (3)
[junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard1/election/89909107309871114-127.0.0.1:39874_e_t_collection1-n_0000000005 (0)
[junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard1/election/89909107309871118-127.0.0.1:44824_e_t_collection1-n_0000000004 (0)
[junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard1/election/89909107309871116-127.0.0.1:47823_e_t_collection1-n_0000000003 (0)
[junit4:junit4] 1> /solr/collections/collection1/leaders (1)
[junit4:junit4] 1> /solr/collections/collection1/leaders/shard1 (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "node_name":"127.0.0.1:47823_e_t",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:47823/e_t"}
[junit4:junit4] 1> /solr/collections/control_collection (3)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {"configName":"conf1"}
[junit4:junit4] 1> /solr/collections/control_collection/shards (0)
[junit4:junit4] 1> /solr/collections/control_collection/leader_elect (1)
[junit4:junit4] 1> /solr/collections/control_collection/leader_elect/shard1 (1)
[junit4:junit4] 1> /solr/collections/control_collection/leader_elect/shard1/election (1)
[junit4:junit4] 1> /solr/collections/control_collection/leader_elect/shard1/election/89909107309871107-127.0.0.1:58087_e_t_collection1-n_0000000000 (0)
[junit4:junit4] 1> /solr/collections/control_collection/leaders (1)
[junit4:junit4] 1> /solr/collections/control_collection/leaders/shard1 (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "node_name":"127.0.0.1:58087_e_t",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:58087/e_t"}
[junit4:junit4] 1> /solr/overseer_elect (2)
[junit4:junit4] 1> /solr/overseer_elect/election (4)
[junit4:junit4] 1> /solr/overseer_elect/election/89909107309871114-127.0.0.1:39874_e_t-n_0000000003 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89909107309871118-127.0.0.1:44824_e_t-n_0000000005 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89909107309871116-127.0.0.1:47823_e_t-n_0000000004 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89909107309871107-127.0.0.1:58087_e_t-n_0000000000 (0)
[junit4:junit4] 1> /solr/overseer_elect/leader (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {"id":"89909107309871107-127.0.0.1:58087_e_t-n_0000000000"}
[junit4:junit4] 1> /zookeeper (1)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1>
[junit4:junit4] 1>
[junit4:junit4] 2> 882001 T2254 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 882012 T2254 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 882012 T2254 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=SyncSliceTest -Dtests.method=testDistribSearch -Dtests.seed=BC174470A104C5EC -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=is_IS -Dtests.timezone=America/Halifax -Dtests.file.encoding=UTF-8
[junit4:junit4] FAILURE 101s J0 | SyncSliceTest.testDistribSearch <<<
[junit4:junit4] > Throwable #1: java.lang.AssertionError: shard1 is not consistent. Got 305 from http://127.0.0.1:44824/e_t/collection1lastClient and got 249 from http://127.0.0.1:39874/e_t/collection1
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([BC174470A104C5EC:3DF1CA68D65BA5D0]:0)
[junit4:junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1018)
[junit4:junit4] > at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:238)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:724)
[junit4:junit4] 2> 882012 T2179 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 101137 T2178 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 2 leaked thread(s).
[junit4:junit4] 2> 883089 T2271 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 883089 T2271 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 883089 T2271 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> NOTE: test params are: codec=Lucene42: {range_facet_l=Pulsing41(freqCutoff=6 minBlockSize=83 maxBlockSize=179), text=MockFixedIntBlock(blockSize=347), _version_=PostingsFormat(name=Direct), rnd_b=PostingsFormat(name=TestBloomFilteredLucene41Postings), intDefault=PostingsFormat(name=Direct), timestamp=Pulsing41(freqCutoff=6 minBlockSize=83 maxBlockSize=179), id=PostingsFormat(name=TestBloomFilteredLucene41Postings), a_t=Pulsing41(freqCutoff=6 minBlockSize=83 maxBlockSize=179), range_facet_sl=PostingsFormat(name=TestBloomFilteredLucene41Postings), range_facet_si=Pulsing41(freqCutoff=6 minBlockSize=83 maxBlockSize=179), other_tl1=PostingsFormat(name=Direct), multiDefault=Pulsing41(freqCutoff=6 minBlockSize=83 maxBlockSize=179), a_si=PostingsFormat(name=Direct)}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=false,coord=crazy): {}, locale=is_IS, timezone=America/Halifax
[junit4:junit4] 2> NOTE: Linux 3.2.0-48-generic amd64/Oracle Corporation 1.7.0_25 (64-bit)/cpus=8,threads=1,free=305432760,total=518979584
[junit4:junit4] 2> NOTE: All tests run in this JVM: [TestReversedWildcardFilterFactory, TestRemoteStreaming, TestLFUCache, TestSolrXmlPersistence, TermVectorComponentTest, TestQuerySenderListener, TestPseudoReturnFields, TestJoin, TestClassNameShortening, AnalysisAfterCoreReloadTest, SliceStateUpdateTest, PreAnalyzedFieldTest, SuggesterTest, TestDocSet, DateFieldTest, IndexSchemaTest, MoreLikeThisHandlerTest, TestQueryUtils, TestReloadAndDeleteDocs, SpellingQueryConverterTest, FastVectorHighlighterTest, TestPerFieldSimilarity, OverseerCollectionProcessorTest, ClusterStateUpdateTest, SpatialFilterTest, TestRandomDVFaceting, PeerSyncTest, SolrIndexSplitterTest, TestDocumentBuilder, QueryEqualityTest, TestFastLRUCache, QueryElevationComponentTest, UnloadDistributedZkTest, TestFieldCollectionResource, DocumentBuilderTest, TestPropInjectDefaults, DocValuesTest, OverseerTest, BasicFunctionalityTest, BadCopyFieldTest, LegacyHTMLStripCharFilterTest, SOLR749Test, TestGroupingSearch, TestSolrDeletionPolicy2, ResourceLoaderTest, MinimalSchemaTest, TestLRUCache, TestSolrDeletionPolicy1, ExternalFileFieldSortTest, TestFunctionQuery, PrimUtilsTest, FileBasedSpellCheckerTest, SoftAutoCommitTest, DistributedTermsComponentTest, TestSerializedLuceneMatchVersion, TestSolrQueryParser, TestSweetSpotSimilarityFactory, TestSolrCoreProperties, TestFaceting, AliasIntegrationTest, TestIBSimilarityFactory, TestSolrIndexConfig, StatelessScriptUpdateProcessorFactoryTest, ShardSplitTest, TestBadConfig, PluginInfoTest, TestCloudManagedSchema, TestSchemaVersionResource, UpdateRequestProcessorFactoryTest, TestLMDirichletSimilarityFactory, ShardRoutingTest, SyncSliceTest]
[junit4:junit4] Completed on J0 in 102.48s, 1 test, 1 failure <<< FAILURES!
[...truncated 443 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:392: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:372: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:181: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:437: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1246: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:890: There were test failures: 298 suites, 1256 tests, 1 failure, 13 ignored (7 assumptions)
Total time: 37 minutes 23 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0_25 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-4.x-Linux (32bit/jdk1.8.0-ea-b93) - Build #
6184 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/6184/
Java: 32bit/jdk1.8.0-ea-b93 -server -XX:+UseG1GC
1 tests failed.
FAILED: org.apache.solr.cloud.SyncSliceTest.testDistribSearch
Error Message:
shard1 is not consistent. Got 305 from http://127.0.0.1:43073/ebg/lc/collection1lastClient and got 246 from http://127.0.0.1:52252/ebg/lc/collection1
Stack Trace:
java.lang.AssertionError: shard1 is not consistent. Got 305 from http://127.0.0.1:43073/ebg/lc/collection1lastClient and got 246 from http://127.0.0.1:52252/ebg/lc/collection1
at __randomizedtesting.SeedInfo.seed([FD6B0656D09C0FB9:7C8D884EA7C36F85]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1018)
at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:238)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:491)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:724)
Build Log:
[...truncated 9500 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.SyncSliceTest
[junit4:junit4] 2> 365409 T1514 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /ebg/lc
[junit4:junit4] 2> 365413 T1514 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-SyncSliceTest-1371908984250
[junit4:junit4] 2> 365414 T1514 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 365414 T1515 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 365514 T1514 oasc.ZkTestServer.run start zk server on port:33456
[junit4:junit4] 2> 365515 T1514 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 365606 T1521 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1a24510 name:ZooKeeperConnection Watcher:127.0.0.1:33456 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 365606 T1514 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 365606 T1514 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 365611 T1514 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 365613 T1523 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@165b654 name:ZooKeeperConnection Watcher:127.0.0.1:33456/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 365613 T1514 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 365613 T1514 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 365616 T1514 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 365619 T1514 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 365621 T1514 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 365623 T1514 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 365624 T1514 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 365627 T1514 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 365628 T1514 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 365631 T1514 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 365631 T1514 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 365634 T1514 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 365634 T1514 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 365636 T1514 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 365637 T1514 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 365639 T1514 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 365640 T1514 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 365642 T1514 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 365642 T1514 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 365645 T1514 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 365646 T1514 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 365648 T1514 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 365649 T1514 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 365751 T1514 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 365756 T1514 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50855
[junit4:junit4] 2> 365757 T1514 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 365757 T1514 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 365758 T1514 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1371908984488
[junit4:junit4] 2> 365758 T1514 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1371908984488/solr.xml
[junit4:junit4] 2> 365758 T1514 oasc.CoreContainer.<init> New CoreContainer 28260414
[junit4:junit4] 2> 365759 T1514 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1371908984488/'
[junit4:junit4] 2> 365759 T1514 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1371908984488/'
[junit4:junit4] 2> 365829 T1514 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 365829 T1514 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 365830 T1514 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 365830 T1514 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 365831 T1514 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 365831 T1514 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 365831 T1514 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 365832 T1514 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 365832 T1514 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 365833 T1514 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 365836 T1514 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 365836 T1514 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:33456/solr
[junit4:junit4] 2> 365837 T1514 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 365838 T1514 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 365840 T1534 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@78d3e6 name:ZooKeeperConnection Watcher:127.0.0.1:33456 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 365840 T1514 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 365842 T1514 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 365846 T1514 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 365847 T1536 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@85a932 name:ZooKeeperConnection Watcher:127.0.0.1:33456/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 365847 T1514 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 365849 T1514 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 365852 T1514 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 365855 T1514 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 365857 T1514 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50855_ebg%2Flc
[junit4:junit4] 2> 365858 T1514 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50855_ebg%2Flc
[junit4:junit4] 2> 365861 T1514 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 365867 T1514 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 365869 T1514 oasc.Overseer.start Overseer (id=89909427191939075-127.0.0.1:50855_ebg%2Flc-n_0000000000) starting
[junit4:junit4] 2> 365872 T1514 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 365876 T1538 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 365876 T1514 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 365879 T1514 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 365880 T1514 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 365883 T1537 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 365886 T1539 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 365886 T1539 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 367387 T1537 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 367387 T1537 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "node_name":"127.0.0.1:50855_ebg%2Flc",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:50855/ebg/lc",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "core_node_name":null}
[junit4:junit4] 2> 367387 T1537 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 367388 T1537 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 367391 T1536 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 367887 T1539 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1371908984488/collection1
[junit4:junit4] 2> 367887 T1539 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 367888 T1539 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 367888 T1539 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 367889 T1539 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1371908984488/collection1/'
[junit4:junit4] 2> 367890 T1539 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1371908984488/collection1/lib/README' to classloader
[junit4:junit4] 2> 367890 T1539 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1371908984488/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 367923 T1539 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 367965 T1539 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 367967 T1539 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 367971 T1539 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 368348 T1539 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4:junit4] 2> 368348 T1539 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4:junit4] 2> 368349 T1539 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 368354 T1539 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 368356 T1539 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 368368 T1539 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 368370 T1539 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 368373 T1539 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 368374 T1539 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 368374 T1539 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 368374 T1539 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 368375 T1539 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 368375 T1539 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 368376 T1539 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 368376 T1539 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1371908984488/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1371908984249/control/data/
[junit4:junit4] 2> 368376 T1539 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@147c2e4
[junit4:junit4] 2> 368376 T1539 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 368377 T1539 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/control/data
[junit4:junit4] 2> 368377 T1539 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1371908984249/control/data/index/
[junit4:junit4] 2> 368377 T1539 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1371908984249/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 368377 T1539 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/control/data/index
[junit4:junit4] 2> 368381 T1539 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1c33b7f; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 368381 T1539 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 368383 T1539 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 368383 T1539 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 368384 T1539 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 368384 T1539 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 368384 T1539 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 368384 T1539 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 368385 T1539 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 368385 T1539 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 368385 T1539 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 368387 T1539 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 368389 T1539 oass.SolrIndexSearcher.<init> Opening Searcher@1140399 main
[junit4:junit4] 2> 368390 T1539 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 368390 T1539 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 368393 T1540 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1140399 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 368395 T1539 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 368395 T1539 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:50855/ebg/lc collection:control_collection shard:shard1
[junit4:junit4] 2> 368396 T1539 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 368402 T1539 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 368404 T1539 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 368405 T1539 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 368405 T1539 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:50855/ebg/lc/collection1/
[junit4:junit4] 2> 368405 T1539 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 368405 T1539 oasc.SyncStrategy.syncToMe http://127.0.0.1:50855/ebg/lc/collection1/ has no replicas
[junit4:junit4] 2> 368406 T1539 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:50855/ebg/lc/collection1/
[junit4:junit4] 2> 368406 T1539 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 368894 T1537 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 368901 T1536 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 368913 T1539 oasc.ZkController.register We are http://127.0.0.1:50855/ebg/lc/collection1/ and leader is http://127.0.0.1:50855/ebg/lc/collection1/
[junit4:junit4] 2> 368913 T1539 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:50855/ebg/lc
[junit4:junit4] 2> 368914 T1539 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 368914 T1539 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 368914 T1539 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 368916 T1539 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 368916 T1514 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 368917 T1514 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 368917 T1514 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 368920 T1514 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 368921 T1514 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 368922 T1543 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@cac12 name:ZooKeeperConnection Watcher:127.0.0.1:33456/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 368923 T1514 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 368924 T1514 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 368926 T1514 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 368994 T1514 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 368996 T1514 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:43073
[junit4:junit4] 2> 368996 T1514 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 368997 T1514 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 368997 T1514 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1371908987762
[junit4:junit4] 2> 368997 T1514 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1371908987762/solr.xml
[junit4:junit4] 2> 368998 T1514 oasc.CoreContainer.<init> New CoreContainer 33065911
[junit4:junit4] 2> 368998 T1514 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1371908987762/'
[junit4:junit4] 2> 368998 T1514 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1371908987762/'
[junit4:junit4] 2> 369043 T1514 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 369044 T1514 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 369044 T1514 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 369044 T1514 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 369045 T1514 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 369045 T1514 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 369045 T1514 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 369045 T1514 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 369046 T1514 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 369046 T1514 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 369049 T1514 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 369049 T1514 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:33456/solr
[junit4:junit4] 2> 369050 T1514 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 369050 T1514 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 369052 T1554 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7690 name:ZooKeeperConnection Watcher:127.0.0.1:33456 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 369052 T1514 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 369054 T1514 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 369057 T1514 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 369058 T1556 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7193f1 name:ZooKeeperConnection Watcher:127.0.0.1:33456/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 369058 T1514 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 369062 T1514 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 370064 T1514 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43073_ebg%2Flc
[junit4:junit4] 2> 370066 T1514 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:43073_ebg%2Flc
[junit4:junit4] 2> 370068 T1536 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 370068 T1543 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 370068 T1556 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 370070 T1536 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 370074 T1557 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 370075 T1557 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 370406 T1537 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 370407 T1537 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "node_name":"127.0.0.1:50855_ebg%2Flc",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:50855/ebg/lc",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:50855_ebg%2Flc_collection1"}
[junit4:junit4] 2> 370411 T1537 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "node_name":"127.0.0.1:43073_ebg%2Flc",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:43073/ebg/lc",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "core_node_name":null}
[junit4:junit4] 2> 370412 T1537 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 1
[junit4:junit4] 2> 370412 T1537 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 370417 T1536 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 370417 T1543 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 370417 T1556 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 371076 T1557 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1371908987762/collection1
[junit4:junit4] 2> 371076 T1557 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 371077 T1557 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 371077 T1557 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 371078 T1557 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1371908987762/collection1/'
[junit4:junit4] 2> 371079 T1557 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty1-1371908987762/collection1/lib/README' to classloader
[junit4:junit4] 2> 371079 T1557 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty1-1371908987762/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 371106 T1557 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 371138 T1557 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 371139 T1557 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 371143 T1557 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 371505 T1557 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4:junit4] 2> 371505 T1557 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4:junit4] 2> 371505 T1557 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 371511 T1557 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 371513 T1557 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 371525 T1557 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 371528 T1557 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 371531 T1557 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 371532 T1557 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 371532 T1557 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 371532 T1557 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 371534 T1557 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 371534 T1557 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 371534 T1557 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 371534 T1557 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1371908987762/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty1/
[junit4:junit4] 2> 371534 T1557 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@147c2e4
[junit4:junit4] 2> 371535 T1557 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 371535 T1557 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty1
[junit4:junit4] 2> 371535 T1557 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty1/index/
[junit4:junit4] 2> 371536 T1557 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 371536 T1557 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty1/index
[junit4:junit4] 2> 371539 T1557 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1dceeb7; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 371539 T1557 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 371541 T1557 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 371542 T1557 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 371542 T1557 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 371543 T1557 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 371544 T1557 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 371544 T1557 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 371545 T1557 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 371545 T1557 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 371546 T1557 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 371548 T1557 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 371551 T1557 oass.SolrIndexSearcher.<init> Opening Searcher@1ff2e6e main
[junit4:junit4] 2> 371552 T1557 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 371552 T1557 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 371556 T1558 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1ff2e6e main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 371558 T1557 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 371558 T1557 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:43073/ebg/lc collection:collection1 shard:shard1
[junit4:junit4] 2> 371559 T1557 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 371565 T1557 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 371569 T1557 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 371569 T1557 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 371569 T1557 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:43073/ebg/lc/collection1/
[junit4:junit4] 2> 371569 T1557 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 371570 T1557 oasc.SyncStrategy.syncToMe http://127.0.0.1:43073/ebg/lc/collection1/ has no replicas
[junit4:junit4] 2> 371570 T1557 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:43073/ebg/lc/collection1/
[junit4:junit4] 2> 371570 T1557 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 371923 T1537 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 371931 T1536 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 371931 T1543 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 371931 T1556 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 371977 T1557 oasc.ZkController.register We are http://127.0.0.1:43073/ebg/lc/collection1/ and leader is http://127.0.0.1:43073/ebg/lc/collection1/
[junit4:junit4] 2> 371977 T1557 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:43073/ebg/lc
[junit4:junit4] 2> 371977 T1557 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 371978 T1557 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 371978 T1557 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 371979 T1557 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 371980 T1514 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 371981 T1514 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 371981 T1514 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 372054 T1514 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 372056 T1514 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:59164
[junit4:junit4] 2> 372056 T1514 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 372057 T1514 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 372057 T1514 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1371908990820
[junit4:junit4] 2> 372057 T1514 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1371908990820/solr.xml
[junit4:junit4] 2> 372058 T1514 oasc.CoreContainer.<init> New CoreContainer 3423626
[junit4:junit4] 2> 372058 T1514 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1371908990820/'
[junit4:junit4] 2> 372058 T1514 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1371908990820/'
[junit4:junit4] 2> 372102 T1514 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 372103 T1514 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 372103 T1514 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 372103 T1514 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 372104 T1514 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 372104 T1514 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 372104 T1514 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 372105 T1514 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 372105 T1514 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 372105 T1514 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 372108 T1514 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 372109 T1514 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:33456/solr
[junit4:junit4] 2> 372109 T1514 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 372110 T1514 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 372112 T1570 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b4fb2 name:ZooKeeperConnection Watcher:127.0.0.1:33456 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 372112 T1514 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 372115 T1514 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 372118 T1514 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 372120 T1572 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@17cd583 name:ZooKeeperConnection Watcher:127.0.0.1:33456/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 372120 T1514 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 372124 T1514 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 373127 T1514 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59164_ebg%2Flc
[junit4:junit4] 2> 373128 T1514 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59164_ebg%2Flc
[junit4:junit4] 2> 373131 T1543 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 373132 T1556 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 373132 T1556 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 373132 T1536 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 373132 T1536 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 373133 T1543 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 373134 T1572 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 373139 T1573 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 373139 T1573 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 373436 T1537 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 373437 T1537 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "node_name":"127.0.0.1:43073_ebg%2Flc",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:43073/ebg/lc",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:43073_ebg%2Flc_collection1"}
[junit4:junit4] 2> 373440 T1537 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "node_name":"127.0.0.1:59164_ebg%2Flc",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:59164/ebg/lc",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "core_node_name":null}
[junit4:junit4] 2> 373441 T1537 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 373441 T1537 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 373445 T1556 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 373445 T1572 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 373445 T1536 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 373445 T1543 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 374140 T1573 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1371908990820/collection1
[junit4:junit4] 2> 374141 T1573 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 374141 T1573 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 374142 T1573 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 374143 T1573 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1371908990820/collection1/'
[junit4:junit4] 2> 374144 T1573 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty2-1371908990820/collection1/lib/README' to classloader
[junit4:junit4] 2> 374144 T1573 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty2-1371908990820/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 374173 T1573 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 374206 T1573 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 374208 T1573 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 374211 T1573 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 374604 T1573 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4:junit4] 2> 374604 T1573 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4:junit4] 2> 374605 T1573 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 374612 T1573 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 374614 T1573 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 374627 T1573 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 374631 T1573 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 374635 T1573 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 374636 T1573 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 374637 T1573 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 374637 T1573 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 374638 T1573 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 374638 T1573 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 374639 T1573 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 374639 T1573 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1371908990820/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty2/
[junit4:junit4] 2> 374639 T1573 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@147c2e4
[junit4:junit4] 2> 374640 T1573 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 374640 T1573 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty2
[junit4:junit4] 2> 374640 T1573 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty2/index/
[junit4:junit4] 2> 374641 T1573 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 374641 T1573 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty2/index
[junit4:junit4] 2> 374645 T1573 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@32e520; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 374645 T1573 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 374648 T1573 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 374648 T1573 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 374649 T1573 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 374649 T1573 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 374650 T1573 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 374650 T1573 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 374651 T1573 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 374651 T1573 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 374652 T1573 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 374654 T1573 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 374658 T1573 oass.SolrIndexSearcher.<init> Opening Searcher@109bd51 main
[junit4:junit4] 2> 374659 T1573 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 374659 T1573 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 374663 T1574 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@109bd51 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 374665 T1573 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 374665 T1573 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:59164/ebg/lc collection:collection1 shard:shard1
[junit4:junit4] 2> 374668 T1573 oasc.ZkController.register We are http://127.0.0.1:59164/ebg/lc/collection1/ and leader is http://127.0.0.1:43073/ebg/lc/collection1/
[junit4:junit4] 2> 374668 T1573 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:59164/ebg/lc
[junit4:junit4] 2> 374668 T1573 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 374668 T1573 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C971 name=collection1 org.apache.solr.core.SolrCore@178a900 url=http://127.0.0.1:59164/ebg/lc/collection1 node=127.0.0.1:59164_ebg%2Flc C971_STATE=coll:collection1 core:collection1 props:{collection=collection1, node_name=127.0.0.1:59164_ebg%2Flc, core=collection1, state=down, base_url=http://127.0.0.1:59164/ebg/lc}
[junit4:junit4] 2> 374669 T1575 C971 P59164 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 374669 T1573 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 374669 T1575 C971 P59164 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 374670 T1575 C971 P59164 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 374670 T1575 C971 P59164 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 374670 T1514 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 374671 T1514 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 374671 T1575 C971 P59164 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 374671 T1514 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 374677 T1550 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:59164_ebg%2Flc_collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 374743 T1514 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 374745 T1514 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52252
[junit4:junit4] 2> 374745 T1514 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 374745 T1514 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 374746 T1514 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1371908993511
[junit4:junit4] 2> 374746 T1514 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1371908993511/solr.xml
[junit4:junit4] 2> 374746 T1514 oasc.CoreContainer.<init> New CoreContainer 5709614
[junit4:junit4] 2> 374747 T1514 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1371908993511/'
[junit4:junit4] 2> 374747 T1514 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1371908993511/'
[junit4:junit4] 2> 374789 T1514 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 374789 T1514 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 374790 T1514 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 374790 T1514 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 374790 T1514 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 374791 T1514 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 374791 T1514 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 374791 T1514 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 374791 T1514 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 374792 T1514 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 374795 T1514 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 374796 T1514 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:33456/solr
[junit4:junit4] 2> 374796 T1514 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 374797 T1514 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 374799 T1587 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@9d39bb name:ZooKeeperConnection Watcher:127.0.0.1:33456 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 374799 T1514 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 374801 T1514 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 374804 T1514 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 374806 T1589 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ddcb13 name:ZooKeeperConnection Watcher:127.0.0.1:33456/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 374806 T1514 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 374810 T1514 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 374951 T1537 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 374952 T1537 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "node_name":"127.0.0.1:59164_ebg%2Flc",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:59164/ebg/lc",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:59164_ebg%2Flc_collection1"}
[junit4:junit4] 2> 374955 T1536 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 374956 T1572 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 374956 T1543 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 374955 T1589 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 374956 T1556 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 375678 T1550 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:59164_ebg%2Flc_collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 375678 T1550 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={version=2&onlyIfLeader=true&nodeName=127.0.0.1:59164_ebg%252Flc&core=collection1&action=PREPRECOVERY&coreNodeName=127.0.0.1:59164_ebg%252Flc_collection1&state=recovering&wt=javabin&checkLive=true} status=0 QTime=1001
[junit4:junit4] 2> 375814 T1514 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52252_ebg%2Flc
[junit4:junit4] 2> 375815 T1514 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52252_ebg%2Flc
[junit4:junit4] 2> 375817 T1543 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 375817 T1572 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 375817 T1556 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 375818 T1572 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 375817 T1536 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 375818 T1589 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 375818 T1556 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 375818 T1589 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 375818 T1536 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 375819 T1543 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 375825 T1590 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 375825 T1590 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 376461 T1537 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 376462 T1537 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "node_name":"127.0.0.1:52252_ebg%2Flc",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52252/ebg/lc",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "core_node_name":null}
[junit4:junit4] 2> 376462 T1537 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 376463 T1537 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 376468 T1543 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 376468 T1572 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 376468 T1536 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 376468 T1589 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 376468 T1556 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 376827 T1590 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1371908993511/collection1
[junit4:junit4] 2> 376827 T1590 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 376828 T1590 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 376828 T1590 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 376830 T1590 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1371908993511/collection1/'
[junit4:junit4] 2> 376830 T1590 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty3-1371908993511/collection1/lib/README' to classloader
[junit4:junit4] 2> 376830 T1590 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty3-1371908993511/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 376863 T1590 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 376893 T1590 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 376895 T1590 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 376898 T1590 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 377226 T1590 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4:junit4] 2> 377226 T1590 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4:junit4] 2> 377227 T1590 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 377232 T1590 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 377235 T1590 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 377249 T1590 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 377251 T1590 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 377254 T1590 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 377255 T1590 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 377255 T1590 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 377255 T1590 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 377256 T1590 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 377256 T1590 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 377257 T1590 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 377257 T1590 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1371908993511/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty3/
[junit4:junit4] 2> 377257 T1590 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@147c2e4
[junit4:junit4] 2> 377257 T1590 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 377258 T1590 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty3
[junit4:junit4] 2> 377258 T1590 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty3/index/
[junit4:junit4] 2> 377258 T1590 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 377258 T1590 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty3/index
[junit4:junit4] 2> 377261 T1590 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@fc965c; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 377261 T1590 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 377263 T1590 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 377263 T1590 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 377264 T1590 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 377264 T1590 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 377265 T1590 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 377265 T1590 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 377265 T1590 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 377266 T1590 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 377266 T1590 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 377267 T1590 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 377270 T1590 oass.SolrIndexSearcher.<init> Opening Searcher@12dea9f main
[junit4:junit4] 2> 377271 T1590 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 377271 T1590 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 377276 T1591 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@12dea9f main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 377278 T1590 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 377279 T1590 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:52252/ebg/lc collection:collection1 shard:shard1
[junit4:junit4] 2> 377282 T1590 oasc.ZkController.register We are http://127.0.0.1:52252/ebg/lc/collection1/ and leader is http://127.0.0.1:43073/ebg/lc/collection1/
[junit4:junit4] 2> 377282 T1590 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:52252/ebg/lc
[junit4:junit4] 2> 377282 T1590 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 377283 T1590 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C972 name=collection1 org.apache.solr.core.SolrCore@eef1f5 url=http://127.0.0.1:52252/ebg/lc/collection1 node=127.0.0.1:52252_ebg%2Flc C972_STATE=coll:collection1 core:collection1 props:{collection=collection1, node_name=127.0.0.1:52252_ebg%2Flc, core=collection1, state=down, base_url=http://127.0.0.1:52252/ebg/lc}
[junit4:junit4] 2> 377283 T1592 C972 P52252 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 377284 T1592 C972 P52252 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 377284 T1590 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 377284 T1592 C972 P52252 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 377284 T1592 C972 P52252 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 377285 T1514 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 377285 T1514 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 377285 T1592 C972 P52252 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 377286 T1514 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 377290 T1552 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:52252_ebg%2Flc_collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 377403 T1514 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 377405 T1514 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:57495
[junit4:junit4] 2> 377406 T1514 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 377407 T1514 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 377407 T1514 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1371908996125
[junit4:junit4] 2> 377407 T1514 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1371908996125/solr.xml
[junit4:junit4] 2> 377408 T1514 oasc.CoreContainer.<init> New CoreContainer 32642067
[junit4:junit4] 2> 377408 T1514 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1371908996125/'
[junit4:junit4] 2> 377409 T1514 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1371908996125/'
[junit4:junit4] 2> 377468 T1514 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 377469 T1514 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 377469 T1514 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 377470 T1514 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 377470 T1514 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 377470 T1514 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 377471 T1514 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 377471 T1514 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 377471 T1514 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 377472 T1514 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 377475 T1514 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 377476 T1514 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:33456/solr
[junit4:junit4] 2> 377476 T1514 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 377477 T1514 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 377478 T1604 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e4bc79 name:ZooKeeperConnection Watcher:127.0.0.1:33456 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 377479 T1514 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 377480 T1514 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 377483 T1514 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 377486 T1606 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@11d07cb name:ZooKeeperConnection Watcher:127.0.0.1:33456/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 377487 T1514 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 377490 T1514 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> ASYNC NEW_CORE C973 name=collection1 org.apache.solr.core.SolrCore@178a900 url=http://127.0.0.1:59164/ebg/lc/collection1 node=127.0.0.1:59164_ebg%2Flc C973_STATE=coll:collection1 core:collection1 props:{collection=collection1, node_name=127.0.0.1:59164_ebg%2Flc, core=collection1, state=recovering, shard=shard1, base_url=http://127.0.0.1:59164/ebg/lc}
[junit4:junit4] 2> 377679 T1575 C973 P59164 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:43073/ebg/lc/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 377679 T1575 C973 P59164 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:59164/ebg/lc START replicas=[http://127.0.0.1:43073/ebg/lc/collection1/] nUpdates=100
[junit4:junit4] 2> 377680 T1575 C973 P59164 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 377680 T1575 C973 P59164 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 377680 T1575 C973 P59164 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 377680 T1575 C973 P59164 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 377680 T1575 C973 P59164 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 377680 T1575 C973 P59164 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:43073/ebg/lc/collection1/. core=collection1
[junit4:junit4] 2> 377681 T1575 C973 P59164 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C974 name=collection1 org.apache.solr.core.SolrCore@1144034 url=http://127.0.0.1:43073/ebg/lc/collection1 node=127.0.0.1:43073_ebg%2Flc C974_STATE=coll:collection1 core:collection1 props:{collection=collection1, node_name=127.0.0.1:43073_ebg%2Flc, core=collection1, state=active, shard=shard1, base_url=http://127.0.0.1:43073/ebg/lc, leader=true}
[junit4:junit4] 2> 377684 T1549 C974 P43073 oasc.SolrCore.execute [collection1] webapp=/ebg/lc path=/get params={distrib=false&version=2&qt=/get&wt=javabin&getVersions=100} status=0 QTime=0
[junit4:junit4] 2> 377690 T1551 C974 P43073 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 377692 T1551 C974 P43073 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1dceeb7; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 377693 T1551 C974 P43073 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 377705 T1551 C974 P43073 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1dceeb7; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1dceeb7; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> 377705 T1551 C974 P43073 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 377706 T1551 C974 P43073 oass.SolrIndexSearcher.<init> Opening Searcher@11f8365 realtime
[junit4:junit4] 2> 377706 T1551 C974 P43073 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 377706 T1551 C974 P43073 oasup.LogUpdateProcessor.finish [collection1] webapp=/ebg/lc path=/update params={version=2&softCommit=false&openSearcher=false&wt=javabin&commit=true&commit_end_point=true&waitSearcher=true} {commit=} 0 16
[junit4:junit4] 2> 377707 T1575 C973 P59164 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 377707 T1575 C973 P59164 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 377711 T1551 C974 P43073 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 377711 T1551 C974 P43073 oasc.SolrCore.execute [collection1] webapp=/ebg/lc path=/replication params={version=2&command=indexversion&qt=/replication&wt=javabin} status=0 QTime=3
[junit4:junit4] 2> 377712 T1575 C973 P59164 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 377712 T1575 C973 P59164 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 377712 T1575 C973 P59164 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 377714 T1549 C974 P43073 oasc.SolrCore.execute [collection1] webapp=/ebg/lc path=/replication params={version=2&command=filelist&generation=2&qt=/replication&wt=javabin} status=0 QTime=0
[junit4:junit4] 2> 377714 T1575 C973 P59164 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 377715 T1575 C973 P59164 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty2/index.20130622194956551
[junit4:junit4] 2> 377715 T1575 C973 P59164 oash.SnapPuller.fetchLatestIndex Starting download to NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty2/index.20130622194956551 lockFactory=org.apache.lucene.store.NativeFSLockFactory@527368; maxCacheMB=48.0 maxMergeSizeMB=4.0) fullCopy=false
[junit4:junit4] 2> 377718 T1550 C974 P43073 oasc.SolrCore.execute [collection1] webapp=/ebg/lc path=/replication params={checksum=true&file=segments_2&command=filecontent&generation=2&qt=/replication&wt=filestream} status=0 QTime=0
[junit4:junit4] 2> 377719 T1575 C973 P59164 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 377725 T1575 C973 P59164 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 377726 T1575 C973 P59164 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 377727 T1575 C973 P59164 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@32e520; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@32e520; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> 377728 T1575 C973 P59164 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 377728 T1575 C973 P59164 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 377728 T1575 C973 P59164 oass.SolrIndexSearcher.<init> Opening Searcher@1b88331 main
[junit4:junit4] 2> 377729 T1574 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1b88331 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 377729 T1575 C973 P59164 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty2/index.20130622194956551 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty2/index.20130622194956551;done=true>>]
[junit4:junit4] 2> 377730 T1575 C973 P59164 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty2/index.20130622194956551
[junit4:junit4] 2> 377730 T1575 C973 P59164 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty2/index.20130622194956551
[junit4:junit4] 2> 377730 T1575 C973 P59164 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 377730 T1575 C973 P59164 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 377730 T1575 C973 P59164 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 377731 T1575 C973 P59164 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 377733 T1575 C973 P59164 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 377974 T1537 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 377975 T1537 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "node_name":"127.0.0.1:52252_ebg%2Flc",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52252/ebg/lc",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:52252_ebg%2Flc_collection1"}
[junit4:junit4] 2> 377996 T1537 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "node_name":"127.0.0.1:59164_ebg%2Flc",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:59164/ebg/lc",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:59164_ebg%2Flc_collection1"}
[junit4:junit4] 2> 378001 T1536 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 378001 T1556 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 378002 T1606 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 378002 T1543 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 378002 T1572 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 378001 T1589 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 378290 T1552 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:52252_ebg%2Flc_collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 378291 T1552 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={version=2&onlyIfLeader=true&nodeName=127.0.0.1:52252_ebg%252Flc&core=collection1&action=PREPRECOVERY&coreNodeName=127.0.0.1:52252_ebg%252Flc_collection1&state=recovering&wt=javabin&checkLive=true} status=0 QTime=1001
[junit4:junit4] 2> 378493 T1514 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:57495_ebg%2Flc
[junit4:junit4] 2> 378495 T1514 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:57495_ebg%2Flc
[junit4:junit4] 2> 378496 T1589 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 378496 T1606 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 378497 T1556 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 378497 T1543 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 378497 T1536 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 378498 T1572 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 378498 T1572 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 378497 T1543 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 378497 T1556 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 378499 T1589 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 378499 T1606 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 378502 T1536 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 378504 T1609 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 378504 T1609 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 379510 T1537 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 379510 T1537 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "node_name":"127.0.0.1:57495_ebg%2Flc",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "base_url":"http://127.0.0.1:57495/ebg/lc",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "core_node_name":null}
[junit4:junit4] 2> 379510 T1537 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 379511 T1537 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 379514 T1556 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 379514 T1572 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 379515 T1606 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 379515 T1543 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 379514 T1536 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 379514 T1589 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> ASYNC NEW_CORE C975 name=collection1 org.apache.solr.core.SolrCore@eef1f5 url=http://127.0.0.1:52252/ebg/lc/collection1 node=127.0.0.1:52252_ebg%2Flc C975_STATE=coll:collection1 core:collection1 props:{collection=collection1, node_name=127.0.0.1:52252_ebg%2Flc, core=collection1, state=recovering, shard=shard1, base_url=http://127.0.0.1:52252/ebg/lc}
[junit4:junit4] 2> 380292 T1592 C975 P52252 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:43073/ebg/lc/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 380292 T1592 C975 P52252 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:52252/ebg/lc START replicas=[http://127.0.0.1:43073/ebg/lc/collection1/] nUpdates=100
[junit4:junit4] 2> 380292 T1592 C975 P52252 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 380293 T1592 C975 P52252 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 380293 T1592 C975 P52252 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 380293 T1592 C975 P52252 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 380293 T1592 C975 P52252 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 380293 T1592 C975 P52252 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:43073/ebg/lc/collection1/. core=collection1
[junit4:junit4] 2> 380293 T1592 C975 P52252 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 380294 T1552 C974 P43073 oasc.SolrCore.execute [collection1] webapp=/ebg/lc path=/get params={distrib=false&version=2&qt=/get&wt=javabin&getVersions=100} status=0 QTime=0
[junit4:junit4] 2> 380298 T1551 C974 P43073 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 380305 T1551 C974 P43073 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1dceeb7; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1dceeb7; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> 380305 T1551 C974 P43073 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 380306 T1551 C974 P43073 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 380306 T1551 C974 P43073 oasup.LogUpdateProcessor.finish [collection1] webapp=/ebg/lc path=/update params={version=2&softCommit=false&openSearcher=false&wt=javabin&commit=true&commit_end_point=true&waitSearcher=true} {commit=} 0 9
[junit4:junit4] 2> 380307 T1592 C975 P52252 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 380307 T1592 C975 P52252 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 380309 T1552 C974 P43073 oasc.SolrCore.execute [collection1] webapp=/ebg/lc path=/replication params={version=2&command=indexversion&qt=/replication&wt=javabin} status=0 QTime=0
[junit4:junit4] 2> 380309 T1592 C975 P52252 oash.SnapPuller.fetchLatestIndex Master's generation: 3
[junit4:junit4] 2> 380309 T1592 C975 P52252 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 380310 T1592 C975 P52252 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 380311 T1550 C974 P43073 oasc.SolrCore.execute [collection1] webapp=/ebg/lc path=/replication params={version=2&command=filelist&generation=3&qt=/replication&wt=javabin} status=0 QTime=0
[junit4:junit4] 2> 380312 T1592 C975 P52252 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 380313 T1592 C975 P52252 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty3/index.20130622194959148
[junit4:junit4] 2> 380313 T1592 C975 P52252 oash.SnapPuller.fetchLatestIndex Starting download to NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty3/index.20130622194959148 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4a2996; maxCacheMB=48.0 maxMergeSizeMB=4.0) fullCopy=false
[junit4:junit4] 2> 380316 T1551 C974 P43073 oasc.SolrCore.execute [collection1] webapp=/ebg/lc path=/replication params={checksum=true&file=segments_3&command=filecontent&generation=3&qt=/replication&wt=filestream} status=0 QTime=0
[junit4:junit4] 2> 380317 T1592 C975 P52252 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 380319 T1592 C975 P52252 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 380319 T1592 C975 P52252 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 380320 T1592 C975 P52252 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@fc965c; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@fc965c; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> 380321 T1592 C975 P52252 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 380321 T1592 C975 P52252 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 380321 T1592 C975 P52252 oass.SolrIndexSearcher.<init> Opening Searcher@1b835ab main
[junit4:junit4] 2> 380322 T1591 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1b835ab main{StandardDirectoryReader(segments_3:1:nrt)}
[junit4:junit4] 2> 380323 T1592 C975 P52252 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty3/index.20130622194959148 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty3/index.20130622194959148;done=true>>]
[junit4:junit4] 2> 380323 T1592 C975 P52252 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty3/index.20130622194959148
[junit4:junit4] 2> 380323 T1592 C975 P52252 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty3/index.20130622194959148
[junit4:junit4] 2> 380324 T1592 C975 P52252 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 380324 T1592 C975 P52252 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 380324 T1592 C975 P52252 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 380324 T1592 C975 P52252 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 380325 T1592 C975 P52252 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 380506 T1609 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1371908996125/collection1
[junit4:junit4] 2> 380507 T1609 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 380507 T1609 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 380508 T1609 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 380509 T1609 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1371908996125/collection1/'
[junit4:junit4] 2> 380509 T1609 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty4-1371908996125/collection1/lib/README' to classloader
[junit4:junit4] 2> 380510 T1609 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty4-1371908996125/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 380546 T1609 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 380576 T1609 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 380577 T1609 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 380581 T1609 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 380930 T1609 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4:junit4] 2> 380930 T1609 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4:junit4] 2> 380930 T1609 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 380936 T1609 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 380938 T1609 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 380950 T1609 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 380953 T1609 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 380956 T1609 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 380957 T1609 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 380957 T1609 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 380958 T1609 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 380959 T1609 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 380959 T1609 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 380959 T1609 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 380959 T1609 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1371908996125/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty4/
[junit4:junit4] 2> 380959 T1609 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@147c2e4
[junit4:junit4] 2> 380960 T1609 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 380960 T1609 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty4
[junit4:junit4] 2> 380960 T1609 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty4/index/
[junit4:junit4] 2> 380960 T1609 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 380961 T1609 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty4/index
[junit4:junit4] 2> 380976 T1609 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@10bb693; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 380977 T1609 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 380979 T1609 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 380979 T1609 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 380979 T1609 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 380980 T1609 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 380980 T1609 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 380980 T1609 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 380982 T1609 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 380982 T1609 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 380983 T1609 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 380985 T1609 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 380988 T1609 oass.SolrIndexSearcher.<init> Opening Searcher@981dfc main
[junit4:junit4] 2> 380988 T1609 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 380989 T1609 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 380992 T1612 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@981dfc main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 380994 T1609 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 380994 T1609 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:57495/ebg/lc collection:collection1 shard:shard1
[junit4:junit4] 2> 380997 T1609 oasc.ZkController.register We are http://127.0.0.1:57495/ebg/lc/collection1/ and leader is http://127.0.0.1:43073/ebg/lc/collection1/
[junit4:junit4] 2> 380997 T1609 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:57495/ebg/lc
[junit4:junit4] 2> 380997 T1609 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 380997 T1609 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C976 name=collection1 org.apache.solr.core.SolrCore@d20b8d url=http://127.0.0.1:57495/ebg/lc/collection1 node=127.0.0.1:57495_ebg%2Flc C976_STATE=coll:collection1 core:collection1 props:{collection=collection1, node_name=127.0.0.1:57495_ebg%2Flc, core=collection1, state=down, base_url=http://127.0.0.1:57495/ebg/lc}
[junit4:junit4] 2> 380997 T1613 C976 P57495 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 380998 T1613 C976 P57495 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 380998 T1609 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 380998 T1613 C976 P57495 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 380998 T1613 C976 P57495 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 380999 T1514 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 381000 T1514 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 380999 T1613 C976 P57495 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 381000 T1514 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 381004 T1550 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:57495_ebg%2Flc_collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 381004 T1514 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 381006 T1514 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 2> 381006 T1514 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 2> 381007 T1514 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 381018 T1537 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 381019 T1537 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "node_name":"127.0.0.1:52252_ebg%2Flc",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52252/ebg/lc",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:52252_ebg%2Flc_collection1"}
[junit4:junit4] 2> 381022 T1537 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "node_name":"127.0.0.1:57495_ebg%2Flc",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:57495/ebg/lc",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:57495_ebg%2Flc_collection1"}
[junit4:junit4] 2> 381025 T1556 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 381026 T1543 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 381026 T1536 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 381026 T1606 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 381026 T1572 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 381026 T1589 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 382005 T1550 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:57495_ebg%2Flc_collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 382005 T1550 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={version=2&onlyIfLeader=true&nodeName=127.0.0.1:57495_ebg%252Flc&core=collection1&action=PREPRECOVERY&coreNodeName=127.0.0.1:57495_ebg%252Flc_collection1&state=recovering&wt=javabin&checkLive=true} status=0 QTime=1001
[junit4:junit4] 2> 382008 T1514 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 383010 T1514 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C976_STATE=coll:collection1 core:collection1 props:{collection=collection1, node_name=127.0.0.1:57495_ebg%2Flc, core=collection1, state=recovering, shard=shard1, base_url=http://127.0.0.1:57495/ebg/lc}
[junit4:junit4] 2> 384006 T1613 C976 P57495 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:43073/ebg/lc/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 384006 T1613 C976 P57495 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:57495/ebg/lc START replicas=[http://127.0.0.1:43073/ebg/lc/collection1/] nUpdates=100
[junit4:junit4] 2> 384007 T1613 C976 P57495 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 384007 T1613 C976 P57495 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 384007 T1613 C976 P57495 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 384007 T1613 C976 P57495 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 384007 T1613 C976 P57495 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 384008 T1613 C976 P57495 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:43073/ebg/lc/collection1/. core=collection1
[junit4:junit4] 2> 384008 T1613 C976 P57495 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C977 name=collection1 org.apache.solr.core.SolrCore@1144034 url=http://127.0.0.1:43073/ebg/lc/collection1 node=127.0.0.1:43073_ebg%2Flc C977_STATE=coll:collection1 core:collection1 props:{collection=collection1, node_name=127.0.0.1:43073_ebg%2Flc, core=collection1, state=active, shard=shard1, base_url=http://127.0.0.1:43073/ebg/lc, leader=true}
[junit4:junit4] 2> 384009 T1550 C977 P43073 oasc.SolrCore.execute [collection1] webapp=/ebg/lc path=/get params={distrib=false&version=2&qt=/get&wt=javabin&getVersions=100} status=0 QTime=0
[junit4:junit4] 2> 384012 T1514 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 384013 T1552 C977 P43073 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 384025 T1552 C977 P43073 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=3
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1dceeb7; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1dceeb7; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1dceeb7; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> 384025 T1552 C977 P43073 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4:junit4] 2> 384026 T1552 C977 P43073 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 384027 T1552 C977 P43073 oasup.LogUpdateProcessor.finish [collection1] webapp=/ebg/lc path=/update params={version=2&softCommit=false&openSearcher=false&wt=javabin&commit=true&commit_end_point=true&waitSearcher=true} {commit=} 0 15
[junit4:junit4] 2> 384027 T1613 C976 P57495 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 384028 T1613 C976 P57495 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 384030 T1550 C977 P43073 oasc.SolrCore.execute [collection1] webapp=/ebg/lc path=/replication params={version=2&command=indexversion&qt=/replication&wt=javabin} status=0 QTime=0
[junit4:junit4] 2> 384030 T1613 C976 P57495 oash.SnapPuller.fetchLatestIndex Master's generation: 4
[junit4:junit4] 2> 384030 T1613 C976 P57495 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 384031 T1613 C976 P57495 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 384033 T1549 C977 P43073 oasc.SolrCore.execute [collection1] webapp=/ebg/lc path=/replication params={version=2&command=filelist&generation=4&qt=/replication&wt=javabin} status=0 QTime=1
[junit4:junit4] 2> 384033 T1613 C976 P57495 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 384034 T1613 C976 P57495 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty4/index.20130622195002869
[junit4:junit4] 2> 384034 T1613 C976 P57495 oash.SnapPuller.fetchLatestIndex Starting download to NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty4/index.20130622195002869 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1f6c06a; maxCacheMB=48.0 maxMergeSizeMB=4.0) fullCopy=false
[junit4:junit4] 2> 384037 T1552 C977 P43073 oasc.SolrCore.execute [collection1] webapp=/ebg/lc path=/replication params={checksum=true&file=segments_4&command=filecontent&generation=4&qt=/replication&wt=filestream} status=0 QTime=0
[junit4:junit4] 2> 384038 T1613 C976 P57495 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 384040 T1613 C976 P57495 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 384040 T1613 C976 P57495 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 384042 T1613 C976 P57495 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@10bb693; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@10bb693; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> 384043 T1613 C976 P57495 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4:junit4] 2> 384043 T1613 C976 P57495 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 384044 T1613 C976 P57495 oass.SolrIndexSearcher.<init> Opening Searcher@1c7c9f6 main
[junit4:junit4] 2> 384045 T1612 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1c7c9f6 main{StandardDirectoryReader(segments_4:1:nrt)}
[junit4:junit4] 2> 384045 T1613 C976 P57495 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty4/index.20130622195002869 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty4/index.20130622195002869;done=true>>]
[junit4:junit4] 2> 384046 T1613 C976 P57495 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty4/index.20130622195002869
[junit4:junit4] 2> 384046 T1613 C976 P57495 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty4/index.20130622195002869
[junit4:junit4] 2> 384046 T1613 C976 P57495 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 384047 T1613 C976 P57495 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 384047 T1613 C976 P57495 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 384047 T1613 C976 P57495 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 384048 T1613 C976 P57495 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 385014 T1514 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 385539 T1537 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 385540 T1537 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "node_name":"127.0.0.1:57495_ebg%2Flc",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:57495/ebg/lc",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:57495_ebg%2Flc_collection1"}
[junit4:junit4] 2> 385550 T1556 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 385550 T1606 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 385550 T1572 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 385550 T1543 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 385550 T1589 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 385550 T1536 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 386016 T1514 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 386017 T1514 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> ASYNC NEW_CORE C978 name=collection1 org.apache.solr.core.SolrCore@1a7df9f url=http://127.0.0.1:50855/ebg/lc/collection1 node=127.0.0.1:50855_ebg%2Flc C978_STATE=coll:control_collection core:collection1 props:{collection=control_collection, node_name=127.0.0.1:50855_ebg%2Flc, core=collection1, state=active, shard=shard1, base_url=http://127.0.0.1:50855/ebg/lc, leader=true}
[junit4:junit4] 2> 386024 T1532 C978 P50855 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 386027 T1532 C978 P50855 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1c33b7f; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 386028 T1532 C978 P50855 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 386035 T1532 C978 P50855 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1c33b7f; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1c33b7f; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> 386035 T1532 C978 P50855 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 386036 T1532 C978 P50855 oass.SolrIndexSearcher.<init> Opening Searcher@4526e0 main
[junit4:junit4] 2> 386036 T1532 C978 P50855 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 386037 T1540 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4526e0 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 386038 T1532 C978 P50855 oasup.LogUpdateProcessor.finish [collection1] webapp=/ebg/lc path=/update params={version=2&softCommit=false&wt=javabin&commit=true&waitSearcher=true} {commit=} 0 14
[junit4:junit4] 2> C976_STATE=coll:collection1 core:collection1 props:{collection=collection1, node_name=127.0.0.1:57495_ebg%2Flc, core=collection1, state=active, shard=shard1, base_url=http://127.0.0.1:57495/ebg/lc}
[junit4:junit4] 2> 386048 T1600 C976 P57495 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:43073/ebg/lc/collection1/, StdNode: http://127.0.0.1:59164/ebg/lc/collection1/, StdNode: http://127.0.0.1:52252/ebg/lc/collection1/, StdNode: http://127.0.0.1:57495/ebg/lc/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 386053 T1549 C977 P43073 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 386054 T1602 C976 P57495 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> ASYNC NEW_CORE C979 name=collection1 org.apache.solr.core.SolrCore@eef1f5 url=http://127.0.0.1:52252/ebg/lc/collection1 node=127.0.0.1:52252_ebg%2Flc C979_STATE=coll:collection1 core:collection1 props:{collection=collection1, node_name=127.0.0.1:52252_ebg%2Flc, core=collection1, state=active, shard=shard1, base_url=http://127.0.0.1:52252/ebg/lc}
[junit4:junit4] 2> 386059 T1583 C979 P52252 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> ASYNC NEW_CORE C980 name=collection1 org.apache.solr.core.SolrCore@178a900 url=http://127.0.0.1:59164/ebg/lc/collection1 node=127.0.0.1:59164_ebg%2Flc C980_STATE=coll:collection1 core:collection1 props:{collection=collection1, node_name=127.0.0.1:59164_ebg%2Flc, core=collection1, state=active, shard=shard1, base_url=http://127.0.0.1:59164/ebg/lc}
[junit4:junit4] 2> 386060 T1565 C980 P59164 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 386085 T1602 C976 P57495 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@10bb693; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@10bb693; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5}
[junit4:junit4] 2> 386085 T1549 C977 P43073 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=4
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1dceeb7; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1dceeb7; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1dceeb7; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1dceeb7; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5}
[junit4:junit4] 2> 386085 T1602 C976 P57495 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 5
[junit4:junit4] 2> 386086 T1549 C977 P43073 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 5
[junit4:junit4] 2> 386087 T1602 C976 P57495 oass.SolrIndexSearcher.<init> Opening Searcher@3f236b main
[junit4:junit4] 2> 386087 T1549 C977 P43073 oass.SolrIndexSearcher.<init> Opening Searcher@72a35c main
[junit4:junit4] 2> 386087 T1602 C976 P57495 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 386088 T1549 C977 P43073 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 386088 T1558 oasc.JmxMonitoredMap.put WARN Failed to register info bean: searcher javax.management.InstanceAlreadyExistsException: solr/collection1:type=searcher,id=org.apache.solr.search.SolrIndexSearcher
[junit4:junit4] 2> at com.sun.jmx.mbeanserver.Repository.addMBean(Repository.java:437)
[junit4:junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerWithRepository(DefaultMBeanServerInterceptor.java:1898)
[junit4:junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:966)
[junit4:junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)
[junit4:junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)
[junit4:junit4] 2> at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:513)
[junit4:junit4] 2> at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:140)
[junit4:junit4] 2> at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:51)
[junit4:junit4] 2> at org.apache.solr.search.SolrIndexSearcher.register(SolrIndexSearcher.java:298)
[junit4:junit4] 2> at org.apache.solr.core.SolrCore.registerSearcher(SolrCore.java:1846)
[junit4:junit4] 2> at org.apache.solr.core.SolrCore.access$000(SolrCore.java:135)
[junit4:junit4] 2> at org.apache.solr.core.SolrCore$7.call(SolrCore.java:1723)
[junit4:junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:724)
[junit4:junit4] 2>
[junit4:junit4] 2> 386088 T1612 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3f236b main{StandardDirectoryReader(segments_4:1:nrt)}
[junit4:junit4] 2> 386089 T1558 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@72a35c main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 386089 T1602 C976 P57495 oasup.LogUpdateProcessor.finish [collection1] webapp=/ebg/lc path=/update params={version=2&expungeDeletes=false&softCommit=false&wt=javabin&commit=true&commit_end_point=true&waitSearcher=true} {commit=} 0 35
[junit4:junit4] 2> 386090 T1549 C977 P43073 oasup.LogUpdateProcessor.finish [collection1] webapp=/ebg/lc path=/update params={version=2&expungeDeletes=false&softCommit=false&wt=javabin&commit=true&commit_end_point=true&waitSearcher=true} {commit=} 0 37
[junit4:junit4] 2> 386105 T1565 C980 P59164 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@32e520; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@32e520; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> 386105 T1583 C979 P52252 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@fc965c; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@fc965c; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> 386106 T1583 C979 P52252 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4:junit4] 2> 386105 T1565 C980 P59164 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 386107 T1583 C979 P52252 oass.SolrIndexSearcher.<init> Opening Searcher@121217f main
[junit4:junit4] 2> 386107 T1565 C980 P59164 oass.SolrIndexSearcher.<init> Opening Searcher@41962d main
[junit4:junit4] 2> 386108 T1591 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@121217f main{StandardDirectoryReader(segments_3:1:nrt)}
[junit4:junit4] 2> 386107 T1583 C979 P52252 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 386109 T1565 C980 P59164 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 386109 T1574 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@41962d main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 386109 T1583 C979 P52252 oasup.LogUpdateProcessor.finish [collection1] webapp=/ebg/lc path=/update params={version=2&expungeDeletes=false&softCommit=false&wt=javabin&commit=true&commit_end_point=true&waitSearcher=true} {commit=} 0 50
[junit4:junit4] 2> 386110 T1565 C980 P59164 oasup.LogUpdateProcessor.finish [collection1] webapp=/ebg/lc path=/update params={version=2&expungeDeletes=false&softCommit=false&wt=javabin&commit=true&commit_end_point=true&waitSearcher=true} {commit=} 0 50
[junit4:junit4] 2> 386110 T1600 C976 P57495 oasup.LogUpdateProcessor.finish [collection1] webapp=/ebg/lc path=/update params={version=2&softCommit=false&wt=javabin&commit=true&waitSearcher=true} {commit=} 0 62
[junit4:junit4] 2> 386111 T1514 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 386113 T1550 C977 P43073 oasc.SolrCore.execute [collection1] webapp=/ebg/lc path=/select params={distrib=false&version=2&rows=0&tests=checkShardConsistency&q=*:*&wt=javabin} hits=0 status=0 QTime=0
[junit4:junit4] 2> 386115 T1566 C980 P59164 oasc.SolrCore.execute [collection1] webapp=/ebg/lc path=/select params={distrib=false&version=2&rows=0&tests=checkShardConsistency&q=*:*&wt=javabin} hits=0 status=0 QTime=0
[junit4:junit4] 2> 386116 T1584 C979 P52252 oasc.SolrCore.execute [collection1] webapp=/ebg/lc path=/select params={distrib=false&version=2&rows=0&tests=checkShardConsistency&q=*:*&wt=javabin} hits=0 status=0 QTime=0
[junit4:junit4] 2> 386118 T1599 C976 P57495 oasc.SolrCore.execute [collection1] webapp=/ebg/lc path=/select params={distrib=false&version=2&rows=0&tests=checkShardConsistency&q=*:*&wt=javabin} hits=0 status=0 QTime=0
[junit4:junit4] 2> 388121 T1530 C978 P50855 oasup.LogUpdateProcessor.finish [collection1] webapp=/ebg/lc path=/update params={version=2&wt=javabin} {deleteByQuery=*:* (-1438550858878943232)} 0 1
[junit4:junit4] 2> 388129 T1567 C980 P59164 oasup.LogUpdateProcessor.finish [collection1] webapp=/ebg/lc path=/update params={version=2&update.distrib=FROMLEADER&_version_=-1438550858883137536&wt=javabin&update.from=http://127.0.0.1:43073/ebg/lc/collection1/} {deleteByQuery=*:* (-1438550858883137536)} 0 0
[junit4:junit4] 2> 388129 T1582 C979 P52252 oasup.LogUpdateProcessor.finish [collection1] webapp=/ebg/lc path=/update params={version=2&update.distrib=FROMLEADER&_version_=-1438550858883137536&wt=javabin&update.from=http://127.0.0.1:43073/ebg/lc/collection1/} {deleteByQuery=*:* (-1438550858883137536)} 0 0
[junit4:junit4] 2> 388129 T1601 C976 P57495 oasup.LogUpdateProcessor.finish [collection1] webapp=/ebg/lc path=/update params={version=2&update.distrib=FROMLEADER&_version_=-1438550858883137536&wt=javabin&update.from=http://127.0.0.1:43073/ebg/lc/collection1/} {deleteByQuery=*:* (-1438550858883137536)} 0 0
[junit4:junit4] 2> 388131 T1551 C977 P43073 oasup.LogUpdateProcessor.finish [collection1] webapp=/ebg/lc path=/update params={version=2&update.distrib=TOLEADER&wt=javabin} {deleteByQuery=*:* (-1438550858883137536)} 0 6
[junit4:junit4] 2> 388131 T1600 C976 P57495 oasup.LogUpdateProcessor.finish [collection1] webapp=/ebg/lc path=/update params={version=2&wt=javabin} {deleteByQuery=*:*} 0 8
[junit4:junit4] 2> 388135 T1529 C978 P50855 oasup.LogUpdateProcessor.finish [collection1] webapp=/ebg/lc path=/update params={version=2&wt=javabin} {add=[0 (1438550858892574720)]} 0 2
[junit4:junit4] 2> 388145 T1584 C979 P52252 oasup.LogUpdateProcessor.finish [collection1] webapp=/ebg/lc path=/update params={version=2&update.distrib=FROMLEADER&wt=javabin&distrib.from=http://127.0.0.1:43073/ebg/lc/collection1/} {add=[0 (1438550858899914752)]} 0 1
[junit4:junit4] 2> 388145 T1566 C980 P59164 oasup.LogUpdateProcessor.finish [collection1] webapp=/ebg/lc path=/update params={version=2&update.distrib=FROMLEADER&wt=javabin&distrib.from=http://127.0.0.1:43073/ebg/lc/collection1/} {add=[0 (1438550858899914752)]} 0 1
[junit4:junit4] 2> 388145 T1599 C976 P57495 oasup.LogUpdateProcessor.finish [collection1] webapp=/ebg/lc path=/update params={version=2&update.distrib=FROMLEADER&wt=javabin&distrib.from=http://127.0.0.1:43073/ebg/lc/collection1/} {add=[0 (1438550858899914752)]} 0 1
[junit4:junit4] 2> 388146 T1552 C977 P43073 oasup.LogUpdateProcessor.finish [collection1] webapp=/ebg/lc path=/update params={version=2&update.distrib=TOLEADER&wt=javabin&distrib.from=http://127.0.0.1:57495/ebg/lc/collection1/} {add=[0 (1438550858899914752)]} 0 6
[junit4:junit4] 2> 388147 T1602 C976 P57495 oasup.LogUpdateProcessor.finish [collection1] webapp=/ebg/lc path=/update params={version=2&wt=javabin} {add=[0]} 0 10
[junit4:junit4] 2> 388150 T1532 C978 P50855 oasup.LogUpdateProcessor.finish [collection1] webapp=/ebg/lc path=/update params={version=2&wt=javabin} {add=[1 (1438550858908303360)]} 0 1
[junit4:junit4] 2> 388157 T1585 C979 P52252 oasup.LogUpdateProcessor.finish [collection1] webapp=/ebg/lc path=/update params={version=2&update.distrib=FROMLEADER&wt=javabin&distrib.from=http://127.0.0.1:43073/ebg/lc/collection1/} {add=[1 (1438550858912497664)]} 0 1
[junit4:junit4] 2> 388157 T1601 C976 P57495 oasup.LogUpdateProcessor.finish [collection1] webapp=/ebg/lc path=/update params={version=2&update.distrib=FROMLEADER&wt=javabin&distrib.from=http://127.0.0.1:43073/ebg/lc/collection1/} {add=[1 (1438550858912497664)]} 0 1
[junit4:junit4] 2> 388157 T1568 C980 P59164 oasup.LogUpdateProcessor.finish [collection1] webapp=/ebg/lc path=/update params={version=2&update.distrib=FROMLEADER&wt=javabin&distrib.from=http://127.0.0.1:43073/ebg/lc/collection1/} {add=[1 (1438550858912497664)]} 0 1
[junit4:junit4] 2> 388158 T1549 C977 P43073 oasup.LogUpdateProcessor.finish [collection1] webapp=/ebg/lc path=/update params={version=2&update.distrib=TOLEADER&wt=javabin&distrib.from=http://127.0.0.1:59164/ebg/lc/collection1/} {add=[1 (1438550858912497664)]} 0 5
[junit4:junit4] 2> 388158 T1565 C980 P59164 oasup.LogUpdateProcessor.finish [collection1] webapp=/ebg/lc path=/update params={version=2&wt=javabin} {add=[1]} 0 7
[junit4:junit4] 2> 388162 T1531 C978 P50855 oasup.LogUpdateProcessor.finish [collection1] webapp=/ebg/lc path=/update params={version=2&wt=javabin} {add=[2 (1438550858920886272)]} 0 1
[junit4:junit4] 2> 388164 T1551 C977 P43073 oasup.DistributedUpdateProcessor.setupRequest test.distrib.skip.servers was found and contains:[http://127.0.0.1:59164/ebg/lc/collection1/]
[junit4:junit4] 2> 388164 T1551 C977 P43073 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:59164/ebg/lc/collection1/ against:[http://127.0.0.1:59164/ebg/lc/collection1/] result:true
[junit4:junit4] 2> 388164 T1551 C977 P43073 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:52252/ebg/lc/collection1/ against:[http://127.0.0.1:59164/ebg/lc/collection1/] result:false
[junit4:junit4] 2> 388165 T1551 C977 P43073 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:57495/ebg/lc/collection1/ against:[http://127.0.0.1:59164/ebg/lc/collection1/] result:false
[junit4:junit4] 2> 388169 T1600 C976 P57495 oasup.LogUpdateProcessor.finish [collection1] webapp=/ebg/lc path=/update params={version=2&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:59164/ebg/lc/collection1/&wt=javabin&distrib.from=http://127.0.0.1:43073/ebg/lc/collection1/} {add=[2 (1438550858925080576)]} 0 1
[junit4:junit4] 2> 388169 T1583 C979 P52252 oasup.LogUpdateProcessor.finish [collection1] webapp=/ebg/lc path=/update params={version=2&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:59164/ebg/lc/collection1/&wt=javabin&distrib.from=http://127.0.0.1:43073/ebg/lc/collection1/} {add=[2 (1438550858925080576)]} 0 1
[junit4:junit4] 2> 388170 T1551 C977 P43073 oasup.LogUpdateProcessor.finish [collection1] webapp=/ebg/lc path=/update params={version=2&test.distrib.skip.servers=http://127.0.0.1:59164/ebg/lc/collection1/&wt=javabin} {add=[2 (1438550858925080576)]} 0 6
[junit4:junit4] 2> 388173 T1530 C978 P50855 oasup.LogUpdateProcessor.finish [collection1] webapp=/ebg/lc path=/update params={version=2&wt=javabin} {add=[3 (1438550858932420608)]} 0 1
[junit4:junit4] 2> 388176 T1552 C977 P43073 oasup.DistributedUpdateProcessor.setupRequest test.distrib.skip.servers was found and contains:[http://127.0.0.1:59164/ebg/lc/collection1/]
[junit4:junit4] 2> 388177 T1552 C977 P43073 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:59164/ebg/lc/collection1/ against:[http://127.0.0.1:59164/ebg/lc/collection1/] result:true
[junit4:junit4] 2> 388177 T1552 C977 P43073 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:52252/ebg/lc/collection1/ against:[http://127.0.0.1:59164/ebg/lc/collection1/] result:false
[junit4:junit4] 2> 388177 T1552 C977 P43073 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:57495/ebg/lc/collection1/ against:[http://127.0.0.1:59164/ebg/lc/collection1/] result:false
[junit4:junit4] 2> 388181 T1599 C976 P57495 oasup.LogUpdateProcessor.finish [collection1] webapp=/ebg/lc path=/update params={version=2&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:59164/ebg/lc/collection1/&wt=javabin&distrib.from=http://127.0.0.1:43073/ebg/lc/collection1/} {add=[3 (1438550858938712064)]} 0 1
[junit4:junit4] 2> 388181 T1585 C979 P52252 oasup.LogUpdateProcessor.finish [collection1] webapp=/ebg/lc path=/update params={version=2&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:59164/ebg/lc/collection1/&wt=javabin&distrib.from=http://127.0.0.1:43073/ebg/lc/collection1/} {add=[3 (1438550858938712064)]} 0 1
[junit4:junit4] 2> 388182 T1552 C977 P43073 oasup.LogUpdateProcessor.finish [collection1] webapp=/ebg/lc path=/update params={version=2&update.distrib=TOLEADER&test.distrib.skip.servers=http://127.0.0.1:59164/ebg/lc/collection1/&wt=javabin&distrib.from=http://127.0.0.1:52252/ebg/lc/collection1/} {add=[3 (1438550858938712064)]} 0 6
[junit4:junit4] 2> 388182 T1584 C979 P52252 oasup.LogUpdateProcessor.finish [collection1] webapp=/ebg/lc path=/update params={version=2&test.distrib.skip.servers=http://127.0.0.1:59164/ebg/lc/collection1/&test.distrib.skip.servers=http://127.0.0.1:52252/ebg/lc/collection1/&wt=javabin} {add=[3]} 0 7
[junit4:junit4] 2> 388184 T1532 C978 P50855 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 388225 T1532 C978 P50855 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1c33b7f; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1c33b7f; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> 388225 T1532 C978 P50855 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 388227 T1532 C978 P50855 oass.SolrIndexSearcher.<init> Opening Searcher@1185a82 main
[junit4:junit4] 2> 388228 T1532 C978 P50855 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 388228 T1540 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1185a82 main{StandardDirectoryReader(segments_3:3:nrt _0(4.4):C4)}
[junit4:junit4] 2> 388228 T1532 C978 P50855 oasup.LogUpdateProcessor.finish [collection1] webapp=/ebg/lc path=/update params={version=2&softCommit=false&wt=javabin&commit=true&waitSearcher=true} {commit=} 0 44
[junit4:junit4] 2> 388231 T1549 C977 P43073 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:43073/ebg/lc/collection1/, StdNode: http://127.0.0.1:59164/ebg/lc/collection1/, StdNode: http://127.0.0.1:52252/ebg/lc/collection1/, StdNode: http://127.0.0.1:57495/ebg/lc/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 388233 T1550 C977 P43073 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 388233 T1567 C980 P59164 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 388233 T1583 C979 P52252 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 388237 T1602 C976 P57495 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 388285 T1583 C979 P52252 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@fc965c; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@fc965c; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5}
[junit4:junit4] 2> 388285 T1550 C977 P43073 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=5
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1dceeb7; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1dceeb7; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1dceeb7; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1dceeb7; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1dceeb7; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_6,generation=6}
[junit4:junit4] 2> 388285 T1567 C980 P59164 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@32e520; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@32e520; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> 388286 T1550 C977 P43073 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 6
[junit4:junit4] 2> 388285 T1583 C979 P52252 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 5
[junit4:junit4] 2> 388286 T1567 C980 P59164 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4:junit4] 2> 388288 T1550 C977 P43073 oass.SolrIndexSearcher.<init> Opening Searcher@25fcf7 main
[junit4:junit4] 2> 388288 T1583 C979 P52252 oass.SolrIndexSearcher.<init> Opening Searcher@a0a30d main
[junit4:junit4] 2> 388289 T1550 C977 P43073 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 388289 T1591 oasc.JmxMonitoredMap.put WARN Failed to register info bean: searcher javax.management.InstanceAlreadyExistsException: solr/collection1:type=searcher,id=org.apache.solr.search.SolrIndexSearcher
[junit4:junit4] 2> at com.sun.jmx.mbeanserver.Repository.addMBean(Repository.java:437)
[junit4:junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerWithRepository(DefaultMBeanServerInterceptor.java:1898)
[junit4:junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:966)
[junit4:junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)
[junit4:junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)
[junit4:junit4] 2> at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:513)
[junit4:junit4] 2> at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:140)
[junit4:junit4] 2> at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:51)
[junit4:junit4] 2> at org.apache.solr.search.SolrIndexSearcher.register(SolrIndexSearcher.java:298)
[junit4:junit4] 2> at org.apache.solr.core.SolrCore.registerSearcher(SolrCore.java:1846)
[junit4:junit4] 2> at org.apache.solr.core.SolrCore.access$000(SolrCore.java:135)
[junit4:junit4] 2> at org.apache.solr.core.SolrCore$7.call(SolrCore.java:1723)
[junit4:junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:724)
[junit4:junit4] 2>
[junit4:junit4] 2> 388289 T1558 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@25fcf7 main{StandardDirectoryReader(segments_6:3:nrt _0(4.4):C4)}
[junit4:junit4] 2> 388289 T1567 C980 P59164 oass.SolrIndexSearcher.<init> Opening Searcher@1e423f8 main
[junit4:junit4] 2> 388289 T1583 C979 P52252 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 388290 T1567 C980 P59164 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 388290 T1550 C977 P43073 oasup.LogUpdateProcessor.finish [collection1] webapp=/ebg/lc path=/update params={version=2&expungeDeletes=false&softCommit=false&wt=javabin&commit=true&commit_end_point=true&waitSearcher=true} {commit=} 0 58
[junit4:junit4] 2> 388290 T1591 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@a0a30d main{StandardDirectoryReader(segments_5:3:nrt _0(4.4):C4)}
[junit4:junit4] 2> 388291 T1574 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1e423f8 main{StandardDirectoryReader(segments_4:3:nrt _0(4.4):C2)}
[junit4:junit4] 2> 388292 T1583 C979 P52252 oasup.LogUpdateProcessor.finish [collection1] webapp=/ebg/lc path=/update params={version=2&expungeDeletes=false&softCommit=false&wt=javabin&commit=true&commit_end_point=true&waitSearcher=true} {commit=} 0 59
[junit4:junit4] 2> 388292 T1567 C980 P59164 oasup.LogUpdateProcessor.finish [collection1] webapp=/ebg/lc path=/update params={version=2&expungeDeletes=false&softCommit=false&wt=javabin&commit=true&commit_end_point=true&waitSearcher=true} {commit=} 0 59
[junit4:junit4] 2> 388295 T1602 C976 P57495 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@10bb693; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@10bb693; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_6,generation=6}
[junit4:junit4] 2> 388295 T1602 C976 P57495 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 6
[junit4:junit4] 2> 388297 T1602 C976 P57495 oass.SolrIndexSearcher.<init> Opening Searcher@1f8d24c main
[junit4:junit4] 2> 388298 T1602 C976 P57495 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 388299 T1612 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1f8d24c main{StandardDirectoryReader(segments_6:3:nrt _0(4.4):C4)}
[junit4:junit4] 2> 388299 T1602 C976 P57495 oasup.LogUpdateProcessor.finish [collection1] webapp=/ebg/lc path=/update params={version=2&expungeDeletes=false&softCommit=false&wt=javabin&commit=true&commit_end_point=true&waitSearcher=true} {commit=} 0 62
[junit4:junit4] 2> 388300 T1549 C977 P43073 oasup.LogUpdateProcessor.finish [collection1] webapp=/ebg/lc path=/update params={version=2&softCommit=false&wt=javabin&commit=true&waitSearcher=true} {commit=} 0 69
[junit4:junit4] 2> 388300 T1514 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):230
[junit4:junit4] 2> 388301 T1514 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 388302 T1514 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> 388304 T1551 C977 P43073 oasc.SolrCore.execute [collection1] webapp=/ebg/lc path=/select params={distrib=false&version=2&rows=0&tests=checkShardConsistency&q=*:*&wt=javabin} hits=4 status=0 QTime=0
[junit4:junit4] 2> 388306 T1566 C980 P59164 oasc.SolrCore.execute [collection1] webapp=/ebg/lc path=/select params={distrib=false&version=2&rows=0&tests=checkShardConsistency&q=*:*&wt=javabin} hits=2 status=0 QTime=0
[junit4:junit4] 2> 388309 T1582 C979 P52252 oasc.SolrCore.execute [collection1] webapp=/ebg/lc path=/select params={distrib=false&version=2&rows=0&tests=checkShardConsistency&q=*:*&wt=javabin} hits=4 status=0 QTime=0
[junit4:junit4] 2> 388311 T1601 C976 P57495 oasc.SolrCore.execute [collection1] webapp=/ebg/lc path=/select params={distrib=false&version=2&rows=0&tests=checkShardConsistency&q=*:*&wt=javabin} hits=4 status=0 QTime=0
[junit4:junit4] 2> 388312 T1514 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 388316 T1585 oasha.CollectionsHandler.handleSyncShardAction Syncing shard : version=2&collection=collection1&action=SYNCSHARD&wt=javabin&shard=shard1
[junit4:junit4] 2> 388316 T1585 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 388319 T1552 oasha.CoreAdminHandler.handleRequestSyncAction I have been requested to sync up my shard
[junit4:junit4] 2> 388319 T1552 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:43073/ebg/lc/collection1/
[junit4:junit4] 2> 388320 T1552 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:43073/ebg/lc START replicas=[http://127.0.0.1:59164/ebg/lc/collection1/, http://127.0.0.1:52252/ebg/lc/collection1/, http://127.0.0.1:57495/ebg/lc/collection1/] nUpdates=100
[junit4:junit4] 2> 388321 T1568 C980 P59164 oasc.SolrCore.execute [collection1] webapp=/ebg/lc path=/get params={distrib=false&version=2&qt=/get&wt=javabin&getVersions=100} status=0 QTime=0
[junit4:junit4] 2> 388322 T1600 C976 P57495 oasc.SolrCore.execute [collection1] webapp=/ebg/lc path=/get params={distrib=false&version=2&qt=/get&wt=javabin&getVersions=100} status=0 QTime=0
[junit4:junit4] 2> 388322 T1552 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:43073/ebg/lc Received 3 versions from 127.0.0.1:59164/ebg/lc/collection1/
[junit4:junit4] 2> 388321 T1584 C979 P52252 oasc.SolrCore.execute [collection1] webapp=/ebg/lc path=/get params={distrib=false&version=2&qt=/get&wt=javabin&getVersions=100} status=0 QTime=0
[junit4:junit4] 2> 388322 T1552 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:43073/ebg/lc Our versions are newer. ourLowThreshold=1438550858883137536 otherHigh=1438550858912497664
[junit4:junit4] 2> 388323 T1552 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:43073/ebg/lc Received 5 versions from 127.0.0.1:57495/ebg/lc/collection1/
[junit4:junit4] 2> 388323 T1552 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:43073/ebg/lc Our versions are newer. ourLowThreshold=1438550858883137536 otherHigh=1438550858925080576
[junit4:junit4] 2> 388323 T1552 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:43073/ebg/lc Received 5 versions from 127.0.0.1:52252/ebg/lc/collection1/
[junit4:junit4] 2> 388323 T1552 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:43073/ebg/lc Our versions are newer. ourLowThreshold=1438550858883137536 otherHigh=1438550858925080576
[junit4:junit4] 2> 388324 T1552 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:43073/ebg/lc DONE. sync succeeded
[junit4:junit4] 2> 388324 T1552 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 388324 T1552 oasc.SyncStrategy.syncToMe http://127.0.0.1:43073/ebg/lc/collection1/: try and ask http://127.0.0.1:59164/ebg/lc/collection1/ to sync
[junit4:junit4] 2> 388325 T1552 oasc.SyncStrategy.syncToMe http://127.0.0.1:43073/ebg/lc/collection1/: try and ask http://127.0.0.1:52252/ebg/lc/collection1/ to sync
[junit4:junit4] 2> 388325 T1552 oasc.SyncStrategy.syncToMe http://127.0.0.1:43073/ebg/lc/collection1/: try and ask http://127.0.0.1:57495/ebg/lc/collection1/ to sync
[junit4:junit4] 2> 388326 T1565 C980 P59164 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:59164/ebg/lc START replicas=[http://127.0.0.1:43073/ebg/lc/collection1/] nUpdates=100
[junit4:junit4] 2> 388327 T1583 C979 P52252 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:52252/ebg/lc START replicas=[http://127.0.0.1:43073/ebg/lc/collection1/] nUpdates=100
[junit4:junit4] 2> 388327 T1602 C976 P57495 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:57495/ebg/lc START replicas=[http://127.0.0.1:43073/ebg/lc/collection1/] nUpdates=100
[junit4:junit4] 2> 388328 T1550 C977 P43073 oasc.SolrCore.execute [collection1] webapp=/ebg/lc path=/get params={distrib=false&version=2&qt=/get&wt=javabin&getVersions=100} status=0 QTime=0
[junit4:junit4] 2> 388328 T1549 C977 P43073 oasc.SolrCore.execute [collection1] webapp=/ebg/lc path=/get params={distrib=false&version=2&qt=/get&wt=javabin&getVersions=100} status=0 QTime=0
[junit4:junit4] 2> 388329 T1551 C977 P43073 oasc.SolrCore.execute [collection1] webapp=/ebg/lc path=/get params={distrib=false&version=2&qt=/get&wt=javabin&getVersions=100} status=0 QTime=1
[junit4:junit4] 2> 388329 T1565 C980 P59164 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:59164/ebg/lc Received 5 versions from 127.0.0.1:43073/ebg/lc/collection1/
[junit4:junit4] 2> 388329 T1583 C979 P52252 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:52252/ebg/lc Received 5 versions from 127.0.0.1:43073/ebg/lc/collection1/
[junit4:junit4] 2> 388329 T1565 C980 P59164 oasu.PeerSync.requestUpdates PeerSync: core=collection1 url=http://127.0.0.1:59164/ebg/lc Requesting updates from 127.0.0.1:43073/ebg/lc/collection1/n=2 versions=[1438550858938712064, 1438550858925080576]
[junit4:junit4] 2> 388329 T1602 C976 P57495 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:57495/ebg/lc Received 5 versions from 127.0.0.1:43073/ebg/lc/collection1/
[junit4:junit4] 2> 388329 T1583 C979 P52252 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:52252/ebg/lc Our versions are newer. ourLowThreshold=1438550858883137536 otherHigh=1438550858925080576
[junit4:junit4] 2> 388330 T1602 C976 P57495 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:57495/ebg/lc Our versions are newer. ourLowThreshold=1438550858883137536 otherHigh=1438550858925080576
[junit4:junit4] 2> 388330 T1583 C979 P52252 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:52252/ebg/lc DONE. sync succeeded
[junit4:junit4] 2> 388331 T1602 C976 P57495 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:57495/ebg/lc DONE. sync succeeded
[junit4:junit4] 2> 388331 T1583 C979 P52252 oasc.SolrCore.execute [collection1] webapp=/ebg/lc path=/get params={distrib=false&version=2&qt=/get&wt=javabin&getVersions=100&sync=http://127.0.0.1:43073/ebg/lc/collection1/} status=0 QTime=4
[junit4:junit4] 2> 388331 T1602 C976 P57495 oasc.SolrCore.execute [collection1] webapp=/ebg/lc path=/get params={distrib=false&version=2&qt=/get&wt=javabin&getVersions=100&sync=http://127.0.0.1:43073/ebg/lc/collection1/} status=0 QTime=4
[junit4:junit4] 2> 388332 T1552 oasc.SyncStrategy.syncToMe http://127.0.0.1:43073/ebg/lc/collection1/: sync completed with http://127.0.0.1:52252/ebg/lc/collection1/
[junit4:junit4] 2> 388332 T1550 C977 P43073 oasc.SolrCore.execute [collection1] webapp=/ebg/lc path=/get params={distrib=false&version=2&getUpdates=1438550858938712064,1438550858925080576&qt=/get&wt=javabin} status=0 QTime=1
[junit4:junit4] 2> 388332 T1552 oasc.SyncStrategy.syncToMe http://127.0.0.1:43073/ebg/lc/collection1/: sync completed with http://127.0.0.1:57495/ebg/lc/collection1/
[junit4:junit4] 2> 388335 T1565 C980 P59164 oasup.LogUpdateProcessor.finish [collection1] {add=[2 (1438550858925080576), 3 (1438550858938712064)]} 0 3
[junit4:junit4] 2> 388335 T1565 C980 P59164 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:59164/ebg/lc DONE. sync succeeded
[junit4:junit4] 2> 388335 T1565 C980 P59164 oasc.SolrCore.execute [collection1] webapp=/ebg/lc path=/get params={distrib=false&version=2&qt=/get&wt=javabin&getVersions=100&sync=http://127.0.0.1:43073/ebg/lc/collection1/} status=0 QTime=9
[junit4:junit4] 2> 388336 T1552 oasc.SyncStrategy.syncToMe http://127.0.0.1:43073/ebg/lc/collection1/: sync completed with http://127.0.0.1:59164/ebg/lc/collection1/
[junit4:junit4] 2> 388336 T1552 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={version=2&collection=collection1&core=collection1&action=REQUESTSYNCSHARD&wt=javabin&shard=shard1} status=0 QTime=17
[junit4:junit4] 2> 388336 T1585 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/collections params={version=2&collection=collection1&action=SYNCSHARD&wt=javabin&shard=shard1} status=0 QTime=21
[junit4:junit4] 2> 388337 T1514 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 2> 388337 T1514 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 2> 388338 T1514 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 388339 T1514 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> 388341 T1531 C978 P50855 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 388405 T1531 C978 P50855 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371908984249/control/data/index lockFactory=org.apache.lucene.store.Nativ
[...truncated too long message...]
lection/leader_elect/shard1/election/89909427191939075-127.0.0.1:50855_ebg%2Flc_collection1-n_0000000000 (0)
[junit4:junit4] 1> /solr/collections/collection1 (3)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {"configName":"conf1"}
[junit4:junit4] 1> /solr/collections/collection1/leaders (1)
[junit4:junit4] 1> /solr/collections/collection1/leaders/shard1 (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "node_name":"127.0.0.1:52252_ebg%2Flc",
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:52252/ebg/lc"}
[junit4:junit4] 1> /solr/collections/collection1/shards (0)
[junit4:junit4] 1> /solr/collections/collection1/leader_elect (1)
[junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard1 (1)
[junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard1/election (3)
[junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard1/election/89909427191939084-127.0.0.1:57495_ebg%2Flc_collection1-n_0000000003 (0)
[junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard1/election/89909427191939082-127.0.0.1:52252_ebg%2Flc_collection1-n_0000000002 (0)
[junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard1/election/89909427191939086-127.0.0.1:43073_ebg%2Flc_collection1-n_0000000004 (0)
[junit4:junit4] 1> /solr/clusterstate.json (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "control_collection":{
[junit4:junit4] 1> "router":"compositeId",
[junit4:junit4] 1> "shards":{"shard1":{
[junit4:junit4] 1> "range":"80000000-7fffffff",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "replicas":{"127.0.0.1:50855_ebg%2Flc_collection1":{
[junit4:junit4] 1> "collection":"control_collection",
[junit4:junit4] 1> "node_name":"127.0.0.1:50855_ebg%2Flc",
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "shard":"shard1",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:50855/ebg/lc",
[junit4:junit4] 1> "leader":"true"}}}}},
[junit4:junit4] 1> "collection1":{
[junit4:junit4] 1> "router":"compositeId",
[junit4:junit4] 1> "shards":{"shard1":{
[junit4:junit4] 1> "range":"80000000-7fffffff",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "replicas":{
[junit4:junit4] 1> "127.0.0.1:43073_ebg%2Flc_collection1":{
[junit4:junit4] 1> "collection":"collection1",
[junit4:junit4] 1> "node_name":"127.0.0.1:43073_ebg%2Flc",
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "shard":"shard1",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:43073/ebg/lc"},
[junit4:junit4] 1> "127.0.0.1:59164_ebg%2Flc_collection1":{
[junit4:junit4] 1> "collection":"collection1",
[junit4:junit4] 1> "node_name":"127.0.0.1:59164_ebg%2Flc",
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "state":"down",
[junit4:junit4] 1> "shard":"shard1",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:59164/ebg/lc"},
[junit4:junit4] 1> "127.0.0.1:52252_ebg%2Flc_collection1":{
[junit4:junit4] 1> "collection":"collection1",
[junit4:junit4] 1> "node_name":"127.0.0.1:52252_ebg%2Flc",
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "shard":"shard1",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:52252/ebg/lc",
[junit4:junit4] 1> "leader":"true"},
[junit4:junit4] 1> "127.0.0.1:57495_ebg%2Flc_collection1":{
[junit4:junit4] 1> "collection":"collection1",
[junit4:junit4] 1> "node_name":"127.0.0.1:57495_ebg%2Flc",
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "shard":"shard1",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:57495/ebg/lc"}}}}}}
[junit4:junit4] 1> /solr/overseer (3)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1>
[junit4:junit4] 1> /solr/overseer/collection-queue-work (0)
[junit4:junit4] 1> /solr/overseer/queue (0)
[junit4:junit4] 1> /solr/overseer/queue-work (0)
[junit4:junit4] 1> /solr/overseer_elect (2)
[junit4:junit4] 1> /solr/overseer_elect/leader (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {"id":"89909427191939075-127.0.0.1:50855_ebg%2Flc-n_0000000000"}
[junit4:junit4] 1> /solr/overseer_elect/election (4)
[junit4:junit4] 1> /solr/overseer_elect/election/89909427191939084-127.0.0.1:57495_ebg%2Flc-n_0000000004 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89909427191939082-127.0.0.1:52252_ebg%2Flc-n_0000000003 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89909427191939086-127.0.0.1:43073_ebg%2Flc-n_0000000005 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89909427191939075-127.0.0.1:50855_ebg%2Flc-n_0000000000 (0)
[junit4:junit4] 1>
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=SyncSliceTest -Dtests.method=testDistribSearch -Dtests.seed=FD6B0656D09C0FB9 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ko_KR -Dtests.timezone=Antarctica/Vostok -Dtests.file.encoding=UTF-8
[junit4:junit4] FAILURE 101s J0 | SyncSliceTest.testDistribSearch <<<
[junit4:junit4] > Throwable #1: java.lang.AssertionError: shard1 is not consistent. Got 305 from http://127.0.0.1:43073/ebg/lc/collection1lastClient and got 246 from http://127.0.0.1:52252/ebg/lc/collection1
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([FD6B0656D09C0FB9:7C8D884EA7C36F85]:0)
[junit4:junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1018)
[junit4:junit4] > at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:238)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:724)
[junit4:junit4] 2> 466642 T1514 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 101236 T1513 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 2 leaked thread(s).
[junit4:junit4] 2> 467803 T1606 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 467803 T1606 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 467803 T1606 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> NOTE: test params are: codec=Asserting, sim=DefaultSimilarity, locale=ko_KR, timezone=Antarctica/Vostok
[junit4:junit4] 2> NOTE: Linux 3.2.0-48-generic i386/Oracle Corporation 1.8.0-ea (32-bit)/cpus=8,threads=3,free=118563880,total=220200960
[junit4:junit4] 2> NOTE: All tests run in this JVM: [TestWriterPerf, ExternalFileFieldSortTest, MBeansHandlerTest, SolrInfoMBeanTest, TestSolrXmlPersistence, TestValueSourceCache, TestPluginEnable, TestXIncludeConfig, RecoveryZkTest, SolrCoreTest, TestFieldResource, ReturnFieldsTest, DocValuesTest, TestStressRecovery, ClusterStateUpdateTest, TestSurroundQueryParser, CoreAdminHandlerTest, PreAnalyzedUpdateProcessorTest, BinaryUpdateRequestHandlerTest, OverseerCollectionProcessorTest, DistributedSpellCheckComponentTest, DistributedTermsComponentTest, PeerSyncTest, TestCharFilters, TermsComponentTest, TestFieldTypeCollectionResource, CacheHeaderTest, UpdateRequestProcessorFactoryTest, TestCoreContainer, AutoCommitTest, SoftAutoCommitTest, TestJoin, SliceStateTest, TestGroupingSearch, TestFastWriter, TestReplicationHandler, IndexSchemaTest, SimpleFacetsTest, TermVectorComponentTest, TestDynamicFieldCollectionResource, TestSolrDeletionPolicy2, SyncSliceTest]
[junit4:junit4] Completed on J0 in 102.51s, 1 test, 1 failure <<< FAILURES!
[...truncated 681 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:392: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:372: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:181: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:437: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1246: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:890: There were test failures: 298 suites, 1256 tests, 1 failure, 16 ignored (7 assumptions)
Total time: 39 minutes 46 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.8.0-ea-b93 -server -XX:+UseG1GC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure