You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2013/06/15 13:46:27 UTC
[JENKINS] Lucene-Solr-Tests-4.x-Java7 - Build # 1334 - Failure
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java7/1334/
1 tests failed.
REGRESSION: org.apache.solr.cloud.ChaosMonkeyShardSplitTest.testDistribSearch
Error Message:
Server at http://127.0.0.1:49863/_ returned non ok status:500, message:Server Error
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:49863/_ returned non ok status:500, message:Server Error
at __randomizedtesting.SeedInfo.seed([F93B426350DA18B9:78DDCC7B27857885]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:228)
at org.apache.solr.cloud.ChaosMonkeyShardSplitTest.doTest(ChaosMonkeyShardSplitTest.java:136)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9553 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.ChaosMonkeyShardSplitTest
[junit4:junit4] 2> 958120 T1889 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /_/
[junit4:junit4] 2> 958126 T1889 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solrtest-ChaosMonkeyShardSplitTest-1371295674317
[junit4:junit4] 2> 958128 T1889 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 958128 T1890 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 958229 T1889 oasc.ZkTestServer.run start zk server on port:61548
[junit4:junit4] 2> 958230 T1889 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 958233 T1896 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@413bff7f name:ZooKeeperConnection Watcher:127.0.0.1:61548 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 958234 T1889 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 958234 T1889 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 958253 T1889 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 958255 T1898 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@325e8dc9 name:ZooKeeperConnection Watcher:127.0.0.1:61548/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 958255 T1889 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 958256 T1889 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 958259 T1889 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 958267 T1889 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 958269 T1889 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 958272 T1889 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 958273 T1889 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 958278 T1889 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 958279 T1889 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 958399 T1889 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 958400 T1889 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 958403 T1889 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 958404 T1889 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 958407 T1889 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 958408 T1889 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 958415 T1889 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 958416 T1889 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 958419 T1889 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 958419 T1889 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 958422 T1889 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 958423 T1889 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 958426 T1889 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 958426 T1889 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 958700 T1889 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 958705 T1889 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:20041
[junit4:junit4] 2> 958706 T1889 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 958707 T1889 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 958707 T1889 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1371295674624
[junit4:junit4] 2> 958708 T1889 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1371295674624/solr.xml
[junit4:junit4] 2> 958708 T1889 oasc.CoreContainer.<init> New CoreContainer 668836637
[junit4:junit4] 2> 958709 T1889 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1371295674624/'
[junit4:junit4] 2> 958710 T1889 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1371295674624/'
[junit4:junit4] 2> 958841 T1889 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 958842 T1889 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 958843 T1889 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 958844 T1889 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 958844 T1889 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 958845 T1889 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 958845 T1889 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 958846 T1889 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 958846 T1889 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 958847 T1889 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 958866 T1889 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 958866 T1889 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:61548/solr
[junit4:junit4] 2> 958867 T1889 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 958868 T1889 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 958875 T1909 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@9b4a111 name:ZooKeeperConnection Watcher:127.0.0.1:61548 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 958876 T1889 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 958878 T1889 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 958891 T1889 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 958893 T1911 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f10965e name:ZooKeeperConnection Watcher:127.0.0.1:61548/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 958893 T1889 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 958895 T1889 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 958905 T1889 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 958909 T1889 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 958910 T1889 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:20041__
[junit4:junit4] 2> 958919 T1889 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:20041__
[junit4:junit4] 2> 958922 T1889 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 958939 T1889 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 958942 T1889 oasc.Overseer.start Overseer (id=89869233312563203-127.0.0.1:20041__-n_0000000000) starting
[junit4:junit4] 2> 958954 T1889 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 958965 T1913 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 958966 T1889 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 958969 T1889 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 958970 T1889 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 958972 T1912 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 958978 T1914 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 958978 T1914 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 960475 T1912 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 960476 T1912 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:20041__",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:20041/_"}
[junit4:junit4] 2> 960476 T1912 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 960477 T1912 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 960495 T1911 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 960981 T1914 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1371295674624/collection1
[junit4:junit4] 2> 960981 T1914 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 960982 T1914 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 960982 T1914 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 960983 T1914 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1371295674624/collection1/'
[junit4:junit4] 2> 960985 T1914 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1371295674624/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 960985 T1914 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1371295674624/collection1/lib/README' to classloader
[junit4:junit4] 2> 961038 T1914 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 961100 T1914 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 961201 T1914 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 961208 T1914 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 961787 T1914 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 961791 T1914 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 961794 T1914 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 961799 T1914 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 961820 T1914 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 961821 T1914 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1371295674624/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371295674316/control/data/
[junit4:junit4] 2> 961821 T1914 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2f1632c7
[junit4:junit4] 2> 961821 T1914 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 961822 T1914 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371295674316/control/data
[junit4:junit4] 2> 961823 T1914 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371295674316/control/data/index/
[junit4:junit4] 2> 961823 T1914 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371295674316/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 961823 T1914 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371295674316/control/data/index
[junit4:junit4] 2> 961828 T1914 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6407e189 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7abaaca0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 961828 T1914 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 961831 T1914 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 961832 T1914 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 961832 T1914 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 961833 T1914 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 961834 T1914 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 961834 T1914 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 961834 T1914 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 961835 T1914 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 961835 T1914 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 961851 T1914 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 961859 T1914 oass.SolrIndexSearcher.<init> Opening Searcher@7a93c218 main
[junit4:junit4] 2> 961859 T1914 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371295674316/control/data/tlog
[junit4:junit4] 2> 961860 T1914 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 961861 T1914 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 961864 T1915 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7a93c218 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 961866 T1914 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 961866 T1914 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:20041/_ collection:control_collection shard:shard1
[junit4:junit4] 2> 961867 T1914 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 961885 T1914 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 961897 T1914 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 961897 T1914 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 961898 T1914 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:20041/_/collection1/
[junit4:junit4] 2> 961898 T1914 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 961898 T1914 oasc.SyncStrategy.syncToMe http://127.0.0.1:20041/_/collection1/ has no replicas
[junit4:junit4] 2> 961898 T1914 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:20041/_/collection1/
[junit4:junit4] 2> 961899 T1914 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 961999 T1912 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 962014 T1911 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 962064 T1914 oasc.ZkController.register We are http://127.0.0.1:20041/_/collection1/ and leader is http://127.0.0.1:20041/_/collection1/
[junit4:junit4] 2> 962064 T1914 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:20041/_
[junit4:junit4] 2> 962064 T1914 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 962065 T1914 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 962065 T1914 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 962067 T1914 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 962067 T1889 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 962068 T1889 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 962069 T1889 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 962087 T1889 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 962089 T1889 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 962091 T1918 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@450752fa name:ZooKeeperConnection Watcher:127.0.0.1:61548/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 962091 T1889 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 962092 T1889 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 962094 T1889 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 962361 T1889 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 962365 T1889 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:49863
[junit4:junit4] 2> 962366 T1889 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 962366 T1889 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 962367 T1889 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1371295678285
[junit4:junit4] 2> 962367 T1889 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1371295678285/solr.xml
[junit4:junit4] 2> 962368 T1889 oasc.CoreContainer.<init> New CoreContainer 1572048188
[junit4:junit4] 2> 962368 T1889 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1371295678285/'
[junit4:junit4] 2> 962369 T1889 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1371295678285/'
[junit4:junit4] 2> 962497 T1889 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 962498 T1889 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 962498 T1889 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 962499 T1889 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 962499 T1889 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 962500 T1889 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 962500 T1889 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 962501 T1889 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 962501 T1889 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 962502 T1889 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 962520 T1889 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 962521 T1889 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:61548/solr
[junit4:junit4] 2> 962522 T1889 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 962523 T1889 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 962526 T1929 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4b003ae9 name:ZooKeeperConnection Watcher:127.0.0.1:61548 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 962527 T1889 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 962542 T1889 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 962556 T1889 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 962558 T1931 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@70e6a658 name:ZooKeeperConnection Watcher:127.0.0.1:61548/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 962558 T1889 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 962567 T1889 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 963519 T1912 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 963520 T1912 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:20041__",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:20041/_"}
[junit4:junit4] 2> 963535 T1931 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 963535 T1918 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 963535 T1911 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 963570 T1889 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49863__
[junit4:junit4] 2> 963605 T1889 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49863__
[junit4:junit4] 2> 963627 T1931 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 963627 T1911 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 963627 T1918 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 963627 T1911 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 963627 T1931 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 963628 T1918 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 963635 T1932 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 963635 T1932 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 965039 T1912 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 965040 T1912 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:49863__",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:49863/_"}
[junit4:junit4] 2> 965040 T1912 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 965041 T1912 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 965065 T1911 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 965065 T1931 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 965065 T1918 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 965650 T1932 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1371295678285/collection1
[junit4:junit4] 2> 965650 T1932 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 965651 T1932 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 965651 T1932 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 965652 T1932 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1371295678285/collection1/'
[junit4:junit4] 2> 965654 T1932 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1371295678285/collection1/lib/README' to classloader
[junit4:junit4] 2> 965654 T1932 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1371295678285/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 965708 T1932 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 965770 T1932 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 965871 T1932 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 965877 T1932 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 966240 T1719 oasc.OverseerCollectionProcessor.run WARN Overseer cannot talk to ZK
[junit4:junit4] 2> 966458 T1932 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 966462 T1932 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 966465 T1932 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 966470 T1932 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 966491 T1932 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 966491 T1932 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1371295678285/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371295674316/jetty1/
[junit4:junit4] 2> 966492 T1932 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2f1632c7
[junit4:junit4] 2> 966492 T1932 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 966493 T1932 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371295674316/jetty1
[junit4:junit4] 2> 966494 T1932 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371295674316/jetty1/index/
[junit4:junit4] 2> 966494 T1932 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371295674316/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 966495 T1932 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371295674316/jetty1/index
[junit4:junit4] 2> 966498 T1932 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4a75c79b lockFactory=org.apache.lucene.store.NativeFSLockFactory@48028507),segFN=segments_1,generation=1}
[junit4:junit4] 2> 966499 T1932 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 966502 T1932 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 966502 T1932 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 966503 T1932 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 966504 T1932 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 966504 T1932 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 966505 T1932 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 966505 T1932 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 966506 T1932 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 966506 T1932 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 966523 T1932 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 966530 T1932 oass.SolrIndexSearcher.<init> Opening Searcher@1984d3a7 main
[junit4:junit4] 2> 966530 T1932 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371295674316/jetty1/tlog
[junit4:junit4] 2> 966531 T1932 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 966532 T1932 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 966536 T1933 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1984d3a7 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 966538 T1932 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 966539 T1932 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:49863/_ collection:collection1 shard:shard1
[junit4:junit4] 2> 966539 T1932 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 966556 T1932 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 966558 T1932 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 966559 T1932 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 966559 T1932 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:49863/_/collection1/
[junit4:junit4] 2> 966559 T1932 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 966559 T1932 oasc.SyncStrategy.syncToMe http://127.0.0.1:49863/_/collection1/ has no replicas
[junit4:junit4] 2> 966560 T1932 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:49863/_/collection1/
[junit4:junit4] 2> 966560 T1932 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 966569 T1912 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 966575 T1931 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 966575 T1911 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 966575 T1918 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 966616 T1932 oasc.ZkController.register We are http://127.0.0.1:49863/_/collection1/ and leader is http://127.0.0.1:49863/_/collection1/
[junit4:junit4] 2> 966616 T1932 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:49863/_
[junit4:junit4] 2> 966616 T1932 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 966616 T1932 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 966617 T1932 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 966618 T1932 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 966619 T1889 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 966620 T1889 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 966621 T1889 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 966901 T1889 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 966905 T1889 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:36416
[junit4:junit4] 2> 966906 T1889 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 966906 T1889 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 966907 T1889 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1371295682829
[junit4:junit4] 2> 966907 T1889 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1371295682829/solr.xml
[junit4:junit4] 2> 966908 T1889 oasc.CoreContainer.<init> New CoreContainer 287325185
[junit4:junit4] 2> 966909 T1889 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1371295682829/'
[junit4:junit4] 2> 966909 T1889 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1371295682829/'
[junit4:junit4] 2> 967037 T1889 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 967038 T1889 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 967039 T1889 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 967039 T1889 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 967040 T1889 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 967040 T1889 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 967041 T1889 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 967041 T1889 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 967042 T1889 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 967042 T1889 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 967061 T1889 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 967062 T1889 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:61548/solr
[junit4:junit4] 2> 967062 T1889 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 967063 T1889 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 967066 T1945 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7d3cf772 name:ZooKeeperConnection Watcher:127.0.0.1:61548 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 967067 T1889 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 967081 T1889 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 967095 T1889 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 967097 T1947 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@54f20e31 name:ZooKeeperConnection Watcher:127.0.0.1:61548/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 967097 T1889 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 967106 T1889 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 968080 T1912 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 968081 T1912 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:49863__",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:49863/_"}
[junit4:junit4] 2> 968094 T1918 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 968094 T1947 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 968094 T1931 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 968095 T1911 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 968110 T1889 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36416__
[junit4:junit4] 2> 968112 T1889 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:36416__
[junit4:junit4] 2> 968114 T1947 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 968114 T1918 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 968114 T1911 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 968114 T1931 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 968115 T1911 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 968115 T1918 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 968115 T1931 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 968115 T1947 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 968122 T1948 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 968122 T1948 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 969598 T1912 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 969599 T1912 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:36416__",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:36416/_"}
[junit4:junit4] 2> 969599 T1912 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 969600 T1912 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 969620 T1931 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 969620 T1947 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 969620 T1911 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 969620 T1918 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 970126 T1948 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1371295682829/collection1
[junit4:junit4] 2> 970126 T1948 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 970127 T1948 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 970127 T1948 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 970129 T1948 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1371295682829/collection1/'
[junit4:junit4] 2> 970130 T1948 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1371295682829/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 970131 T1948 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1371295682829/collection1/lib/README' to classloader
[junit4:junit4] 2> 970183 T1948 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 970244 T1948 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 970345 T1948 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 970351 T1948 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 970368 T1723 oasc.OverseerCollectionProcessor.run WARN Overseer cannot talk to ZK
[junit4:junit4] 2> 970931 T1948 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 970935 T1948 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 970938 T1948 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 970943 T1948 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 970965 T1948 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 970965 T1948 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1371295682829/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371295674316/jetty2/
[junit4:junit4] 2> 970965 T1948 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2f1632c7
[junit4:junit4] 2> 970966 T1948 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 970967 T1948 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371295674316/jetty2
[junit4:junit4] 2> 970967 T1948 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371295674316/jetty2/index/
[junit4:junit4] 2> 970967 T1948 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371295674316/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 970969 T1948 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371295674316/jetty2/index
[junit4:junit4] 2> 970972 T1948 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1d3697a6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2ee6f0f2),segFN=segments_1,generation=1}
[junit4:junit4] 2> 970973 T1948 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 970976 T1948 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 970976 T1948 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 970977 T1948 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 970978 T1948 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 970978 T1948 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 970978 T1948 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 970979 T1948 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 970979 T1948 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 970980 T1948 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 970996 T1948 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 971004 T1948 oass.SolrIndexSearcher.<init> Opening Searcher@772ffb3e main
[junit4:junit4] 2> 971004 T1948 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371295674316/jetty2/tlog
[junit4:junit4] 2> 971005 T1948 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 971006 T1948 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 971010 T1949 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@772ffb3e main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 971013 T1948 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 971013 T1948 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:36416/_ collection:collection1 shard:shard2
[junit4:junit4] 2> 971014 T1948 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 971032 T1948 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 971035 T1948 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 971035 T1948 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 971035 T1948 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:36416/_/collection1/
[junit4:junit4] 2> 971036 T1948 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 971036 T1948 oasc.SyncStrategy.syncToMe http://127.0.0.1:36416/_/collection1/ has no replicas
[junit4:junit4] 2> 971036 T1948 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:36416/_/collection1/
[junit4:junit4] 2> 971036 T1948 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 971124 T1912 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 971140 T1918 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 971140 T1947 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 971140 T1931 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 971140 T1911 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 971143 T1948 oasc.ZkController.register We are http://127.0.0.1:36416/_/collection1/ and leader is http://127.0.0.1:36416/_/collection1/
[junit4:junit4] 2> 971143 T1948 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:36416/_
[junit4:junit4] 2> 971143 T1948 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 971143 T1948 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 971144 T1948 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 971145 T1948 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 971146 T1889 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 971147 T1889 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 971147 T1889 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 971439 T1889 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 971442 T1889 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:55762
[junit4:junit4] 2> 971443 T1889 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 971443 T1889 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 971444 T1889 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1371295687356
[junit4:junit4] 2> 971445 T1889 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1371295687356/solr.xml
[junit4:junit4] 2> 971445 T1889 oasc.CoreContainer.<init> New CoreContainer 158321267
[junit4:junit4] 2> 971446 T1889 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1371295687356/'
[junit4:junit4] 2> 971446 T1889 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1371295687356/'
[junit4:junit4] 2> 971574 T1889 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 971575 T1889 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 971575 T1889 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 971576 T1889 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 971576 T1889 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 971577 T1889 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 971577 T1889 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 971578 T1889 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 971578 T1889 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 971579 T1889 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 971597 T1889 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 971598 T1889 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:61548/solr
[junit4:junit4] 2> 971598 T1889 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 971599 T1889 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 971603 T1961 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5aab22ab name:ZooKeeperConnection Watcher:127.0.0.1:61548 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 971603 T1889 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 971618 T1889 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 971632 T1889 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 971634 T1963 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4aa9a24e name:ZooKeeperConnection Watcher:127.0.0.1:61548/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 971634 T1889 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 971644 T1889 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 972645 T1912 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 972646 T1912 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:36416__",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:36416/_"}
[junit4:junit4] 2> 972649 T1889 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55762__
[junit4:junit4] 2> 972663 T1963 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 972663 T1947 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 972663 T1931 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 972664 T1889 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55762__
[junit4:junit4] 2> 972663 T1918 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 972663 T1911 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 972672 T1947 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 972672 T1918 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 972672 T1931 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 972672 T1963 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 972673 T1931 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 972672 T1911 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 972672 T1918 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 972673 T1911 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 972673 T1963 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 972674 T1947 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 972680 T1964 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 972680 T1964 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 974173 T1912 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 974174 T1912 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:55762__",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:55762/_"}
[junit4:junit4] 2> 974174 T1912 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 974175 T1912 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 974193 T1918 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 974193 T1931 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 974193 T1947 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 974193 T1911 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 974193 T1963 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 974684 T1964 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1371295687356/collection1
[junit4:junit4] 2> 974684 T1964 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 974685 T1964 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 974685 T1964 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 974686 T1964 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1371295687356/collection1/'
[junit4:junit4] 2> 974688 T1964 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1371295687356/collection1/lib/README' to classloader
[junit4:junit4] 2> 974688 T1964 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1371295687356/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 974741 T1964 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 974802 T1964 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 974903 T1964 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 974909 T1964 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 975489 T1964 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 975493 T1964 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 975495 T1964 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 975500 T1964 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 975522 T1964 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 975522 T1964 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1371295687356/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371295674316/jetty3/
[junit4:junit4] 2> 975522 T1964 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2f1632c7
[junit4:junit4] 2> 975523 T1964 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 975524 T1964 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371295674316/jetty3
[junit4:junit4] 2> 975524 T1964 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371295674316/jetty3/index/
[junit4:junit4] 2> 975524 T1964 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371295674316/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 975525 T1964 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371295674316/jetty3/index
[junit4:junit4] 2> 975529 T1964 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@418df424 lockFactory=org.apache.lucene.store.NativeFSLockFactory@28a0ab18),segFN=segments_1,generation=1}
[junit4:junit4] 2> 975529 T1964 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 975532 T1964 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 975532 T1964 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 975533 T1964 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 975534 T1964 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 975534 T1964 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 975535 T1964 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 975535 T1964 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 975536 T1964 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 975536 T1964 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 975553 T1964 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 975560 T1964 oass.SolrIndexSearcher.<init> Opening Searcher@d8c1e1b main
[junit4:junit4] 2> 975560 T1964 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371295674316/jetty3/tlog
[junit4:junit4] 2> 975562 T1964 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 975562 T1964 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 975566 T1965 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@d8c1e1b main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 975568 T1964 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 975569 T1964 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:55762/_ collection:collection1 shard:shard1
[junit4:junit4] 2> 975572 T1964 oasc.ZkController.register We are http://127.0.0.1:55762/_/collection1/ and leader is http://127.0.0.1:49863/_/collection1/
[junit4:junit4] 2> 975572 T1964 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:55762/_
[junit4:junit4] 2> 975572 T1964 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 975572 T1964 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C980 name=collection1 org.apache.solr.core.SolrCore@2c74b7fe url=http://127.0.0.1:55762/_/collection1 node=127.0.0.1:55762__ C980_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:55762__, base_url=http://127.0.0.1:55762/_}
[junit4:junit4] 2> 975573 T1966 C980 P55762 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 975573 T1964 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 975574 T1966 C980 P55762 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 975575 T1966 C980 P55762 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 975575 T1966 C980 P55762 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 975575 T1889 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 975576 T1889 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 975576 T1966 C980 P55762 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 975576 T1889 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 975599 T1921 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 975697 T1912 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 975698 T1912 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:55762__",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:55762/_"}
[junit4:junit4] 2> 975730 T1963 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 975730 T1918 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 975730 T1911 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 975730 T1931 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 975730 T1947 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 975862 T1889 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 975865 T1889 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:65155
[junit4:junit4] 2> 975866 T1889 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 975867 T1889 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 975867 T1889 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1371295691787
[junit4:junit4] 2> 975868 T1889 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1371295691787/solr.xml
[junit4:junit4] 2> 975868 T1889 oasc.CoreContainer.<init> New CoreContainer 1729505070
[junit4:junit4] 2> 975869 T1889 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1371295691787/'
[junit4:junit4] 2> 975870 T1889 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1371295691787/'
[junit4:junit4] 2> 975998 T1889 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 975999 T1889 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 975999 T1889 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 976000 T1889 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 976001 T1889 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 976001 T1889 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 976002 T1889 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 976002 T1889 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 976003 T1889 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 976003 T1889 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 976021 T1889 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 976022 T1889 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:61548/solr
[junit4:junit4] 2> 976022 T1889 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 976024 T1889 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 976026 T1978 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@78ef1a70 name:ZooKeeperConnection Watcher:127.0.0.1:61548 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 976027 T1889 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 976039 T1889 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 976052 T1889 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 976054 T1980 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@29ab13e3 name:ZooKeeperConnection Watcher:127.0.0.1:61548/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 976054 T1889 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 976064 T1889 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 976601 T1921 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 976601 T1921 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=4&state=recovering&nodeName=127.0.0.1:55762__&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1002
[junit4:junit4] 2> 977067 T1889 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:65155__
[junit4:junit4] 2> 977069 T1889 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:65155__
[junit4:junit4] 2> 977071 T1947 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 977072 T1963 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 977072 T1980 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 977072 T1963 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 977072 T1911 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 977072 T1931 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 977071 T1918 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 977073 T1931 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 977072 T1911 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 977073 T1918 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 977080 T1947 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 977086 T1981 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 977087 T1981 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 977234 T1912 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 977235 T1912 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:65155__",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:65155/_"}
[junit4:junit4] 2> 977235 T1912 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 977235 T1912 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 977268 T1963 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 977268 T1980 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 977268 T1931 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 977268 T1947 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 977268 T1918 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 977268 T1911 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 978089 T1981 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1371295691787/collection1
[junit4:junit4] 2> 978089 T1981 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 978090 T1981 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 978090 T1981 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 978091 T1981 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1371295691787/collection1/'
[junit4:junit4] 2> 978093 T1981 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1371295691787/collection1/lib/README' to classloader
[junit4:junit4] 2> 978094 T1981 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1371295691787/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 978146 T1981 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 978225 T1981 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 978326 T1981 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 978332 T1981 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> ASYNC NEW_CORE C981 name=collection1 org.apache.solr.core.SolrCore@2c74b7fe url=http://127.0.0.1:55762/_/collection1 node=127.0.0.1:55762__ C981_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:55762__, base_url=http://127.0.0.1:55762/_}
[junit4:junit4] 2> 978603 T1966 C981 P55762 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:49863/_/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 978603 T1966 C981 P55762 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:55762/_ START replicas=[http://127.0.0.1:49863/_/collection1/] nUpdates=100
[junit4:junit4] 2> 978604 T1966 C981 P55762 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 978605 T1966 C981 P55762 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 978605 T1966 C981 P55762 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 978605 T1966 C981 P55762 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 978606 T1966 C981 P55762 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 978606 T1966 C981 P55762 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:49863/_/collection1/. core=collection1
[junit4:junit4] 2> 978606 T1966 C981 P55762 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C982 name=collection1 org.apache.solr.core.SolrCore@6af9d14f url=http://127.0.0.1:49863/_/collection1 node=127.0.0.1:49863__ C982_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:49863__, base_url=http://127.0.0.1:49863/_, leader=true}
[junit4:junit4] 2> 978614 T1922 C982 P49863 oasc.SolrCore.execute [collection1] webapp=/_ path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 978620 T1923 C982 P49863 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 978623 T1923 C982 P49863 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4a75c79b lockFactory=org.apache.lucene.store.NativeFSLockFactory@48028507),segFN=segments_1,generation=1}
[junit4:junit4] 2> 978624 T1923 C982 P49863 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 978625 T1923 C982 P49863 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4a75c79b lockFactory=org.apache.lucene.store.NativeFSLockFactory@48028507),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4a75c79b lockFactory=org.apache.lucene.store.NativeFSLockFactory@48028507),segFN=segments_2,generation=2}
[junit4:junit4] 2> 978625 T1923 C982 P49863 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 978626 T1923 C982 P49863 oass.SolrIndexSearcher.<init> Opening Searcher@52d561c8 realtime
[junit4:junit4] 2> 978626 T1923 C982 P49863 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 978627 T1923 C982 P49863 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 978627 T1966 C981 P55762 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 978628 T1966 C981 P55762 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 978631 T1924 C982 P49863 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 978631 T1924 C982 P49863 oasc.SolrCore.execute [collection1] webapp=/_ path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=2
[junit4:junit4] 2> 978632 T1966 C981 P55762 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 978632 T1966 C981 P55762 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 978632 T1966 C981 P55762 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 978634 T1924 C982 P49863 oasc.SolrCore.execute [collection1] webapp=/_ path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 978635 T1966 C981 P55762 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 978637 T1966 C981 P55762 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371295674316/jetty3/index.20130615052814825
[junit4:junit4] 2> 978637 T1966 C981 P55762 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@2fb51d9b lockFactory=org.apache.lucene.store.NativeFSLockFactory@e4387f4) fullCopy=false
[junit4:junit4] 2> 978640 T1924 C982 P49863 oasc.SolrCore.execute [collection1] webapp=/_ path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 978641 T1966 C981 P55762 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 978642 T1966 C981 P55762 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 978643 T1966 C981 P55762 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 978645 T1966 C981 P55762 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@418df424 lockFactory=org.apache.lucene.store.NativeFSLockFactory@28a0ab18),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@418df424 lockFactory=org.apache.lucene.store.NativeFSLockFactory@28a0ab18),segFN=segments_2,generation=2}
[junit4:junit4] 2> 978646 T1966 C981 P55762 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 978646 T1966 C981 P55762 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 978646 T1966 C981 P55762 oass.SolrIndexSearcher.<init> Opening Searcher@4c7d571d main
[junit4:junit4] 2> 978648 T1965 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4c7d571d main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 978648 T1966 C981 P55762 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371295674316/jetty3/index.20130615052814825 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371295674316/jetty3/index.20130615052814825;done=true>>]
[junit4:junit4] 2> 978649 T1966 C981 P55762 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371295674316/jetty3/index.20130615052814825
[junit4:junit4] 2> 978649 T1966 C981 P55762 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371295674316/jetty3/index.20130615052814825
[junit4:junit4] 2> 978649 T1966 C981 P55762 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 978649 T1966 C981 P55762 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 978650 T1966 C981 P55762 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 978650 T1966 C981 P55762 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 978651 T1966 C981 P55762 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 978772 T1912 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 978773 T1912 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:55762__",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:55762/_"}
[junit4:junit4] 2> 978839 T1963 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 978840 T1947 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 978839 T1911 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 978839 T1918 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 978839 T1980 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 978839 T1931 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 978904 T1981 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 978908 T1981 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 978911 T1981 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 978916 T1981 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 978937 T1981 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 978937 T1981 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1371295691787/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371295674316/jetty4/
[junit4:junit4] 2> 978937 T1981 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2f1632c7
[junit4:junit4] 2> 978938 T1981 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 978939 T1981 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371295674316/jetty4
[junit4:junit4] 2> 978939 T1981 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371295674316/jetty4/index/
[junit4:junit4] 2> 978939 T1981 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371295674316/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 978940 T1981 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371295674316/jetty4/index
[junit4:junit4] 2> 978949 T1981 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@82231e0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@bc41827),segFN=segments_1,generation=1}
[junit4:junit4] 2> 978950 T1981 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 978953 T1981 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 978954 T1981 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 978954 T1981 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 978955 T1981 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 978956 T1981 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 978956 T1981 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 978957 T1981 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 978958 T1981 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 978958 T1981 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 978975 T1981 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 978982 T1981 oass.SolrIndexSearcher.<init> Opening Searcher@213bee7d main
[junit4:junit4] 2> 978983 T1981 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371295674316/jetty4/tlog
[junit4:junit4] 2> 978984 T1981 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 978984 T1981 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 978989 T1984 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@213bee7d main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 978992 T1981 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 978992 T1981 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:65155/_ collection:collection1 shard:shard2
[junit4:junit4] 2> 978997 T1981 oasc.ZkController.register We are http://127.0.0.1:65155/_/collection1/ and leader is http://127.0.0.1:36416/_/collection1/
[junit4:junit4] 2> 978998 T1981 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:65155/_
[junit4:junit4] 2> 978998 T1981 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 978998 T1981 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C983 name=collection1 org.apache.solr.core.SolrCore@6c4d1767 url=http://127.0.0.1:65155/_/collection1 node=127.0.0.1:65155__ C983_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:65155__, base_url=http://127.0.0.1:65155/_}
[junit4:junit4] 2> 978999 T1985 C983 P65155 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 978999 T1981 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 978999 T1985 C983 P65155 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 979000 T1985 C983 P65155 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 979000 T1985 C983 P65155 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 979000 T1889 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 979001 T1889 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 979001 T1889 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 979006 T1985 C983 P65155 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 979019 T1889 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 979021 T1937 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 979021 T1889 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 2> 979022 T1889 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 2> 979023 T1889 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 980025 T1889 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 980361 T1912 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 980362 T1912 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:65155__",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:65155/_"}
[junit4:junit4] 2> 980380 T1918 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 980380 T1947 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 980381 T1931 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 980381 T1980 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 980380 T1911 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 980381 T1963 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 981023 T1937 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 981023 T1937 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=5&state=recovering&nodeName=127.0.0.1:65155__&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2002
[junit4:junit4] 2> 981027 T1889 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 982029 T1889 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C983_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:65155__, base_url=http://127.0.0.1:65155/_}
[junit4:junit4] 2> 983025 T1985 C983 P65155 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:36416/_/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 983025 T1985 C983 P65155 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:65155/_ START replicas=[http://127.0.0.1:36416/_/collection1/] nUpdates=100
[junit4:junit4] 2> 983026 T1985 C983 P65155 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 983026 T1985 C983 P65155 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 983026 T1985 C983 P65155 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 983026 T1985 C983 P65155 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 983027 T1985 C983 P65155 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 983027 T1985 C983 P65155 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:36416/_/collection1/. core=collection1
[junit4:junit4] 2> 983028 T1985 C983 P65155 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 983031 T1889 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> ASYNC NEW_CORE C984 name=collection1 org.apache.solr.core.SolrCore@2e3fb5b3 url=http://127.0.0.1:36416/_/collection1 node=127.0.0.1:36416__ C984_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:36416__, base_url=http://127.0.0.1:36416/_, leader=true}
[junit4:junit4] 2> 983052 T1938 C984 P36416 oasc.SolrCore.execute [collection1] webapp=/_ path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 983058 T1939 C984 P36416 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 983061 T1939 C984 P36416 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1d3697a6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2ee6f0f2),segFN=segments_1,generation=1}
[junit4:junit4] 2> 983061 T1939 C984 P36416 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 983062 T1939 C984 P36416 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1d3697a6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2ee6f0f2),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1d3697a6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2ee6f0f2),segFN=segments_2,generation=2}
[junit4:junit4] 2> 983063 T1939 C984 P36416 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 983063 T1939 C984 P36416 oass.SolrIndexSearcher.<init> Opening Searcher@1c0951a2 realtime
[junit4:junit4] 2> 983064 T1939 C984 P36416 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 983064 T1939 C984 P36416 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> ASYNC NEW_CORE C985 name=collection1 org.apache.solr.core.SolrCore@6c4d1767 url=http://127.0.0.1:65155/_/collection1 node=127.0.0.1:65155__ C985_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:65155__, base_url=http://127.0.0.1:65155/_}
[junit4:junit4] 2> 983065 T1985 C985 P65155 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 983065 T1985 C985 P65155 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 983068 T1940 C984 P36416 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 983068 T1940 C984 P36416 oasc.SolrCore.execute [collection1] webapp=/_ path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 983069 T1985 C985 P65155 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 983069 T1985 C985 P65155 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 983069 T1985 C985 P65155 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 983071 T1940 C984 P36416 oasc.SolrCore.execute [collection1] webapp=/_ path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 983072 T1985 C985 P65155 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 983073 T1985 C985 P65155 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371295674316/jetty4/index.20130615052819262
[junit4:junit4] 2> 983073 T1985 C985 P65155 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@4810ac80 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4ffc2307) fullCopy=false
[junit4:junit4] 2> 983076 T1940 C984 P36416 oasc.SolrCore.execute [collection1] webapp=/_ path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 983077 T1985 C985 P65155 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 983078 T1985 C985 P65155 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 983079 T1985 C985 P65155 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 983080 T1985 C985 P65155 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@82231e0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@bc41827),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@82231e0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@bc41827),segFN=segments_2,generation=2}
[junit4:junit4] 2> 983081 T1985 C985 P65155 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 983081 T1985 C985 P65155 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 983081 T1985 C985 P65155 oass.SolrIndexSearcher.<init> Opening Searcher@5375f9f5 main
[junit4:junit4] 2> 983083 T1984 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5375f9f5 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 983083 T1985 C985 P65155 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371295674316/jetty4/index.20130615052819262 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371295674316/jetty4/index.20130615052819262;done=true>>]
[junit4:junit4] 2> 983083 T1985 C985 P65155 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371295674316/jetty4/index.20130615052819262
[junit4:junit4] 2> 983084 T1985 C985 P65155 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371295674316/jetty4/index.20130615052819262
[junit4:junit4] 2> 983084 T1985 C985 P65155 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 983084 T1985 C985 P65155 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 983084 T1985 C985 P65155 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 983085 T1985 C985 P65155 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 983086 T1985 C985 P65155 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 983386 T1912 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 983387 T1912 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:65155__",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:65155/_"}
[junit4:junit4] 2> 983391 T1963 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 983391 T1980 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 983391 T1911 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 983391 T1931 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 983391 T1947 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 983391 T1918 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 984033 T1889 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 984034 T1889 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> ASYNC NEW_CORE C986 name=collection1 org.apache.solr.core.SolrCore@ba26977 url=http://127.0.0.1:20041/_/collection1 node=127.0.0.1:20041__ C986_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:20041__, base_url=http://127.0.0.1:20041/_, leader=true}
[junit4:junit4] 2> 984045 T1901 C986 P20041 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 984048 T1901 C986 P20041 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6407e189 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7abaaca0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 984049 T1901 C986 P20041 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 984050 T1901 C986 P20041 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6407e189 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7abaaca0),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6407e189 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7abaaca0),segFN=segments_2,generation=2}
[junit4:junit4] 2> 984050 T1901 C986 P20041 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 984051 T1901 C986 P20041 oass.SolrIndexSearcher.<init> Opening Searcher@3db5ece0 main
[junit4:junit4] 2> 984051 T1901 C986 P20041 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 984052 T1915 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3db5ece0 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 984053 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 8
[junit4:junit4] 2> 984065 T1941 C984 P36416 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 984066 T1941 C984 P36416 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1d3697a6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2ee6f0f2),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1d3697a6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2ee6f0f2),segFN=segments_3,generation=3}
[junit4:junit4] 2> 984067 T1941 C984 P36416 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 984067 T1941 C984 P36416 oass.SolrIndexSearcher.<init> Opening Searcher@3d79d9d7 main
[junit4:junit4] 2> 984068 T1941 C984 P36416 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 984068 T1949 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3d79d9d7 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 984069 T1941 C984 P36416 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:49863/_/collection1/, StdNode: http://127.0.0.1:55762/_/collection1/, StdNode: http://127.0.0.1:65155/_/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> ASYNC NEW_CORE C987 name=collection1 org.apache.solr.core.SolrCore@6af9d14f url=http://127.0.0.1:49863/_/collection1 node=127.0.0.1:49863__ C987_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:49863__, base_url=http://127.0.0.1:49863/_, leader=true}
[junit4:junit4] 2> 984073 T1925 C987 P49863 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 984076 T1925 C987 P49863 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4a75c79b lockFactory=org.apache.lucene.store.NativeFSLockFactory@48028507),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4a75c79b lockFactory=org.apache.lucene.store.NativeFSLockFactory@48028507),segFN=segments_3,generation=3}
[junit4:junit4] 2> 984076 T1925 C987 P49863 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 984077 T1925 C987 P49863 oass.SolrIndexSearcher.<init> Opening Searcher@6daffbe4 main
[junit4:junit4] 2> 984077 T1925 C987 P49863 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 984078 T1933 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6daffbe4 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 984078 T1925 C987 P49863 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> C985_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:65155__, base_url=http://127.0.0.1:65155/_}
[junit4:junit4] 2> 984082 T1970 C985 P65155 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> ASYNC NEW_CORE C988 name=collection1 org.apache.solr.core.SolrCore@2c74b7fe url=http://127.0.0.1:55762/_/collection1 node=127.0.0.1:55762__ C988_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:55762__, base_url=http://127.0.0.1:55762/_}
[junit4:junit4] 2> 984082 T1953 C988 P55762 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 984084 T1970 C985 P65155 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@82231e0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@bc41827),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@82231e0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@bc41827),segFN=segments_3,generation=3}
[junit4:junit4] 2> 984084 T1953 C988 P55762 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@418df424 lockFactory=org.apache.lucene.store.NativeFSLockFactory@28a0ab18),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@418df424 lockFactory=org.apache.lucene.store.NativeFSLockFactory@28a0ab18),segFN=segments_3,generation=3}
[junit4:junit4] 2> 984084 T1970 C985 P65155 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 984085 T1953 C988 P55762 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 984086 T1970 C985 P65155 oass.SolrIndexSearcher.<init> Opening Searcher@3c6a82 main
[junit4:junit4] 2> 984087 T1953 C988 P55762 oass.SolrIndexSearcher.<init> Opening Searcher@11b5aad0 main
[junit4:junit4] 2> 984087 T1970 C985 P65155 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 984087 T1953 C988 P55762 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 984088 T1965 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@11b5aad0 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 984088 T1984 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3c6a82 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 984089 T1953 C988 P55762 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 984089 T1970 C985 P65155 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 984090 T1941 C984 P36416 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 25
[junit4:junit4] 2> 984091 T1889 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 984094 T1926 C987 P49863 oasc.SolrCore.execute [collection1] webapp=/_ path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 984097 T1954 C988 P55762 oasc.SolrCore.execute [collection1] webapp=/_ path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 984100 T1942 C984 P36416 oasc.SolrCore.execute [collection1] webapp=/_ path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 984102 T1971 C985 P65155 oasc.SolrCore.execute [collection1] webapp=/_ path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 986107 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1437907762330730496)} 0 2
[junit4:junit4] 2> 986115 T1970 C985 P65155 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={update.distrib=FROMLEADER&_version_=-1437907762334924800&update.from=http://127.0.0.1:36416/_/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1437907762334924800)} 0 1
[junit4:junit4] 2> 986120 T1955 C988 P55762 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={update.distrib=FROMLEADER&_version_=-1437907762339119104&update.from=http://127.0.0.1:49863/_/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1437907762339119104)} 0 1
[junit4:junit4] 2> 986121 T1925 C987 P49863 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={update.distrib=TOLEADER&wt=javabin&version=2} {deleteByQuery=*:* (-1437907762339119104)} 0 7
[junit4:junit4] 2> 986122 T1941 C984 P36416 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1437907762334924800)} 0 12
[junit4:junit4] 2> 986126 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[0 (1437907762350653440)]} 0 1
[junit4:junit4] 2> 986135 T1955 C988 P55762 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:49863/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1437907762356944896)]} 0 1
[junit4:junit4] 2> 986135 T1925 C987 P49863 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:36416/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[0 (1437907762356944896)]} 0 4
[junit4:junit4] 2> 986136 T1941 C984 P36416 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[0]} 0 7
[junit4:junit4] 2> 986139 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[1 (1437907762365333504)]} 0 0
[junit4:junit4] 2> 986146 T1955 C988 P55762 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:49863/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1437907762370576384)]} 0 0
[junit4:junit4] 2> 986147 T1925 C987 P49863 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:36416/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[1 (1437907762370576384)]} 0 3
[junit4:junit4] 2> 986148 T1941 C984 P36416 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[1]} 0 6
[junit4:junit4] 2> 986150 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[2 (1437907762376867840)]} 0 0
[junit4:junit4] 2> 986158 T1970 C985 P65155 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:36416/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[2 (1437907762382110720)]} 0 1
[junit4:junit4] 2> 986158 T1943 C984 P36416 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:49863/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[2 (1437907762382110720)]} 0 4
[junit4:junit4] 2> 986159 T1927 C987 P49863 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[2]} 0 7
[junit4:junit4] 2> 986163 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[3 (1437907762389450752)]} 0 1
[junit4:junit4] 2> 986169 T1970 C985 P65155 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:36416/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[3 (1437907762393645056)]} 0 0
[junit4:junit4] 2> 986170 T1941 C984 P36416 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[3 (1437907762393645056)]} 0 4
[junit4:junit4] 2> 986173 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[4 (1437907762400985088)]} 0 0
[junit4:junit4] 2> 986178 T1955 C988 P55762 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:49863/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[4 (1437907762404130816)]} 0 0
[junit4:junit4] 2> 986179 T1927 C987 P49863 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[4 (1437907762404130816)]} 0 3
[junit4:junit4] 2> 986182 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[5 (1437907762410422272)]} 0 0
[junit4:junit4] 2> 986189 T1970 C985 P65155 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:36416/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[5 (1437907762415665152)]} 0 0
[junit4:junit4] 2> 986190 T1943 C984 P36416 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:49863/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[5 (1437907762415665152)]} 0 3
[junit4:junit4] 2> 986191 T1927 C987 P49863 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[5]} 0 6
[junit4:junit4] 2> 986193 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[6 (1437907762421956608)]} 0 0
[junit4:junit4] 2> 986200 T1970 C985 P65155 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:36416/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[6 (1437907762427199488)]} 0 0
[junit4:junit4] 2> 986201 T1943 C984 P36416 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:49863/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[6 (1437907762427199488)]} 0 3
[junit4:junit4] 2> 986201 T1927 C987 P49863 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[6]} 0 5
[junit4:junit4] 2> 986204 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[7 (1437907762433490944)]} 0 0
[junit4:junit4] 2> 986211 T1970 C985 P65155 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:36416/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[7 (1437907762438733824)]} 0 0
[junit4:junit4] 2> 986212 T1943 C984 P36416 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:49863/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[7 (1437907762438733824)]} 0 3
[junit4:junit4] 2> 986212 T1927 C987 P49863 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[7]} 0 5
[junit4:junit4] 2> 986215 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[8 (1437907762445025280)]} 0 0
[junit4:junit4] 2> 986222 T1955 C988 P55762 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:49863/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[8 (1437907762448171008)]} 0 1
[junit4:junit4] 2> 986223 T1927 C987 P49863 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[8 (1437907762448171008)]} 0 5
[junit4:junit4] 2> 986225 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[9 (1437907762455511040)]} 0 0
[junit4:junit4] 2> 986232 T1970 C985 P65155 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:36416/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[9 (1437907762460753920)]} 0 0
[junit4:junit4] 2> 986233 T1943 C984 P36416 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:49863/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[9 (1437907762460753920)]} 0 3
[junit4:junit4] 2> 986233 T1927 C987 P49863 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[9]} 0 5
[junit4:junit4] 2> 986236 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[10 (1437907762467045376)]} 0 0
[junit4:junit4] 2> 986242 T1955 C988 P55762 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:49863/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10 (1437907762470191104)]} 0 0
[junit4:junit4] 2> 986243 T1927 C987 P49863 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[10 (1437907762470191104)]} 0 4
[junit4:junit4] 2> 986246 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[11 (1437907762477531136)]} 0 0
[junit4:junit4] 2> 986254 T1955 C988 P55762 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:49863/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[11 (1437907762482774016)]} 0 0
[junit4:junit4] 2> 986255 T1925 C987 P49863 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:36416/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[11 (1437907762482774016)]} 0 4
[junit4:junit4] 2> 986256 T1941 C984 P36416 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[11]} 0 7
[junit4:junit4] 2> 986258 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[12 (1437907762490114048)]} 0 0
[junit4:junit4] 2> 986265 T1955 C988 P55762 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:49863/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[12 (1437907762495356928)]} 0 0
[junit4:junit4] 2> 986266 T1925 C987 P49863 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:36416/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[12 (1437907762495356928)]} 0 3
[junit4:junit4] 2> 986267 T1941 C984 P36416 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[12]} 0 6
[junit4:junit4] 2> 986269 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[13 (1437907762501648384)]} 0 0
[junit4:junit4] 2> 986274 T1955 C988 P55762 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:49863/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[13 (1437907762504794112)]} 0 0
[junit4:junit4] 2> 986275 T1927 C987 P49863 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[13 (1437907762504794112)]} 0 3
[junit4:junit4] 2> 986278 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[14 (1437907762511085568)]} 0 0
[junit4:junit4] 2> 986286 T1955 C988 P55762 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:49863/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[14 (1437907762516328448)]} 0 1
[junit4:junit4] 2> 986286 T1925 C987 P49863 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:36416/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[14 (1437907762516328448)]} 0 3
[junit4:junit4] 2> 986287 T1941 C984 P36416 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[14]} 0 6
[junit4:junit4] 2> 986290 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[15 (1437907762523668480)]} 0 0
[junit4:junit4] 2> 986298 T1955 C988 P55762 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:49863/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[15 (1437907762528911360)]} 0 0
[junit4:junit4] 2> 986299 T1925 C987 P49863 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:36416/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[15 (1437907762528911360)]} 0 4
[junit4:junit4] 2> 986299 T1941 C984 P36416 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[15]} 0 6
[junit4:junit4] 2> 986302 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[16 (1437907762536251392)]} 0 0
[junit4:junit4] 2> 986307 T1955 C988 P55762 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:49863/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[16 (1437907762539397120)]} 0 0
[junit4:junit4] 2> 986308 T1927 C987 P49863 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[16 (1437907762539397120)]} 0 3
[junit4:junit4] 2> 986311 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[17 (1437907762545688576)]} 0 0
[junit4:junit4] 2> 986319 T1970 C985 P65155 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:36416/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[17 (1437907762550931456)]} 0 0
[junit4:junit4] 2> 986320 T1943 C984 P36416 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:49863/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[17 (1437907762550931456)]} 0 4
[junit4:junit4] 2> 986321 T1927 C987 P49863 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[17]} 0 7
[junit4:junit4] 2> 986323 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[18 (1437907762558271488)]} 0 0
[junit4:junit4] 2> 986328 T1970 C985 P65155 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:36416/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[18 (1437907762561417216)]} 0 0
[junit4:junit4] 2> 986329 T1941 C984 P36416 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[18 (1437907762561417216)]} 0 3
[junit4:junit4] 2> 986332 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[19 (1437907762567708672)]} 0 0
[junit4:junit4] 2> 986340 T1970 C985 P65155 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:36416/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[19 (1437907762572951552)]} 0 0
[junit4:junit4] 2> 986341 T1943 C984 P36416 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:49863/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[19 (1437907762572951552)]} 0 4
[junit4:junit4] 2> 986342 T1927 C987 P49863 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[19]} 0 7
[junit4:junit4] 2> 986344 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[20 (1437907762580291584)]} 0 0
[junit4:junit4] 2> 986349 T1955 C988 P55762 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:49863/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[20 (1437907762583437312)]} 0 0
[junit4:junit4] 2> 986350 T1927 C987 P49863 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[20 (1437907762583437312)]} 0 3
[junit4:junit4] 2> 986353 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[21 (1437907762589728768)]} 0 0
[junit4:junit4] 2> 986358 T1970 C985 P65155 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:36416/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[21 (1437907762592874496)]} 0 0
[junit4:junit4] 2> 986359 T1941 C984 P36416 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[21 (1437907762592874496)]} 0 3
[junit4:junit4] 2> 986362 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[22 (1437907762599165952)]} 0 0
[junit4:junit4] 2> 986367 T1955 C988 P55762 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:49863/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[22 (1437907762602311680)]} 0 0
[junit4:junit4] 2> 986368 T1927 C987 P49863 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[22 (1437907762602311680)]} 0 3
[junit4:junit4] 2> 986371 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[23 (1437907762608603136)]} 0 0
[junit4:junit4] 2> 986376 T1970 C985 P65155 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:36416/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[23 (1437907762611748864)]} 0 0
[junit4:junit4] 2> 986377 T1941 C984 P36416 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[23 (1437907762611748864)]} 0 3
[junit4:junit4] 2> 986380 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[24 (1437907762618040320)]} 0 0
[junit4:junit4] 2> 986385 T1955 C988 P55762 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:49863/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[24 (1437907762621186048)]} 0 0
[junit4:junit4] 2> 986386 T1927 C987 P49863 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[24 (1437907762621186048)]} 0 3
[junit4:junit4] 2> 986389 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[25 (1437907762627477504)]} 0 0
[junit4:junit4] 2> 986394 T1970 C985 P65155 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:36416/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[25 (1437907762630623232)]} 0 0
[junit4:junit4] 2> 986395 T1941 C984 P36416 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[25 (1437907762630623232)]} 0 3
[junit4:junit4] 2> 986398 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[26 (1437907762636914688)]} 0 0
[junit4:junit4] 2> 986403 T1970 C985 P65155 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:36416/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[26 (1437907762640060416)]} 0 0
[junit4:junit4] 2> 986404 T1941 C984 P36416 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[26 (1437907762640060416)]} 0 3
[junit4:junit4] 2> 986407 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[27 (1437907762646351872)]} 0 0
[junit4:junit4] 2> 986414 T1955 C988 P55762 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:49863/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[27 (1437907762651594752)]} 0 0
[junit4:junit4] 2> 986415 T1925 C987 P49863 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:36416/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[27 (1437907762651594752)]} 0 3
[junit4:junit4] 2> 986416 T1941 C984 P36416 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[27]} 0 6
[junit4:junit4] 2> 986418 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[28 (1437907762657886208)]} 0 0
[junit4:junit4] 2> 986425 T1955 C988 P55762 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:49863/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[28 (1437907762663129088)]} 0 0
[junit4:junit4] 2> 986426 T1925 C987 P49863 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:36416/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[28 (1437907762663129088)]} 0 3
[junit4:junit4] 2> 986427 T1941 C984 P36416 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[28]} 0 6
[junit4:junit4] 2> 986429 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[29 (1437907762669420544)]} 0 0
[junit4:junit4] 2> 986434 T1970 C985 P65155 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:36416/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[29 (1437907762672566272)]} 0 0
[junit4:junit4] 2> 986435 T1941 C984 P36416 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[29 (1437907762672566272)]} 0 3
[junit4:junit4] 2> 986438 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[30 (1437907762678857728)]} 0 0
[junit4:junit4] 2> 986443 T1970 C985 P65155 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:36416/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[30 (1437907762682003456)]} 0 0
[junit4:junit4] 2> 986444 T1941 C984 P36416 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[30 (1437907762682003456)]} 0 3
[junit4:junit4] 2> 986447 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[31 (1437907762688294912)]} 0 0
[junit4:junit4] 2> 986454 T1970 C985 P65155 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:36416/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[31 (1437907762693537792)]} 0 0
[junit4:junit4] 2> 986455 T1943 C984 P36416 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:49863/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[31 (1437907762693537792)]} 0 3
[junit4:junit4] 2> 986455 T1927 C987 P49863 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[31]} 0 5
[junit4:junit4] 2> 986458 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[32 (1437907762699829248)]} 0 0
[junit4:junit4] 2> 986465 T1955 C988 P55762 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:49863/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[32 (1437907762705072128)]} 0 0
[junit4:junit4] 2> 986466 T1925 C987 P49863 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:36416/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[32 (1437907762705072128)]} 0 3
[junit4:junit4] 2> 986466 T1941 C984 P36416 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[32]} 0 5
[junit4:junit4] 2> 986469 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[33 (1437907762711363584)]} 0 0
[junit4:junit4] 2> 986474 T1970 C985 P65155 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:36416/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[33 (1437907762714509312)]} 0 0
[junit4:junit4] 2> 986475 T1941 C984 P36416 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[33 (1437907762714509312)]} 0 3
[junit4:junit4] 2> 986478 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[34 (1437907762720800768)]} 0 0
[junit4:junit4] 2> 986483 T1955 C988 P55762 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:49863/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[34 (1437907762723946496)]} 0 0
[junit4:junit4] 2> 986484 T1927 C987 P49863 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[34 (1437907762723946496)]} 0 3
[junit4:junit4] 2> 986487 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[35 (1437907762730237952)]} 0 0
[junit4:junit4] 2> 986492 T1955 C988 P55762 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:49863/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[35 (1437907762733383680)]} 0 0
[junit4:junit4] 2> 986493 T1927 C987 P49863 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[35 (1437907762733383680)]} 0 3
[junit4:junit4] 2> 986496 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[36 (1437907762739675136)]} 0 0
[junit4:junit4] 2> 986501 T1955 C988 P55762 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:49863/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[36 (1437907762742820864)]} 0 0
[junit4:junit4] 2> 986502 T1927 C987 P49863 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[36 (1437907762742820864)]} 0 3
[junit4:junit4] 2> 986505 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[37 (1437907762749112320)]} 0 0
[junit4:junit4] 2> 986512 T1970 C985 P65155 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:36416/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[37 (1437907762754355200)]} 0 0
[junit4:junit4] 2> 986513 T1943 C984 P36416 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:49863/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[37 (1437907762754355200)]} 0 3
[junit4:junit4] 2> 986514 T1927 C987 P49863 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[37]} 0 6
[junit4:junit4] 2> 986516 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[38 (1437907762760646656)]} 0 0
[junit4:junit4] 2> 986523 T1955 C988 P55762 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:49863/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[38 (1437907762765889536)]} 0 0
[junit4:junit4] 2> 986524 T1925 C987 P49863 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:36416/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[38 (1437907762765889536)]} 0 3
[junit4:junit4] 2> 986525 T1941 C984 P36416 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[38]} 0 6
[junit4:junit4] 2> 986527 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[39 (1437907762772180992)]} 0 0
[junit4:junit4] 2> 986532 T1970 C985 P65155 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:36416/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[39 (1437907762775326720)]} 0 0
[junit4:junit4] 2> 986533 T1941 C984 P36416 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[39 (1437907762775326720)]} 0 3
[junit4:junit4] 2> 986536 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[40 (1437907762781618176)]} 0 0
[junit4:junit4] 2> 986541 T1955 C988 P55762 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:49863/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[40 (1437907762784763904)]} 0 0
[junit4:junit4] 2> 986542 T1927 C987 P49863 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[40 (1437907762784763904)]} 0 3
[junit4:junit4] 2> 986545 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[41 (1437907762791055360)]} 0 0
[junit4:junit4] 2> 986550 T1955 C988 P55762 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:49863/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[41 (1437907762794201088)]} 0 0
[junit4:junit4] 2> 986551 T1927 C987 P49863 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[41 (1437907762794201088)]} 0 3
[junit4:junit4] 2> 986554 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[42 (1437907762800492544)]} 0 0
[junit4:junit4] 2> 986561 T1955 C988 P55762 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:49863/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[42 (1437907762805735424)]} 0 0
[junit4:junit4] 2> 986562 T1925 C987 P49863 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:36416/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[42 (1437907762805735424)]} 0 3
[junit4:junit4] 2> 986563 T1941 C984 P36416 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[42]} 0 6
[junit4:junit4] 2> 986565 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[43 (1437907762812026880)]} 0 0
[junit4:junit4] 2> 986572 T1955 C988 P55762 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:49863/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[43 (1437907762817269760)]} 0 0
[junit4:junit4] 2> 986573 T1925 C987 P49863 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:36416/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[43 (1437907762817269760)]} 0 3
[junit4:junit4] 2> 986574 T1941 C984 P36416 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[43]} 0 6
[junit4:junit4] 2> 986576 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[44 (1437907762823561216)]} 0 0
[junit4:junit4] 2> 986583 T1955 C988 P55762 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:49863/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[44 (1437907762828804096)]} 0 0
[junit4:junit4] 2> 986584 T1925 C987 P49863 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:36416/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[44 (1437907762828804096)]} 0 3
[junit4:junit4] 2> 986585 T1941 C984 P36416 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[44]} 0 6
[junit4:junit4] 2> 986587 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[45 (1437907762835095552)]} 0 0
[junit4:junit4] 2> 986594 T1970 C985 P65155 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:36416/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[45 (1437907762840338432)]} 0 0
[junit4:junit4] 2> 986595 T1943 C984 P36416 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:49863/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[45 (1437907762840338432)]} 0 3
[junit4:junit4] 2> 986596 T1927 C987 P49863 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[45]} 0 6
[junit4:junit4] 2> 986598 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[46 (1437907762846629888)]} 0 0
[junit4:junit4] 2> 986605 T1955 C988 P55762 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:49863/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[46 (1437907762851872768)]} 0 0
[junit4:junit4] 2> 986606 T1925 C987 P49863 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:36416/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[46 (1437907762851872768)]} 0 3
[junit4:junit4] 2> 986607 T1941 C984 P36416 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[46]} 0 6
[junit4:junit4] 2> 986609 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[47 (1437907762858164224)]} 0 0
[junit4:junit4] 2> 986614 T1955 C988 P55762 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:49863/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[47 (1437907762861309952)]} 0 0
[junit4:junit4] 2> 986615 T1927 C987 P49863 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[47 (1437907762861309952)]} 0 3
[junit4:junit4] 2> 986618 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[48 (1437907762867601408)]} 0 0
[junit4:junit4] 2> 986623 T1955 C988 P55762 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:49863/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[48 (1437907762870747136)]} 0 0
[junit4:junit4] 2> 986624 T1927 C987 P49863 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[48 (1437907762870747136)]} 0 3
[junit4:junit4] 2> 986627 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[49 (1437907762877038592)]} 0 0
[junit4:junit4] 2> 986634 T1955 C988 P55762 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:49863/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[49 (1437907762882281472)]} 0 0
[junit4:junit4] 2> 986635 T1925 C987 P49863 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:36416/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[49 (1437907762882281472)]} 0 3
[junit4:junit4] 2> 986636 T1941 C984 P36416 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[49]} 0 5
[junit4:junit4] 2> 986638 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[50 (1437907762888572928)]} 0 0
[junit4:junit4] 2> 986643 T1955 C988 P55762 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:49863/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[50 (1437907762891718656)]} 0 0
[junit4:junit4] 2> 986644 T1927 C987 P49863 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[50 (1437907762891718656)]} 0 3
[junit4:junit4] 2> 986647 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[51 (1437907762898010112)]} 0 0
[junit4:junit4] 2> 986654 T1955 C988 P55762 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:49863/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[51 (1437907762903252992)]} 0 0
[junit4:junit4] 2> 986655 T1925 C987 P49863 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:36416/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[51 (1437907762903252992)]} 0 3
[junit4:junit4] 2> 986656 T1941 C984 P36416 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[51]} 0 6
[junit4:junit4] 2> 986658 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[52 (1437907762909544448)]} 0 0
[junit4:junit4] 2> 986665 T1955 C988 P55762 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:49863/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[52 (1437907762914787328)]} 0 0
[junit4:junit4] 2> 986666 T1925 C987 P49863 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:36416/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[52 (1437907762914787328)]} 0 3
[junit4:junit4] 2> 986666 T1941 C984 P36416 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[52]} 0 5
[junit4:junit4] 2> 986669 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[53 (1437907762921078784)]} 0 0
[junit4:junit4] 2> 986676 T1970 C985 P65155 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:36416/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[53 (1437907762926321664)]} 0 0
[junit4:junit4] 2> 986677 T1943 C984 P36416 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:49863/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[53 (1437907762926321664)]} 0 3
[junit4:junit4] 2> 986678 T1927 C987 P49863 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[53]} 0 6
[junit4:junit4] 2> 986680 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[54 (1437907762932613120)]} 0 0
[junit4:junit4] 2> 986687 T1955 C988 P55762 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:49863/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[54 (1437907762937856000)]} 0 0
[junit4:junit4] 2> 986688 T1925 C987 P49863 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:36416/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[54 (1437907762937856000)]} 0 3
[junit4:junit4] 2> 986689 T1941 C984 P36416 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[54]} 0 6
[junit4:junit4] 2> 986691 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[55 (1437907762944147456)]} 0 0
[junit4:junit4] 2> 986698 T1955 C988 P55762 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:49863/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[55 (1437907762949390336)]} 0 0
[junit4:junit4] 2> 986699 T1925 C987 P49863 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:36416/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[55 (1437907762949390336)]} 0 3
[junit4:junit4] 2> 986699 T1941 C984 P36416 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[55]} 0 5
[junit4:junit4] 2> 986702 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[56 (1437907762955681792)]} 0 0
[junit4:junit4] 2> 986710 T1970 C985 P65155 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:36416/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[56 (1437907762960924672)]} 0 0
[junit4:junit4] 2> 986711 T1943 C984 P36416 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:49863/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[56 (1437907762960924672)]} 0 4
[junit4:junit4] 2> 986712 T1927 C987 P49863 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[56]} 0 7
[junit4:junit4] 2> 986714 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[57 (1437907762968264704)]} 0 0
[junit4:junit4] 2> 986719 T1970 C985 P65155 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:36416/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[57 (1437907762971410432)]} 0 0
[junit4:junit4] 2> 986720 T1941 C984 P36416 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[57 (1437907762971410432)]} 0 3
[junit4:junit4] 2> 986723 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[58 (1437907762977701888)]} 0 0
[junit4:junit4] 2> 986728 T1970 C985 P65155 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:36416/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[58 (1437907762980847616)]} 0 0
[junit4:junit4] 2> 986729 T1941 C984 P36416 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[58 (1437907762980847616)]} 0 3
[junit4:junit4] 2> 986732 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[59 (1437907762987139072)]} 0 0
[junit4:junit4] 2> 986739 T1955 C988 P55762 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:49863/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[59 (1437907762992381952)]} 0 0
[junit4:junit4] 2> 986740 T1925 C987 P49863 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:36416/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[59 (1437907762992381952)]} 0 3
[junit4:junit4] 2> 986741 T1941 C984 P36416 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[59]} 0 6
[junit4:junit4] 2> 986743 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[60 (1437907762998673408)]} 0 0
[junit4:junit4] 2> 986750 T1970 C985 P65155 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:36416/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[60 (1437907763003916288)]} 0 0
[junit4:junit4] 2> 986751 T1943 C984 P36416 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:49863/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[60 (1437907763003916288)]} 0 3
[junit4:junit4] 2> 986751 T1927 C987 P49863 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[60]} 0 5
[junit4:junit4] 2> 986754 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[61 (1437907763010207744)]} 0 0
[junit4:junit4] 2> 986761 T1955 C988 P55762 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:49863/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[61 (1437907763015450624)]} 0 0
[junit4:junit4] 2> 986762 T1925 C987 P49863 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:36416/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[61 (1437907763015450624)]} 0 3
[junit4:junit4] 2> 986762 T1941 C984 P36416 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[61]} 0 5
[junit4:junit4] 2> 986765 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[62 (1437907763021742080)]} 0 0
[junit4:junit4] 2> 986772 T1970 C985 P65155 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:36416/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[62 (1437907763026984960)]} 0 0
[junit4:junit4] 2> 986773 T1943 C984 P36416 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:49863/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[62 (1437907763026984960)]} 0 3
[junit4:junit4] 2> 986773 T1927 C987 P49863 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[62]} 0 5
[junit4:junit4] 2> 986776 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[63 (1437907763033276416)]} 0 0
[junit4:junit4] 2> 986783 T1955 C988 P55762 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:49863/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[63 (1437907763038519296)]} 0 0
[junit4:junit4] 2> 986784 T1925 C987 P49863 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:36416/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[63 (1437907763038519296)]} 0 3
[junit4:junit4] 2> 986785 T1941 C984 P36416 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[63]} 0 6
[junit4:junit4] 2> 986787 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[64 (1437907763044810752)]} 0 0
[junit4:junit4] 2> 986794 T1955 C988 P55762 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:49863/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[64 (1437907763050053632)]} 0 0
[junit4:junit4] 2> 986795 T1925 C987 P49863 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:36416/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[64 (1437907763050053632)]} 0 3
[junit4:junit4] 2> 986796 T1941 C984 P36416 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[64]} 0 6
[junit4:junit4] 2> 986798 T1901 C986 P20041 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[65 (1437907763056345088)]} 0 0
[junit4:junit4] 2> 986805 T1955 C988 P55762 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.f
[...truncated too long message...]
Shards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:55762___collection1_shard1_0_replica1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1_0",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":null,
[junit4:junit4] 2> "core":"collection1_shard1_0_replica1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:55762__",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:55762/_"}
[junit4:junit4] 2> 1185713 T1980 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1185721 T1889 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 65155
[junit4:junit4] 2> 1185721 T1889 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1729505070
[junit4:junit4] 2> 1186724 T1889 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1186724 T1889 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1186727 T1889 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@6c4d1767
[junit4:junit4] 2> 1186729 T1889 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=4,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=848,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0}
[junit4:junit4] 2> 1186730 T1889 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 1186730 T1889 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 1186730 T1889 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 1186733 T1889 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 1186734 T1889 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 1186734 T1889 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371295674316/jetty4 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371295674316/jetty4;done=false>>]
[junit4:junit4] 2> 1186735 T1889 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371295674316/jetty4
[junit4:junit4] 2> 1186735 T1889 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371295674316/jetty4/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371295674316/jetty4/index;done=false>>]
[junit4:junit4] 2> 1186736 T1889 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371295674316/jetty4/index
[junit4:junit4] 2> 1186737 T2044 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89869233312563212-127.0.0.1:65155__-n_0000000004) am no longer a leader.
[junit4:junit4] 2> 1186739 T1889 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/_,null}
[junit4:junit4] 2> 1186807 T1889 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4] 2> 1186809 T1889 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:61548 61548
[junit4:junit4] 2> 1186969 T1963 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 1187937 T1963 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1187937 T1963 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 1187939 T1889 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 20041
[junit4:junit4] 2> !!!! WARNING: best effort to remove /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371295674316 FAILED !!!!!
[junit4:junit4] 2> 1187940 T1889 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4] 2> 1187941 T1889 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:61548 61548
[junit4:junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ChaosMonkeyShardSplitTest -Dtests.method=testDistribSearch -Dtests.seed=F93B426350DA18B9 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=en_MT -Dtests.timezone=America/Regina -Dtests.file.encoding=US-ASCII
[junit4:junit4] ERROR 230s J1 | ChaosMonkeyShardSplitTest.testDistribSearch <<<
[junit4:junit4] > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:49863/_ returned non ok status:500, message:Server Error
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([F93B426350DA18B9:78DDCC7B27857885]:0)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
[junit4:junit4] > at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:228)
[junit4:junit4] > at org.apache.solr.cloud.ChaosMonkeyShardSplitTest.doTest(ChaosMonkeyShardSplitTest.java:136)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 1187974 T1889 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 229860 T1888 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 1 leaked thread(s).
[junit4:junit4] 2> 1188039 T1980 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 1188039 T1980 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1188039 T1980 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> NOTE: test params are: codec=Lucene3x, sim=RandomSimilarityProvider(queryNorm=true,coord=no): {}, locale=en_MT, timezone=America/Regina
[junit4:junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_21 (64-bit)/cpus=16,threads=1,free=267568120,total=451936256
[junit4:junit4] 2> NOTE: All tests run in this JVM: [TestSolr4Spatial, NoCacheHeaderTest, StatsComponentTest, TestFieldResource, FileBasedSpellCheckerTest, TestIndexingPerformance, TestLRUCache, TestTrie, LeaderElectionIntegrationTest, TestRemoteStreaming, FileUtilsTest, TestGroupingSearch, DateMathParserTest, TestSolrQueryParser, NotRequiredUniqueKeyTest, TestComponentsName, SampleTest, DocumentAnalysisRequestHandlerTest, UniqFieldsUpdateProcessorFactoryTest, TermVectorComponentTest, DocValuesMultiTest, DebugComponentTest, TestCSVResponseWriter, BasicFunctionalityTest, PeerSyncTest, TestRandomDVFaceting, TestFieldCollectionResource, TestMergePolicyConfig, TestDistributedGrouping, TestStressVersions, JsonLoaderTest, TestWriterPerf, TestCoreContainer, PluginInfoTest, TestMaxScoreQueryParser, EchoParamsTest, ZkNodePropsTest, TestFastLRUCache, TestFuzzyAnalyzedSuggestions, ReturnFieldsTest, MinimalSchemaTest, TestUniqueKeyFieldResource, SolrRequestParserTest, TestReloadAndDeleteDocs, SimpleFacetsTest, TestBM25SimilarityFactory, TestJoin, HighlighterConfigTest, PreAnalyzedUpdateProcessorTest, DocumentBuilderTest, TestValueSourceCache, RecoveryZkTest, TestJmxMonitoredMap, TestOmitPositions, SearchHandlerTest, DefaultValueUpdateProcessorTest, TestRTGBase, TestAtomicUpdateErrorCases, SolrCoreCheckLockOnStartupTest, WordBreakSolrSpellCheckerTest, TestQueryTypes, DOMUtilTest, DirectUpdateHandlerTest, TestStressRecovery, TestWordDelimiterFilterFactory, MBeansHandlerTest, TestZkChroot, OverseerTest, TestSolrQueryParserDefaultOperatorResource, DistanceFunctionTest, TestLFUCache, ShardSplitTest, ChaosMonkeyShardSplitTest]
[junit4:junit4] Completed on J1 in 230.19s, 1 test, 1 error <<< FAILURES!
[...truncated 579 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:392: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:372: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build.xml:181: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/common-build.xml:437: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:1246: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:890: There were test failures: 297 suites, 1246 tests, 1 error, 13 ignored (7 assumptions)
Total time: 54 minutes 28 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-Tests-4.x-Java7 - Build # 1340 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java7/1340/
2 tests failed.
REGRESSION: org.apache.solr.cloud.RecoveryZkTest.testDistribSearch
Error Message:
expected:<182> but was:<74>
Stack Trace:
java.lang.AssertionError: expected:<182> but was:<74>
at __randomizedtesting.SeedInfo.seed([7E1360AB42849902:FFF5EEB335DBF93E]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.cloud.RecoveryZkTest.doTest(RecoveryZkTest.java:108)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
REGRESSION: org.apache.solr.cloud.ShardSplitTest.testDistribSearch
Error Message:
Server at http://127.0.0.1:19626 returned non ok status:500, message:Server Error
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:19626 returned non ok status:500, message:Server Error
at __randomizedtesting.SeedInfo.seed([7E1360AB42849902:FFF5EEB335DBF93E]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:228)
at org.apache.solr.cloud.ShardSplitTest.doTest(ShardSplitTest.java:150)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9686 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.ShardSplitTest
[junit4:junit4] 2> 650684 T1461 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4] 2> 650691 T1461 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solrtest-ShardSplitTest-1371532603673
[junit4:junit4] 2> 650693 T1461 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 650693 T1462 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 650794 T1461 oasc.ZkTestServer.run start zk server on port:19619
[junit4:junit4] 2> 650795 T1461 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 650800 T1468 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@27e1bf0e name:ZooKeeperConnection Watcher:127.0.0.1:19619 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 650800 T1461 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 650801 T1461 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 650820 T1461 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 650822 T1470 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4cfe19a8 name:ZooKeeperConnection Watcher:127.0.0.1:19619/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 650823 T1461 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 650823 T1461 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 650828 T1461 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 650838 T1461 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 650840 T1461 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 650848 T1461 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 650849 T1461 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 650860 T1461 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 650861 T1461 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 650965 T1461 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 650966 T1461 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 650977 T1461 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 650978 T1461 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 650981 T1461 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 650982 T1461 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 650985 T1461 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 650986 T1461 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 650989 T1461 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 650989 T1461 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 650993 T1461 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 650993 T1461 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 650997 T1461 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 650997 T1461 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 651271 T1461 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 651274 T1461 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:19622
[junit4:junit4] 2> 651274 T1461 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 651275 T1461 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 651275 T1461 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1371532603983
[junit4:junit4] 2> 651276 T1461 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1371532603983/solr.xml
[junit4:junit4] 2> 651276 T1461 oasc.CoreContainer.<init> New CoreContainer 1286292745
[junit4:junit4] 2> 651277 T1461 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1371532603983/'
[junit4:junit4] 2> 651278 T1461 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1371532603983/'
[junit4:junit4] 2> 651407 T1461 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 651408 T1461 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 651408 T1461 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 651409 T1461 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 651409 T1461 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 651410 T1461 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 651410 T1461 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 651411 T1461 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 651411 T1461 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 651412 T1461 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 651430 T1461 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 651431 T1461 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:19619/solr
[junit4:junit4] 2> 651432 T1461 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 651433 T1461 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 651435 T1481 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6d0229bd name:ZooKeeperConnection Watcher:127.0.0.1:19619 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 651436 T1461 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 651439 T1461 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 651453 T1461 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 651455 T1483 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@291e4e3d name:ZooKeeperConnection Watcher:127.0.0.1:19619/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 651455 T1461 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 651458 T1461 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 651468 T1461 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 651472 T1461 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 651479 T1461 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:19622_
[junit4:junit4] 2> 651480 T1461 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:19622_
[junit4:junit4] 2> 651484 T1461 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 651500 T1461 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 651504 T1461 oasc.Overseer.start Overseer (id=89884760714772483-127.0.0.1:19622_-n_0000000000) starting
[junit4:junit4] 2> 651514 T1461 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 651525 T1485 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 651525 T1461 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 651528 T1461 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 651535 T1461 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 651538 T1484 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 651542 T1486 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 651543 T1486 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 653042 T1484 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 653042 T1484 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:19622_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:19622"}
[junit4:junit4] 2> 653043 T1484 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 653043 T1484 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 653063 T1483 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 653546 T1486 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1371532603983/collection1
[junit4:junit4] 2> 653546 T1486 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 653547 T1486 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 653547 T1486 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 653549 T1486 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1371532603983/collection1/'
[junit4:junit4] 2> 653550 T1486 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-controljetty-1371532603983/collection1/lib/README' to classloader
[junit4:junit4] 2> 653551 T1486 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-controljetty-1371532603983/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 653604 T1486 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 653664 T1486 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 653765 T1486 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 653771 T1486 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 654368 T1486 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 654372 T1486 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 654374 T1486 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 654380 T1486 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 654405 T1486 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 654406 T1486 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1371532603983/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1371532603672/control/data/
[junit4:junit4] 2> 654406 T1486 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@361e5287
[junit4:junit4] 2> 654407 T1486 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 654407 T1486 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1371532603672/control/data
[junit4:junit4] 2> 654408 T1486 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1371532603672/control/data/index/
[junit4:junit4] 2> 654408 T1486 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1371532603672/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 654409 T1486 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1371532603672/control/data/index
[junit4:junit4] 2> 654413 T1486 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@d66a164 lockFactory=org.apache.lucene.store.NativeFSLockFactory@390a31a2),segFN=segments_1,generation=1}
[junit4:junit4] 2> 654414 T1486 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 654417 T1486 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 654417 T1486 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 654418 T1486 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 654418 T1486 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 654419 T1486 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 654419 T1486 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 654420 T1486 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 654420 T1486 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 654421 T1486 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 654436 T1486 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 654443 T1486 oass.SolrIndexSearcher.<init> Opening Searcher@500fc86e main
[junit4:junit4] 2> 654444 T1486 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1371532603672/control/data/tlog
[junit4:junit4] 2> 654445 T1486 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 654445 T1486 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 654448 T1487 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@500fc86e main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 654449 T1486 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 654450 T1486 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:19622 collection:control_collection shard:shard1
[junit4:junit4] 2> 654451 T1486 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 654477 T1486 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 654480 T1486 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 654480 T1486 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 654480 T1486 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:19622/collection1/
[junit4:junit4] 2> 654481 T1486 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 654481 T1486 oasc.SyncStrategy.syncToMe http://127.0.0.1:19622/collection1/ has no replicas
[junit4:junit4] 2> 654481 T1486 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:19622/collection1/
[junit4:junit4] 2> 654482 T1486 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 654567 T1484 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 654585 T1483 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 654590 T1486 oasc.ZkController.register We are http://127.0.0.1:19622/collection1/ and leader is http://127.0.0.1:19622/collection1/
[junit4:junit4] 2> 654590 T1486 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:19622
[junit4:junit4] 2> 654590 T1486 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 654590 T1486 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 654591 T1486 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 654592 T1486 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 654593 T1461 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 654594 T1461 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 654595 T1461 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 654614 T1461 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 654615 T1461 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 654617 T1490 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@336a135 name:ZooKeeperConnection Watcher:127.0.0.1:19619/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 654618 T1461 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 654619 T1461 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 654622 T1461 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 654900 T1461 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 654903 T1461 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:19626
[junit4:junit4] 2> 654904 T1461 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 654905 T1461 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 654905 T1461 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1371532607603
[junit4:junit4] 2> 654906 T1461 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1371532607603/solr.xml
[junit4:junit4] 2> 654906 T1461 oasc.CoreContainer.<init> New CoreContainer 1851571052
[junit4:junit4] 2> 654907 T1461 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1371532607603/'
[junit4:junit4] 2> 654908 T1461 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1371532607603/'
[junit4:junit4] 2> 655039 T1461 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 655040 T1461 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 655040 T1461 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 655041 T1461 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 655041 T1461 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 655042 T1461 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 655042 T1461 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 655043 T1461 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 655043 T1461 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 655044 T1461 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 655062 T1461 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 655063 T1461 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:19619/solr
[junit4:junit4] 2> 655063 T1461 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 655064 T1461 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 655068 T1501 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2e62ac9b name:ZooKeeperConnection Watcher:127.0.0.1:19619 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 655069 T1461 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 655085 T1461 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 655096 T1461 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 655098 T1503 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1bc3822b name:ZooKeeperConnection Watcher:127.0.0.1:19619/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 655099 T1461 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 655111 T1461 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 656090 T1484 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 656091 T1484 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:19622__collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:19622_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:19622"}
[junit4:junit4] 2> 656109 T1503 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 656109 T1483 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 656109 T1490 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 656115 T1461 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:19626_
[junit4:junit4] 2> 656118 T1461 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:19626_
[junit4:junit4] 2> 656120 T1490 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 656120 T1503 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 656120 T1483 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 656121 T1483 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 656121 T1490 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 656127 T1503 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 656133 T1504 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 656133 T1504 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 657615 T1484 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 657616 T1484 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:19626_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:19626"}
[junit4:junit4] 2> 657617 T1484 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 657617 T1484 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 657633 T1490 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 657633 T1503 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 657633 T1483 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 658137 T1504 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1371532607603/collection1
[junit4:junit4] 2> 658137 T1504 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 658138 T1504 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 658138 T1504 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 658140 T1504 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1371532607603/collection1/'
[junit4:junit4] 2> 658141 T1504 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty1-1371532607603/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 658142 T1504 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty1-1371532607603/collection1/lib/README' to classloader
[junit4:junit4] 2> 658195 T1504 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 658255 T1504 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 658357 T1504 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 658363 T1504 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 658941 T1504 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 658945 T1504 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 658947 T1504 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 658953 T1504 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 658979 T1504 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 658980 T1504 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1371532607603/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1371532603672/jetty1/
[junit4:junit4] 2> 658980 T1504 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@361e5287
[junit4:junit4] 2> 658981 T1504 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 658981 T1504 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1371532603672/jetty1
[junit4:junit4] 2> 658982 T1504 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1371532603672/jetty1/index/
[junit4:junit4] 2> 658982 T1504 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1371532603672/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 658983 T1504 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1371532603672/jetty1/index
[junit4:junit4] 2> 658987 T1504 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@58bed46 lockFactory=org.apache.lucene.store.NativeFSLockFactory@18420fd5),segFN=segments_1,generation=1}
[junit4:junit4] 2> 658987 T1504 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 658991 T1504 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 658991 T1504 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 658992 T1504 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 658992 T1504 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 658993 T1504 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 658993 T1504 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 658994 T1504 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 658995 T1504 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 658995 T1504 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 659011 T1504 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 659019 T1504 oass.SolrIndexSearcher.<init> Opening Searcher@5c5ba35 main
[junit4:junit4] 2> 659019 T1504 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1371532603672/jetty1/tlog
[junit4:junit4] 2> 659020 T1504 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 659021 T1504 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 659026 T1505 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5c5ba35 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 659028 T1504 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 659028 T1504 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:19626 collection:collection1 shard:shard1
[junit4:junit4] 2> 659029 T1504 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 659112 T1504 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 659114 T1504 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 659115 T1504 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 659115 T1504 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:19626/collection1/
[junit4:junit4] 2> 659115 T1504 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 659116 T1504 oasc.SyncStrategy.syncToMe http://127.0.0.1:19626/collection1/ has no replicas
[junit4:junit4] 2> 659116 T1504 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:19626/collection1/
[junit4:junit4] 2> 659116 T1504 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 659137 T1484 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 659205 T1490 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 659205 T1483 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 659205 T1503 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 659224 T1504 oasc.ZkController.register We are http://127.0.0.1:19626/collection1/ and leader is http://127.0.0.1:19626/collection1/
[junit4:junit4] 2> 659224 T1504 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:19626
[junit4:junit4] 2> 659224 T1504 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 659225 T1504 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 659225 T1504 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 659227 T1504 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 659228 T1461 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 659229 T1461 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 659229 T1461 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 659507 T1461 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 659511 T1461 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:19630
[junit4:junit4] 2> 659512 T1461 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 659512 T1461 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 659513 T1461 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1371532612228
[junit4:junit4] 2> 659513 T1461 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1371532612228/solr.xml
[junit4:junit4] 2> 659514 T1461 oasc.CoreContainer.<init> New CoreContainer 470874863
[junit4:junit4] 2> 659515 T1461 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1371532612228/'
[junit4:junit4] 2> 659515 T1461 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1371532612228/'
[junit4:junit4] 2> 659644 T1461 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 659645 T1461 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 659646 T1461 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 659646 T1461 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 659647 T1461 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 659647 T1461 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 659648 T1461 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 659648 T1461 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 659649 T1461 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 659649 T1461 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 659667 T1461 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 659667 T1461 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:19619/solr
[junit4:junit4] 2> 659668 T1461 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 659669 T1461 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 659705 T1517 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7e19d69f name:ZooKeeperConnection Watcher:127.0.0.1:19619 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 659705 T1461 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 659719 T1461 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 659731 T1461 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 659733 T1519 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@78d98a7e name:ZooKeeperConnection Watcher:127.0.0.1:19619/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 659734 T1461 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 659746 T1461 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 660718 T1484 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 660719 T1484 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:19626__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:19626_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:19626"}
[junit4:junit4] 2> 660736 T1503 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 660736 T1519 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 660736 T1483 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 660736 T1490 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 660749 T1461 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:19630_
[junit4:junit4] 2> 660751 T1461 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:19630_
[junit4:junit4] 2> 660753 T1503 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 660753 T1519 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 660753 T1490 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 660754 T1483 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 660754 T1483 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 660755 T1503 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 660761 T1519 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 660761 T1490 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 660766 T1520 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 660767 T1520 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 662241 T1484 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 662243 T1484 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:19630_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:19630"}
[junit4:junit4] 2> 662243 T1484 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 662243 T1484 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 662249 T1490 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 662249 T1483 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 662249 T1503 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 662249 T1519 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 662770 T1520 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1371532612228/collection1
[junit4:junit4] 2> 662770 T1520 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 662771 T1520 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 662771 T1520 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 662773 T1520 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1371532612228/collection1/'
[junit4:junit4] 2> 662774 T1520 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty2-1371532612228/collection1/lib/README' to classloader
[junit4:junit4] 2> 662775 T1520 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty2-1371532612228/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 662828 T1520 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 662888 T1520 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 662990 T1520 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 662996 T1520 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 663571 T1520 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 663576 T1520 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 663578 T1520 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 663583 T1520 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 663609 T1520 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 663609 T1520 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1371532612228/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1371532603672/jetty2/
[junit4:junit4] 2> 663609 T1520 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@361e5287
[junit4:junit4] 2> 663610 T1520 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 663611 T1520 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1371532603672/jetty2
[junit4:junit4] 2> 663611 T1520 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1371532603672/jetty2/index/
[junit4:junit4] 2> 663611 T1520 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1371532603672/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 663613 T1520 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1371532603672/jetty2/index
[junit4:junit4] 2> 663617 T1520 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@45d336db lockFactory=org.apache.lucene.store.NativeFSLockFactory@24343f0a),segFN=segments_1,generation=1}
[junit4:junit4] 2> 663617 T1520 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 663620 T1520 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 663621 T1520 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 663621 T1520 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 663622 T1520 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 663623 T1520 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 663623 T1520 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 663624 T1520 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 663624 T1520 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 663625 T1520 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 663641 T1520 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 663648 T1520 oass.SolrIndexSearcher.<init> Opening Searcher@6e17449a main
[junit4:junit4] 2> 663649 T1520 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1371532603672/jetty2/tlog
[junit4:junit4] 2> 663650 T1520 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 663650 T1520 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 663655 T1521 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6e17449a main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 663657 T1520 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 663658 T1520 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:19630 collection:collection1 shard:shard2
[junit4:junit4] 2> 663659 T1520 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 663679 T1520 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 663683 T1520 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 663683 T1520 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 663683 T1520 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:19630/collection1/
[junit4:junit4] 2> 663683 T1520 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 663684 T1520 oasc.SyncStrategy.syncToMe http://127.0.0.1:19630/collection1/ has no replicas
[junit4:junit4] 2> 663684 T1520 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:19630/collection1/
[junit4:junit4] 2> 663684 T1520 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 663753 T1484 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 663768 T1490 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 663768 T1483 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 663768 T1503 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 663768 T1519 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 663792 T1520 oasc.ZkController.register We are http://127.0.0.1:19630/collection1/ and leader is http://127.0.0.1:19630/collection1/
[junit4:junit4] 2> 663792 T1520 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:19630
[junit4:junit4] 2> 663792 T1520 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 663792 T1520 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 663793 T1520 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 663794 T1520 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 663796 T1461 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 663796 T1461 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 663797 T1461 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 664081 T1461 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 664084 T1461 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:19635
[junit4:junit4] 2> 664085 T1461 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 664085 T1461 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 664086 T1461 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1371532616795
[junit4:junit4] 2> 664086 T1461 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1371532616795/solr.xml
[junit4:junit4] 2> 664087 T1461 oasc.CoreContainer.<init> New CoreContainer 1678993531
[junit4:junit4] 2> 664088 T1461 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1371532616795/'
[junit4:junit4] 2> 664088 T1461 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1371532616795/'
[junit4:junit4] 2> 664220 T1461 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 664221 T1461 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 664221 T1461 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 664222 T1461 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 664222 T1461 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 664223 T1461 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 664223 T1461 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 664224 T1461 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 664224 T1461 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 664225 T1461 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 664242 T1461 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 664243 T1461 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:19619/solr
[junit4:junit4] 2> 664244 T1461 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 664245 T1461 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 664248 T1533 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@53c10ede name:ZooKeeperConnection Watcher:127.0.0.1:19619 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 664249 T1461 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 664252 T1461 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 664265 T1461 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 664272 T1535 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@58b44d37 name:ZooKeeperConnection Watcher:127.0.0.1:19619/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 664273 T1461 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 664303 T1461 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 665283 T1484 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 665284 T1484 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:19630__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:19630_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:19630"}
[junit4:junit4] 2> 665289 T1483 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 665289 T1519 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 665289 T1490 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 665289 T1535 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 665289 T1503 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 665310 T1461 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:19635_
[junit4:junit4] 2> 665314 T1461 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:19635_
[junit4:junit4] 2> 665317 T1535 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 665317 T1519 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 665317 T1490 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 665317 T1503 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 665317 T1483 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 665318 T1483 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 665319 T1535 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 665319 T1519 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 665327 T1490 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 665327 T1503 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 665332 T1536 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 665332 T1536 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 666812 T1484 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 666813 T1484 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:19635_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:19635"}
[junit4:junit4] 2> 666814 T1484 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 666814 T1484 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 666819 T1535 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 666819 T1519 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 666819 T1490 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 666819 T1483 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 666819 T1503 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 667337 T1536 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1371532616795/collection1
[junit4:junit4] 2> 667337 T1536 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 667338 T1536 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 667338 T1536 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 667340 T1536 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1371532616795/collection1/'
[junit4:junit4] 2> 667341 T1536 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty3-1371532616795/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 667342 T1536 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty3-1371532616795/collection1/lib/README' to classloader
[junit4:junit4] 2> 667395 T1536 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 667456 T1536 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 667558 T1536 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 667564 T1536 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 668143 T1536 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 668148 T1536 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 668150 T1536 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 668155 T1536 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 668181 T1536 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 668182 T1536 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1371532616795/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1371532603672/jetty3/
[junit4:junit4] 2> 668182 T1536 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@361e5287
[junit4:junit4] 2> 668183 T1536 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 668184 T1536 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1371532603672/jetty3
[junit4:junit4] 2> 668184 T1536 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1371532603672/jetty3/index/
[junit4:junit4] 2> 668184 T1536 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1371532603672/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 668185 T1536 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1371532603672/jetty3/index
[junit4:junit4] 2> 668207 T1536 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@337af227 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1eb08bf7),segFN=segments_1,generation=1}
[junit4:junit4] 2> 668207 T1536 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 668211 T1536 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 668211 T1536 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 668212 T1536 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 668213 T1536 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 668213 T1536 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 668214 T1536 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 668214 T1536 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 668215 T1536 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 668215 T1536 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 668232 T1536 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 668239 T1536 oass.SolrIndexSearcher.<init> Opening Searcher@777cd1 main
[junit4:junit4] 2> 668240 T1536 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1371532603672/jetty3/tlog
[junit4:junit4] 2> 668241 T1536 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 668242 T1536 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 668246 T1537 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@777cd1 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 668249 T1536 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 668249 T1536 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:19635 collection:collection1 shard:shard1
[junit4:junit4] 2> 668252 T1536 oasc.ZkController.register We are http://127.0.0.1:19635/collection1/ and leader is http://127.0.0.1:19626/collection1/
[junit4:junit4] 2> 668253 T1536 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:19635
[junit4:junit4] 2> 668253 T1536 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 668253 T1536 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C620 name=collection1 org.apache.solr.core.SolrCore@10e4fb96 url=http://127.0.0.1:19635/collection1 node=127.0.0.1:19635_ C620_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:19635_, base_url=http://127.0.0.1:19635}
[junit4:junit4] 2> 668254 T1538 C620 P19635 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 668254 T1536 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 668254 T1538 C620 P19635 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 668255 T1538 C620 P19635 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 668255 T1538 C620 P19635 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 668255 T1461 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 668256 T1461 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 668257 T1538 C620 P19635 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 668257 T1461 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 668281 T1493 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:19635__collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 668331 T1484 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 668332 T1484 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:19635__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:19635_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:19635"}
[junit4:junit4] 2> 668346 T1535 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 668346 T1490 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 668346 T1483 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 668346 T1503 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 668346 T1519 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 668545 T1461 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 668548 T1461 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:19639
[junit4:junit4] 2> 668549 T1461 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 668549 T1461 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 668550 T1461 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1371532621261
[junit4:junit4] 2> 668550 T1461 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1371532621261/solr.xml
[junit4:junit4] 2> 668551 T1461 oasc.CoreContainer.<init> New CoreContainer 265595525
[junit4:junit4] 2> 668552 T1461 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1371532621261/'
[junit4:junit4] 2> 668552 T1461 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1371532621261/'
[junit4:junit4] 2> 668681 T1461 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 668682 T1461 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 668683 T1461 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 668683 T1461 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 668684 T1461 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 668684 T1461 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 668685 T1461 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 668685 T1461 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 668686 T1461 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 668687 T1461 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 668702 T1461 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 668703 T1461 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:19619/solr
[junit4:junit4] 2> 668703 T1461 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 668705 T1461 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 668708 T1550 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@25f04b32 name:ZooKeeperConnection Watcher:127.0.0.1:19619 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 668708 T1461 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 668719 T1461 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 668730 T1461 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 668732 T1552 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@10ddee69 name:ZooKeeperConnection Watcher:127.0.0.1:19619/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 668732 T1461 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 668742 T1461 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 669283 T1493 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:19635__collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 669283 T1493 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:19635__collection1&state=recovering&nodeName=127.0.0.1:19635_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1002
[junit4:junit4] 2> 669746 T1461 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:19639_
[junit4:junit4] 2> 669775 T1461 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:19639_
[junit4:junit4] 2> 669779 T1535 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 669779 T1519 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 669780 T1552 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 669779 T1490 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 669779 T1503 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 669780 T1483 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 669781 T1483 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 669781 T1535 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 669781 T1519 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 669793 T1490 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 669794 T1503 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 669799 T1553 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 669799 T1553 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 669858 T1484 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 669859 T1484 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:19639_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:19639"}
[junit4:junit4] 2> 669859 T1484 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 669859 T1484 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 669866 T1552 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 669867 T1519 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 669867 T1490 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 669866 T1483 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 669866 T1535 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 669866 T1503 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 670802 T1553 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1371532621261/collection1
[junit4:junit4] 2> 670802 T1553 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 670803 T1553 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 670803 T1553 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 670805 T1553 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1371532621261/collection1/'
[junit4:junit4] 2> 670806 T1553 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty4-1371532621261/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 670807 T1553 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty4-1371532621261/collection1/lib/README' to classloader
[junit4:junit4] 2> 670860 T1553 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 670921 T1553 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 671022 T1553 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 671028 T1553 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> C620_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:19635_, base_url=http://127.0.0.1:19635}
[junit4:junit4] 2> 671285 T1538 C620 P19635 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:19626/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 671285 T1538 C620 P19635 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:19635 START replicas=[http://127.0.0.1:19626/collection1/] nUpdates=100
[junit4:junit4] 2> 671286 T1538 C620 P19635 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 671286 T1538 C620 P19635 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 671287 T1538 C620 P19635 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 671287 T1538 C620 P19635 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 671287 T1538 C620 P19635 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 671288 T1538 C620 P19635 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:19626/collection1/. core=collection1
[junit4:junit4] 2> 671288 T1538 C620 P19635 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C621 name=collection1 org.apache.solr.core.SolrCore@13887716 url=http://127.0.0.1:19626/collection1 node=127.0.0.1:19626_ C621_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:19626_, base_url=http://127.0.0.1:19626, leader=true}
[junit4:junit4] 2> 671295 T1494 C621 P19626 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 671299 T1495 C621 P19626 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 671303 T1495 C621 P19626 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@58bed46 lockFactory=org.apache.lucene.store.NativeFSLockFactory@18420fd5),segFN=segments_1,generation=1}
[junit4:junit4] 2> 671303 T1495 C621 P19626 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 671304 T1495 C621 P19626 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@58bed46 lockFactory=org.apache.lucene.store.NativeFSLockFactory@18420fd5),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@58bed46 lockFactory=org.apache.lucene.store.NativeFSLockFactory@18420fd5),segFN=segments_2,generation=2}
[junit4:junit4] 2> 671304 T1495 C621 P19626 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 671305 T1495 C621 P19626 oass.SolrIndexSearcher.<init> Opening Searcher@2213f290 realtime
[junit4:junit4] 2> 671306 T1495 C621 P19626 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 671306 T1495 C621 P19626 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> ASYNC NEW_CORE C622 name=collection1 org.apache.solr.core.SolrCore@10e4fb96 url=http://127.0.0.1:19635/collection1 node=127.0.0.1:19635_ C622_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:19635_, base_url=http://127.0.0.1:19635}
[junit4:junit4] 2> 671323 T1538 C622 P19635 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 671323 T1538 C622 P19635 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> ASYNC NEW_CORE C623 name=collection1 org.apache.solr.core.SolrCore@13887716 url=http://127.0.0.1:19626/collection1 node=127.0.0.1:19626_ C623_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:19626_, base_url=http://127.0.0.1:19626, leader=true}
[junit4:junit4] 2> 671326 T1496 C623 P19626 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 671327 T1496 C623 P19626 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=2
[junit4:junit4] 2> 671328 T1538 C622 P19635 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 671328 T1538 C622 P19635 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 671328 T1538 C622 P19635 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 671330 T1496 C623 P19626 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 671331 T1538 C622 P19635 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 671332 T1538 C622 P19635 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1371532603672/jetty3/index.20130617221704312
[junit4:junit4] 2> 671332 T1538 C622 P19635 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@7a20a3f7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@25adaaee) fullCopy=false
[junit4:junit4] 2> 671335 T1496 C623 P19626 oasc.SolrCore.execute [collection1] webapp= path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 671336 T1538 C622 P19635 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 671338 T1538 C622 P19635 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 671338 T1538 C622 P19635 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 671390 T1538 C622 P19635 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@337af227 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1eb08bf7),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@337af227 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1eb08bf7),segFN=segments_2,generation=2}
[junit4:junit4] 2> 671391 T1538 C622 P19635 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 671391 T1538 C622 P19635 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 671392 T1538 C622 P19635 oass.SolrIndexSearcher.<init> Opening Searcher@4de148be main
[junit4:junit4] 2> 671393 T1537 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4de148be main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 671394 T1538 C622 P19635 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1371532603672/jetty3/index.20130617221704312 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1371532603672/jetty3/index.20130617221704312;done=true>>]
[junit4:junit4] 2> 671394 T1538 C622 P19635 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1371532603672/jetty3/index.20130617221704312
[junit4:junit4] 2> 671394 T1538 C622 P19635 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ShardSplitTest-1371532603672/jetty3/index.20130617221704312
[junit4:junit4] 2> 671394 T1538 C622 P19635 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 671395 T1538 C622 P19635 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 671395 T1538 C622 P19635 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 671395 T1538 C622 P19635 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 671397 T1538 C622 P19635 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 671607 T1553 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 671611 T1553 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 671614 T1553 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 671619 T1553 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 671645 T1553 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 671645 T1553 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1371532621261/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1371532603672/jetty4/
[junit4:junit4] 2> 671645 T1553 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@361e5287
[junit4:junit4] 2> 671646 T1553 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 671647 T1553 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1371532603672/jetty4
[junit4:junit4] 2> 671647 T1553 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1371532603672/jetty4/index/
[junit4:junit4] 2> 671647 T1553 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1371532603672/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 671648 T1553 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1371532603672/jetty4/index
[junit4:junit4] 2> 671652 T1553 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@53923f0b lockFactory=org.apache.lucene.store.NativeFSLockFactory@9556f8c),segFN=segments_1,generation=1}
[junit4:junit4] 2> 671652 T1553 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 671656 T1553 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 671656 T1553 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 671657 T1553 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 671657 T1553 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 671658 T1553 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 671658 T1553 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 671660 T1553 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 671660 T1553 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 671661 T1553 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 671677 T1553 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 671685 T1553 oass.SolrIndexSearcher.<init> Opening Searcher@35aa04c5 main
[junit4:junit4] 2> 671685 T1553 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1371532603672/jetty4/tlog
[junit4:junit4] 2> 671686 T1553 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 671687 T1553 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 671691 T1556 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@35aa04c5 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 671693 T1553 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 671694 T1553 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:19639 collection:collection1 shard:shard2
[junit4:junit4] 2> 671697 T1553 oasc.ZkController.register We are http://127.0.0.1:19639/collection1/ and leader is http://127.0.0.1:19630/collection1/
[junit4:junit4] 2> 671697 T1553 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:19639
[junit4:junit4] 2> 671698 T1553 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 671698 T1553 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C624 name=collection1 org.apache.solr.core.SolrCore@14a30878 url=http://127.0.0.1:19639/collection1 node=127.0.0.1:19639_ C624_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:19639_, base_url=http://127.0.0.1:19639}
[junit4:junit4] 2> 671698 T1557 C624 P19639 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 671699 T1553 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 671699 T1557 C624 P19639 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 671699 T1557 C624 P19639 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 671700 T1557 C624 P19639 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 671700 T1461 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 671701 T1461 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 671701 T1557 C624 P19639 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 671701 T1461 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 671725 T1461 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 671726 T1509 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:19639__collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 671726 T1461 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 2> 671727 T1461 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 2> 671728 T1461 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 672730 T1461 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 672873 T1484 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 672874 T1484 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:19635__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:19635_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:19635"}
[junit4:junit4] 2> 672878 T1484 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:19639__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:19639_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:19639"}
[junit4:junit4] 2> 672892 T1552 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 672892 T1483 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 672892 T1490 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 672892 T1519 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 672892 T1503 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 672892 T1535 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 673729 T1509 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:19639__collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 673729 T1509 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:19639__collection1&state=recovering&nodeName=127.0.0.1:19639_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2003
[junit4:junit4] 2> 673732 T1461 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 674734 T1461 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C624_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:19639_, base_url=http://127.0.0.1:19639}
[junit4:junit4] 2> 675731 T1557 C624 P19639 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:19630/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 675731 T1557 C624 P19639 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:19639 START replicas=[http://127.0.0.1:19630/collection1/] nUpdates=100
[junit4:junit4] 2> 675732 T1557 C624 P19639 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 675732 T1557 C624 P19639 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 675732 T1557 C624 P19639 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 675732 T1557 C624 P19639 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 675733 T1557 C624 P19639 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 675734 T1557 C624 P19639 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:19630/collection1/. core=collection1
[junit4:junit4] 2> 675734 T1557 C624 P19639 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 675736 T1461 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> ASYNC NEW_CORE C625 name=collection1 org.apache.solr.core.SolrCore@1084f38e url=http://127.0.0.1:19630/collection1 node=127.0.0.1:19630_ C625_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:19630_, base_url=http://127.0.0.1:19630, leader=true}
[junit4:junit4] 2> 675741 T1510 C625 P19630 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 675745 T1511 C625 P19630 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 675748 T1511 C625 P19630 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@45d336db lockFactory=org.apache.lucene.store.NativeFSLockFactory@24343f0a),segFN=segments_1,generation=1}
[junit4:junit4] 2> 675749 T1511 C625 P19630 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 675750 T1511 C625 P19630 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@45d336db lockFactory=org.apache.lucene.store.NativeFSLockFactory@24343f0a),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@45d336db lockFactory=org.apache.lucene.store.NativeFSLockFactory@24343f0a),segFN=segments_2,generation=2}
[junit4:junit4] 2> 675750 T1511 C625 P19630 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 675751 T1511 C625 P19630 oass.SolrIndexSearcher.<init> Opening Searcher@5db7a5ba realtime
[junit4:junit4] 2> 675751 T1511 C625 P19630 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 675752 T1511 C625 P19630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 675753 T1557 C624 P19639 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 675753 T1557 C624 P19639 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 675755 T1512 C625 P19630 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 675756 T1512 C625 P19630 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=2
[junit4:junit4] 2> 675757 T1557 C624 P19639 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 675757 T1557 C624 P19639 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 675757 T1557 C624 P19639 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 675759 T1512 C625 P19630 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 675760 T1557 C624 P19639 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 675761 T1557 C624 P19639 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1371532603672/jetty4/index.20130617221708741
[junit4:junit4] 2> 675761 T1557 C624 P19639 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@debae77 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7949378) fullCopy=false
[junit4:junit4] 2> 675764 T1512 C625 P19630 oasc.SolrCore.execute [collection1] webapp= path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 675765 T1557 C624 P19639 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 675766 T1557 C624 P19639 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 675766 T1557 C624 P19639 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 675819 T1557 C624 P19639 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@53923f0b lockFactory=org.apache.lucene.store.NativeFSLockFactory@9556f8c),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@53923f0b lockFactory=org.apache.lucene.store.NativeFSLockFactory@9556f8c),segFN=segments_2,generation=2}
[junit4:junit4] 2> 675820 T1557 C624 P19639 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 675820 T1557 C624 P19639 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 675820 T1557 C624 P19639 oass.SolrIndexSearcher.<init> Opening Searcher@1323bfa main
[junit4:junit4] 2> 675822 T1556 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1323bfa main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 675822 T1557 C624 P19639 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1371532603672/jetty4/index.20130617221708741 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1371532603672/jetty4/index.20130617221708741;done=true>>]
[junit4:junit4] 2> 675823 T1557 C624 P19639 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1371532603672/jetty4/index.20130617221708741
[junit4:junit4] 2> 675823 T1557 C624 P19639 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ShardSplitTest-1371532603672/jetty4/index.20130617221708741
[junit4:junit4] 2> 675823 T1557 C624 P19639 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 675823 T1557 C624 P19639 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 675824 T1557 C624 P19639 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 675824 T1557 C624 P19639 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 675826 T1557 C624 P19639 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 675906 T1484 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 675907 T1484 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:19639__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:19639_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:19639"}
[junit4:junit4] 2> 675920 T1552 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 675920 T1519 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 675920 T1503 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 675920 T1490 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 675920 T1483 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 675920 T1535 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 676738 T1461 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 676739 T1461 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> ASYNC NEW_CORE C626 name=collection1 org.apache.solr.core.SolrCore@79406006 url=http://127.0.0.1:19622/collection1 node=127.0.0.1:19622_ C626_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:19622_, base_url=http://127.0.0.1:19622, leader=true}
[junit4:junit4] 2> 676748 T1473 C626 P19622 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 676752 T1473 C626 P19622 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@d66a164 lockFactory=org.apache.lucene.store.NativeFSLockFactory@390a31a2),segFN=segments_1,generation=1}
[junit4:junit4] 2> 676753 T1473 C626 P19622 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 676753 T1473 C626 P19622 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@d66a164 lockFactory=org.apache.lucene.store.NativeFSLockFactory@390a31a2),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@d66a164 lockFactory=org.apache.lucene.store.NativeFSLockFactory@390a31a2),segFN=segments_2,generation=2}
[junit4:junit4] 2> 676754 T1473 C626 P19622 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 676755 T1473 C626 P19622 oass.SolrIndexSearcher.<init> Opening Searcher@3d2a6704 main
[junit4:junit4] 2> 676755 T1473 C626 P19622 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 676756 T1487 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3d2a6704 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 676757 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 9
[junit4:junit4] 2> 676769 T1497 C623 P19626 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:19626/collection1/, StdNode: http://127.0.0.1:19635/collection1/, StdNode: http://127.0.0.1:19630/collection1/, StdNode: http://127.0.0.1:19639/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 676773 T1498 C623 P19626 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 676773 T1513 C625 P19630 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 676774 T1498 C623 P19626 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@58bed46 lockFactory=org.apache.lucene.store.NativeFSLockFactory@18420fd5),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@58bed46 lockFactory=org.apache.lucene.store.NativeFSLockFactory@18420fd5),segFN=segments_3,generation=3}
[junit4:junit4] 2> 676775 T1513 C625 P19630 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@45d336db lockFactory=org.apache.lucene.store.NativeFSLockFactory@24343f0a),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@45d336db lockFactory=org.apache.lucene.store.NativeFSLockFactory@24343f0a),segFN=segments_3,generation=3}
[junit4:junit4] 2> 676775 T1498 C623 P19626 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 676775 T1513 C625 P19630 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 676776 T1498 C623 P19626 oass.SolrIndexSearcher.<init> Opening Searcher@647277f9 main
[junit4:junit4] 2> 676777 T1513 C625 P19630 oass.SolrIndexSearcher.<init> Opening Searcher@1992dc2d main
[junit4:junit4] 2> 676777 T1498 C623 P19626 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 676778 T1513 C625 P19630 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 676778 T1505 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@647277f9 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 676778 T1521 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1992dc2d main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 676779 T1498 C623 P19626 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 676779 T1513 C625 P19630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> C624_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:19639_, base_url=http://127.0.0.1:19639}
[junit4:junit4] 2> 676781 T1542 C624 P19639 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> C622_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:19635_, base_url=http://127.0.0.1:19635}
[junit4:junit4] 2> 676781 T1525 C622 P19635 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 676782 T1542 C624 P19639 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@53923f0b lockFactory=org.apache.lucene.store.NativeFSLockFactory@9556f8c),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@53923f0b lockFactory=org.apache.lucene.store.NativeFSLockFactory@9556f8c),segFN=segments_3,generation=3}
[junit4:junit4] 2> 676783 T1525 C622 P19635 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@337af227 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1eb08bf7),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@337af227 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1eb08bf7),segFN=segments_3,generation=3}
[junit4:junit4] 2> 676783 T1542 C624 P19639 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 676784 T1525 C622 P19635 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 676784 T1542 C624 P19639 oass.SolrIndexSearcher.<init> Opening Searcher@792e38f5 main
[junit4:junit4] 2> 676785 T1525 C622 P19635 oass.SolrIndexSearcher.<init> Opening Searcher@a29b8d8 main
[junit4:junit4] 2> 676785 T1542 C624 P19639 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 676786 T1556 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@792e38f5 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 676786 T1525 C622 P19635 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 676787 T1542 C624 P19639 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> 676787 T1537 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@a29b8d8 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 676788 T1525 C622 P19635 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 676789 T1497 C623 P19626 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 20
[junit4:junit4] 2> 676790 T1461 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 676793 T1499 C623 P19626 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 676795 T1526 C622 P19635 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 676797 T1514 C625 P19630 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 676799 T1543 C624 P19639 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 678805 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1438156200905539584)} 0 2
[junit4:junit4] 2> 678816 T1525 C622 P19635 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=FROMLEADER&_version_=-1438156200912879616&update.from=http://127.0.0.1:19626/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1438156200912879616)} 0 2
[junit4:junit4] 2> 678821 T1544 C624 P19639 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=FROMLEADER&_version_=-1438156200917073920&update.from=http://127.0.0.1:19630/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1438156200917073920)} 0 2
[junit4:junit4] 2> 678822 T1513 C625 P19630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=TOLEADER&wt=javabin&version=2} {deleteByQuery=*:* (-1438156200917073920)} 0 8
[junit4:junit4] 2> 678823 T1497 C623 P19626 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1438156200912879616)} 0 14
[junit4:junit4] 2> 678827 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!0 (1438156200929656832)]} 0 1
[junit4:junit4] 2> 678836 T1544 C624 P19639 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19630/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!0 (1438156200935948288)]} 0 1
[junit4:junit4] 2> 678837 T1513 C625 P19630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19626/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[a!0 (1438156200935948288)]} 0 5
[junit4:junit4] 2> 678837 T1497 C623 P19626 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!0]} 0 7
[junit4:junit4] 2> 678840 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!1 (1438156200944336896)]} 0 0
[junit4:junit4] 2> 678847 T1525 C622 P19635 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19626/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!1 (1438156200947482624)]} 0 1
[junit4:junit4] 2> 678847 T1497 C623 P19626 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!1 (1438156200947482624)]} 0 4
[junit4:junit4] 2> 678850 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!2 (1438156200954822656)]} 0 0
[junit4:junit4] 2> 678857 T1525 C622 P19635 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19626/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!2 (1438156200959016960)]} 0 1
[junit4:junit4] 2> 678857 T1493 C623 P19626 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19630/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[c!2 (1438156200959016960)]} 0 3
[junit4:junit4] 2> 678858 T1515 C625 P19630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!2]} 0 6
[junit4:junit4] 2> 678861 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!3 (1438156200966356992)]} 0 0
[junit4:junit4] 2> 678868 T1544 C624 P19639 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19630/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!3 (1438156200969502720)]} 0 1
[junit4:junit4] 2> 678868 T1515 C625 P19630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!3 (1438156200969502720)]} 0 4
[junit4:junit4] 2> 678871 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!4 (1438156200976842752)]} 0 0
[junit4:junit4] 2> 678877 T1544 C624 P19639 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19630/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!4 (1438156200979988480)]} 0 0
[junit4:junit4] 2> 678878 T1515 C625 P19630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!4 (1438156200979988480)]} 0 4
[junit4:junit4] 2> 678881 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!5 (1438156200987328512)]} 0 0
[junit4:junit4] 2> 678890 T1544 C624 P19639 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19630/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!5 (1438156200992571392)]} 0 1
[junit4:junit4] 2> 678890 T1513 C625 P19630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19626/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[f!5 (1438156200992571392)]} 0 4
[junit4:junit4] 2> 678891 T1497 C623 P19626 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!5]} 0 7
[junit4:junit4] 2> 678894 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!6 (1438156201000960000)]} 0 0
[junit4:junit4] 2> 678901 T1525 C622 P19635 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19626/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!6 (1438156201004105728)]} 0 1
[junit4:junit4] 2> 678901 T1497 C623 P19626 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!6 (1438156201004105728)]} 0 4
[junit4:junit4] 2> 678904 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!7 (1438156201011445760)]} 0 0
[junit4:junit4] 2> 678912 T1525 C622 P19635 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19626/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!7 (1438156201016688640)]} 0 0
[junit4:junit4] 2> 678913 T1493 C623 P19626 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19630/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[h!7 (1438156201016688640)]} 0 4
[junit4:junit4] 2> 678914 T1515 C625 P19630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!7]} 0 7
[junit4:junit4] 2> 678916 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!8 (1438156201024028672)]} 0 0
[junit4:junit4] 2> 678924 T1525 C622 P19635 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19626/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!8 (1438156201029271552)]} 0 0
[junit4:junit4] 2> 678925 T1493 C623 P19626 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19630/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[i!8 (1438156201029271552)]} 0 4
[junit4:junit4] 2> 678926 T1515 C625 P19630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!8]} 0 7
[junit4:junit4] 2> 678929 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!9 (1438156201037660160)]} 0 0
[junit4:junit4] 2> 678936 T1525 C622 P19635 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19626/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!9 (1438156201040805888)]} 0 0
[junit4:junit4] 2> 678936 T1497 C623 P19626 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!9 (1438156201040805888)]} 0 4
[junit4:junit4] 2> 678940 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!10 (1438156201048145920)]} 0 1
[junit4:junit4] 2> 678947 T1525 C622 P19635 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19626/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[k!10 (1438156201053388800)]} 0 0
[junit4:junit4] 2> 678948 T1493 C623 P19626 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19630/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[k!10 (1438156201053388800)]} 0 4
[junit4:junit4] 2> 678949 T1515 C625 P19630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!10]} 0 7
[junit4:junit4] 2> 678953 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!11 (1438156201061777408)]} 0 1
[junit4:junit4] 2> 678960 T1544 C624 P19639 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19630/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[l!11 (1438156201067020288)]} 0 0
[junit4:junit4] 2> 678961 T1513 C625 P19630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19626/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[l!11 (1438156201067020288)]} 0 4
[junit4:junit4] 2> 678962 T1497 C623 P19626 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!11]} 0 7
[junit4:junit4] 2> 678965 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!12 (1438156201075408896)]} 0 0
[junit4:junit4] 2> 678971 T1544 C624 P19639 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19630/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[m!12 (1438156201078554624)]} 0 0
[junit4:junit4] 2> 678972 T1515 C625 P19630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!12 (1438156201078554624)]} 0 4
[junit4:junit4] 2> 678975 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!13 (1438156201085894656)]} 0 0
[junit4:junit4] 2> 678983 T1525 C622 P19635 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19626/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[n!13 (1438156201091137536)]} 0 0
[junit4:junit4] 2> 678984 T1493 C623 P19626 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19630/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[n!13 (1438156201091137536)]} 0 4
[junit4:junit4] 2> 678985 T1515 C625 P19630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!13]} 0 7
[junit4:junit4] 2> 678988 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!14 (1438156201099526144)]} 0 0
[junit4:junit4] 2> 678996 T1544 C624 P19639 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19630/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[o!14 (1438156201104769024)]} 0 0
[junit4:junit4] 2> 678997 T1513 C625 P19630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19626/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[o!14 (1438156201104769024)]} 0 4
[junit4:junit4] 2> 678998 T1497 C623 P19626 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!14]} 0 7
[junit4:junit4] 2> 679001 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!15 (1438156201113157632)]} 0 0
[junit4:junit4] 2> 679009 T1525 C622 P19635 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19626/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[p!15 (1438156201118400512)]} 0 0
[junit4:junit4] 2> 679010 T1493 C623 P19626 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19630/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[p!15 (1438156201118400512)]} 0 4
[junit4:junit4] 2> 679011 T1515 C625 P19630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!15]} 0 7
[junit4:junit4] 2> 679014 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!16 (1438156201126789120)]} 0 0
[junit4:junit4] 2> 679022 T1525 C622 P19635 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19626/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[q!16 (1438156201132032000)]} 0 0
[junit4:junit4] 2> 679023 T1493 C623 P19626 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19630/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[q!16 (1438156201132032000)]} 0 4
[junit4:junit4] 2> 679024 T1515 C625 P19630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!16]} 0 7
[junit4:junit4] 2> 679027 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!17 (1438156201140420608)]} 0 0
[junit4:junit4] 2> 679033 T1544 C624 P19639 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19630/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[r!17 (1438156201143566336)]} 0 0
[junit4:junit4] 2> 679034 T1515 C625 P19630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!17 (1438156201143566336)]} 0 4
[junit4:junit4] 2> 679037 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!18 (1438156201150906368)]} 0 0
[junit4:junit4] 2> 679046 T1525 C622 P19635 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19626/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[s!18 (1438156201156149248)]} 0 1
[junit4:junit4] 2> 679046 T1493 C623 P19626 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19630/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[s!18 (1438156201156149248)]} 0 4
[junit4:junit4] 2> 679047 T1515 C625 P19630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!18]} 0 7
[junit4:junit4] 2> 679051 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!19 (1438156201164537856)]} 0 1
[junit4:junit4] 2> 679057 T1525 C622 P19635 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19626/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[t!19 (1438156201167683584)]} 0 0
[junit4:junit4] 2> 679058 T1497 C623 P19626 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!19 (1438156201167683584)]} 0 5
[junit4:junit4] 2> 679061 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!20 (1438156201176072192)]} 0 0
[junit4:junit4] 2> 679069 T1544 C624 P19639 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19630/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[u!20 (1438156201181315072)]} 0 0
[junit4:junit4] 2> 679070 T1513 C625 P19630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19626/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[u!20 (1438156201181315072)]} 0 4
[junit4:junit4] 2> 679071 T1497 C623 P19626 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!20]} 0 7
[junit4:junit4] 2> 679074 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[v!21 (1438156201189703680)]} 0 0
[junit4:junit4] 2> 679080 T1525 C622 P19635 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19626/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[v!21 (1438156201192849408)]} 0 0
[junit4:junit4] 2> 679081 T1497 C623 P19626 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[v!21 (1438156201192849408)]} 0 4
[junit4:junit4] 2> 679084 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[w!22 (1438156201200189440)]} 0 0
[junit4:junit4] 2> 679090 T1525 C622 P19635 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19626/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[w!22 (1438156201203335168)]} 0 0
[junit4:junit4] 2> 679091 T1497 C623 P19626 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[w!22 (1438156201203335168)]} 0 4
[junit4:junit4] 2> 679094 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[x!23 (1438156201210675200)]} 0 0
[junit4:junit4] 2> 679102 T1544 C624 P19639 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19630/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[x!23 (1438156201215918080)]} 0 0
[junit4:junit4] 2> 679103 T1513 C625 P19630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19626/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[x!23 (1438156201215918080)]} 0 4
[junit4:junit4] 2> 679104 T1497 C623 P19626 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[x!23]} 0 7
[junit4:junit4] 2> 679107 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[y!24 (1438156201224306688)]} 0 0
[junit4:junit4] 2> 679115 T1544 C624 P19639 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19630/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[y!24 (1438156201229549568)]} 0 0
[junit4:junit4] 2> 679116 T1513 C625 P19630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19626/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[y!24 (1438156201229549568)]} 0 4
[junit4:junit4] 2> 679117 T1497 C623 P19626 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[y!24]} 0 7
[junit4:junit4] 2> 679120 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[z!25 (1438156201237938176)]} 0 0
[junit4:junit4] 2> 679126 T1525 C622 P19635 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19626/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[z!25 (1438156201241083904)]} 0 0
[junit4:junit4] 2> 679127 T1497 C623 P19626 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[z!25 (1438156201241083904)]} 0 4
[junit4:junit4] 2> 679130 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!26 (1438156201248423936)]} 0 0
[junit4:junit4] 2> 679136 T1544 C624 P19639 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19630/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!26 (1438156201251569664)]} 0 0
[junit4:junit4] 2> 679137 T1515 C625 P19630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!26 (1438156201251569664)]} 0 4
[junit4:junit4] 2> 679140 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!27 (1438156201258909696)]} 0 0
[junit4:junit4] 2> 679148 T1525 C622 P19635 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19626/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!27 (1438156201264152576)]} 0 0
[junit4:junit4] 2> 679149 T1493 C623 P19626 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19630/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[b!27 (1438156201264152576)]} 0 4
[junit4:junit4] 2> 679150 T1515 C625 P19630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!27]} 0 7
[junit4:junit4] 2> 679152 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!28 (1438156201271492608)]} 0 0
[junit4:junit4] 2> 679161 T1525 C622 P19635 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19626/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!28 (1438156201276735488)]} 0 1
[junit4:junit4] 2> 679161 T1493 C623 P19626 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19630/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[c!28 (1438156201276735488)]} 0 4
[junit4:junit4] 2> 679162 T1515 C625 P19630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!28]} 0 7
[junit4:junit4] 2> 679165 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!29 (1438156201285124096)]} 0 0
[junit4:junit4] 2> 679173 T1544 C624 P19639 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19630/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!29 (1438156201290366976)]} 0 0
[junit4:junit4] 2> 679174 T1513 C625 P19630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19626/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[d!29 (1438156201290366976)]} 0 4
[junit4:junit4] 2> 679175 T1497 C623 P19626 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!29]} 0 7
[junit4:junit4] 2> 679179 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!30 (1438156201298755584)]} 0 1
[junit4:junit4] 2> 679186 T1544 C624 P19639 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19630/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!30 (1438156201302949888)]} 0 1
[junit4:junit4] 2> 679187 T1515 C625 P19630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!30 (1438156201302949888)]} 0 5
[junit4:junit4] 2> 679191 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!31 (1438156201311338496)]} 0 1
[junit4:junit4] 2> 679199 T1544 C624 P19639 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19630/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!31 (1438156201316581376)]} 0 1
[junit4:junit4] 2> 679200 T1513 C625 P19630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19626/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[f!31 (1438156201316581376)]} 0 5
[junit4:junit4] 2> 679200 T1497 C623 P19626 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!31]} 0 7
[junit4:junit4] 2> 679204 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!32 (1438156201324969984)]} 0 1
[junit4:junit4] 2> 679210 T1525 C622 P19635 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19626/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!32 (1438156201328115712)]} 0 1
[junit4:junit4] 2> 679211 T1497 C623 P19626 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!32 (1438156201328115712)]} 0 5
[junit4:junit4] 2> 679214 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!33 (1438156201335455744)]} 0 1
[junit4:junit4] 2> 679219 T1525 C622 P19635 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19626/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!33 (1438156201338601472)]} 0 0
[junit4:junit4] 2> 679220 T1497 C623 P19626 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!33 (1438156201338601472)]} 0 4
[junit4:junit4] 2> 679223 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!34 (1438156201345941504)]} 0 0
[junit4:junit4] 2> 679231 T1525 C622 P19635 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19626/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!34 (1438156201351184384)]} 0 0
[junit4:junit4] 2> 679232 T1493 C623 P19626 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19630/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[i!34 (1438156201351184384)]} 0 4
[junit4:junit4] 2> 679233 T1515 C625 P19630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!34]} 0 7
[junit4:junit4] 2> 679236 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!35 (1438156201359572992)]} 0 0
[junit4:junit4] 2> 679242 T1525 C622 P19635 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19626/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!35 (1438156201362718720)]} 0 0
[junit4:junit4] 2> 679243 T1497 C623 P19626 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!35 (1438156201362718720)]} 0 4
[junit4:junit4] 2> 679246 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!36 (1438156201370058752)]} 0 0
[junit4:junit4] 2> 679254 T1525 C622 P19635 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19626/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[k!36 (1438156201375301632)]} 0 0
[junit4:junit4] 2> 679255 T1493 C623 P19626 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19630/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[k!36 (1438156201375301632)]} 0 4
[junit4:junit4] 2> 679256 T1515 C625 P19630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!36]} 0 7
[junit4:junit4] 2> 679259 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!37 (1438156201383690240)]} 0 0
[junit4:junit4] 2> 679267 T1544 C624 P19639 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19630/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[l!37 (1438156201388933120)]} 0 0
[junit4:junit4] 2> 679268 T1513 C625 P19630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19626/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[l!37 (1438156201388933120)]} 0 4
[junit4:junit4] 2> 679269 T1497 C623 P19626 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!37]} 0 7
[junit4:junit4] 2> 679272 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!38 (1438156201397321728)]} 0 0
[junit4:junit4] 2> 679278 T1544 C624 P19639 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19630/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[m!38 (1438156201400467456)]} 0 0
[junit4:junit4] 2> 679279 T1515 C625 P19630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!38 (1438156201400467456)]} 0 4
[junit4:junit4] 2> 679282 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!39 (1438156201407807488)]} 0 0
[junit4:junit4] 2> 679288 T1525 C622 P19635 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19626/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[n!39 (1438156201410953216)]} 0 0
[junit4:junit4] 2> 679289 T1497 C623 P19626 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!39 (1438156201410953216)]} 0 4
[junit4:junit4] 2> 679293 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!40 (1438156201419341824)]} 0 0
[junit4:junit4] 2> 679301 T1544 C624 P19639 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19630/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[o!40 (1438156201424584704)]} 0 0
[junit4:junit4] 2> 679302 T1513 C625 P19630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19626/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[o!40 (1438156201424584704)]} 0 4
[junit4:junit4] 2> 679303 T1497 C623 P19626 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!40]} 0 7
[junit4:junit4] 2> 679306 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!41 (1438156201432973312)]} 0 0
[junit4:junit4] 2> 679313 T1525 C622 P19635 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19626/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[p!41 (1438156201436119040)]} 0 0
[junit4:junit4] 2> 679313 T1497 C623 P19626 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!41 (1438156201436119040)]} 0 4
[junit4:junit4] 2> 679316 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!42 (1438156201443459072)]} 0 0
[junit4:junit4] 2> 679324 T1525 C622 P19635 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19626/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[q!42 (1438156201448701952)]} 0 0
[junit4:junit4] 2> 679325 T1493 C623 P19626 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19630/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[q!42 (1438156201448701952)]} 0 4
[junit4:junit4] 2> 679326 T1515 C625 P19630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!42]} 0 7
[junit4:junit4] 2> 679328 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!43 (1438156201456041984)]} 0 0
[junit4:junit4] 2> 679335 T1544 C624 P19639 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19630/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[r!43 (1438156201459187712)]} 0 0
[junit4:junit4] 2> 679335 T1515 C625 P19630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!43 (1438156201459187712)]} 0 4
[junit4:junit4] 2> 679338 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!44 (1438156201466527744)]} 0 0
[junit4:junit4] 2> 679344 T1525 C622 P19635 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19626/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[s!44 (1438156201469673472)]} 0 0
[junit4:junit4] 2> 679345 T1497 C623 P19626 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!44 (1438156201469673472)]} 0 4
[junit4:junit4] 2> 679348 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!45 (1438156201477013504)]} 0 0
[junit4:junit4] 2> 679356 T1525 C622 P19635 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19626/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[t!45 (1438156201482256384)]} 0 0
[junit4:junit4] 2> 679357 T1493 C623 P19626 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19630/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[t!45 (1438156201482256384)]} 0 4
[junit4:junit4] 2> 679358 T1515 C625 P19630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!45]} 0 7
[junit4:junit4] 2> 679361 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!46 (1438156201490644992)]} 0 0
[junit4:junit4] 2> 679369 T1544 C624 P19639 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19630/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[u!46 (1438156201495887872)]} 0 0
[junit4:junit4] 2> 679370 T1513 C625 P19630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19626/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[u!46 (1438156201495887872)]} 0 4
[junit4:junit4] 2> 679371 T1497 C623 P19626 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!46]} 0 7
[junit4:junit4] 2> 679374 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[v!47 (1438156201504276480)]} 0 0
[junit4:junit4] 2> 679382 T1525 C622 P19635 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19626/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[v!47 (1438156201509519360)]} 0 0
[junit4:junit4] 2> 679383 T1493 C623 P19626 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19630/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[v!47 (1438156201509519360)]} 0 4
[junit4:junit4] 2> 679384 T1515 C625 P19630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[v!47]} 0 7
[junit4:junit4] 2> 679387 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[w!48 (1438156201517907968)]} 0 0
[junit4:junit4] 2> 679397 T1525 C622 P19635 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19626/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[w!48 (1438156201523150848)]} 0 1
[junit4:junit4] 2> 679397 T1493 C623 P19626 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19630/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[w!48 (1438156201523150848)]} 0 5
[junit4:junit4] 2> 679398 T1515 C625 P19630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[w!48]} 0 8
[junit4:junit4] 2> 679401 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[x!49 (1438156201532588032)]} 0 0
[junit4:junit4] 2> 679409 T1544 C624 P19639 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19630/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[x!49 (1438156201537830912)]} 0 0
[junit4:junit4] 2> 679410 T1513 C625 P19630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19626/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[x!49 (1438156201537830912)]} 0 4
[junit4:junit4] 2> 679411 T1497 C623 P19626 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[x!49]} 0 7
[junit4:junit4] 2> 679414 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[y!50 (1438156201546219520)]} 0 0
[junit4:junit4] 2> 679422 T1544 C624 P19639 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19630/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[y!50 (1438156201551462400)]} 0 0
[junit4:junit4] 2> 679423 T1513 C625 P19630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19626/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[y!50 (1438156201551462400)]} 0 4
[junit4:junit4] 2> 679424 T1497 C623 P19626 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[y!50]} 0 7
[junit4:junit4] 2> 679427 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[z!51 (1438156201559851008)]} 0 0
[junit4:junit4] 2> 679433 T1525 C622 P19635 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19626/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[z!51 (1438156201562996736)]} 0 0
[junit4:junit4] 2> 679434 T1497 C623 P19626 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[z!51 (1438156201562996736)]} 0 4
[junit4:junit4] 2> 679437 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!52 (1438156201570336768)]} 0 0
[junit4:junit4] 2> 679443 T1544 C624 P19639 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19630/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!52 (1438156201573482496)]} 0 0
[junit4:junit4] 2> 679444 T1515 C625 P19630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!52 (1438156201573482496)]} 0 4
[junit4:junit4] 2> 679447 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!53 (1438156201580822528)]} 0 0
[junit4:junit4] 2> 679456 T1525 C622 P19635 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19626/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!53 (1438156201586065408)]} 0 1
[junit4:junit4] 2> 679456 T1493 C623 P19626 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19630/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[b!53 (1438156201586065408)]} 0 4
[junit4:junit4] 2> 679457 T1515 C625 P19630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!53]} 0 7
[junit4:junit4] 2> 679460 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!54 (1438156201594454016)]} 0 0
[junit4:junit4] 2> 679468 T1525 C622 P19635 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19626/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!54 (1438156201599696896)]} 0 0
[junit4:junit4] 2> 679469 T1493 C623 P19626 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19630/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[c!54 (1438156201599696896)]} 0 4
[junit4:junit4] 2> 679470 T1515 C625 P19630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!54]} 0 7
[junit4:junit4] 2> 679473 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!55 (1438156201608085504)]} 0 0
[junit4:junit4] 2> 679481 T1544 C624 P19639 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19630/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!55 (1438156201613328384)]} 0 0
[junit4:junit4] 2> 679482 T1513 C625 P19630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19626/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[d!55 (1438156201613328384)]} 0 4
[junit4:junit4] 2> 679483 T1497 C623 P19626 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!55]} 0 7
[junit4:junit4] 2> 679485 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!56 (1438156201620668416)]} 0 0
[junit4:junit4] 2> 679493 T1544 C624 P19639 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19630/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!56 (1438156201625911296)]} 0 0
[junit4:junit4] 2> 679494 T1513 C625 P19630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19626/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[e!56 (1438156201625911296)]} 0 4
[junit4:junit4] 2> 679495 T1497 C623 P19626 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!56]} 0 7
[junit4:junit4] 2> 679499 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!57 (1438156201634299904)]} 0 1
[junit4:junit4] 2> 679506 T1544 C624 P19639 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19630/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!57 (1438156201639542784)]} 0 0
[junit4:junit4] 2> 679507 T1513 C625 P19630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19626/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[f!57 (1438156201639542784)]} 0 4
[junit4:junit4] 2> 679508 T1497 C623 P19626 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!57]} 0 7
[junit4:junit4] 2> 679511 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!58 (1438156201647931392)]} 0 0
[junit4:junit4] 2> 679519 T1525 C622 P19635 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19626/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!58 (1438156201653174272)]} 0 0
[junit4:junit4] 2> 679520 T1493 C623 P19626 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19630/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[g!58 (1438156201653174272)]} 0 4
[junit4:junit4] 2> 679521 T1515 C625 P19630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!58]} 0 7
[junit4:junit4] 2> 679523 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!59 (1438156201660514304)]} 0 0
[junit4:junit4] 2> 679531 T1525 C622 P19635 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19626/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!59 (1438156201665757184)]} 0 0
[junit4:junit4] 2> 679532 T1493 C623 P19626 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19630/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[h!59 (1438156201665757184)]} 0 4
[junit4:junit4] 2> 679533 T1515 C625 P19630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!59]} 0 7
[junit4:junit4] 2> 679536 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!60 (1438156201674145792)]} 0 0
[junit4:junit4] 2> 679542 T1525 C622 P19635 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19626/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!60 (1438156201677291520)]} 0 0
[junit4:junit4] 2> 679543 T1497 C623 P19626 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!60 (1438156201677291520)]} 0 4
[junit4:junit4] 2> 679546 T1473 C626 P19622 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!61 (1438156201684631552)]} 0 0
[junit4:junit4] 2> 679554 T1525 C622 P19635 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19626/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!61 (1438156201689874432)]} 0 0
[junit4:junit4] 2> 679555 T1493 C623 P19626 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:19630/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[j!61 (1438156201689874432)]} 0 4
[junit4:junit4] 2> 679556 T1515 C625 P19630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!61]} 0 7
[junit4:junit4] 2> 679
[...truncated too long message...]
2> 1721817 T3250 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:63819_ik_x%2Fxx_collection1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:63819_ik_x%2Fxx",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:63819/ik_x/xx"}
[junit4:junit4] 2> 1721820 T3250 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:63819_ik_x%2Fxx_collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:63819_ik_x%2Fxx",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:63819/ik_x/xx"}
[junit4:junit4] 2> 1721829 T3240 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1721832 T3158 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 63822
[junit4:junit4] 2> 1721832 T3158 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1120341647
[junit4:junit4] 2> 1721989 T3180 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 1721989 T3180 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1721989 T3180 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 1722835 T3158 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1722835 T3158 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1722837 T3158 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@2d0b5de3
[junit4:junit4] 2> 1722846 T3158 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=43,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=74,cumulative_deletesById=34,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 1722847 T3158 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 1722848 T3158 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 1722848 T3158 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 1722851 T3158 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 1722851 T3158 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 1722852 T3158 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.RecoveryZkTest-1371533562554/jetty2/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.RecoveryZkTest-1371533562554/jetty2/index;done=false>>]
[junit4:junit4] 2> 1722852 T3158 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.RecoveryZkTest-1371533562554/jetty2/index
[junit4:junit4] 2> 1722853 T3158 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.RecoveryZkTest-1371533562554/jetty2 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.RecoveryZkTest-1371533562554/jetty2;done=false>>]
[junit4:junit4] 2> 1722853 T3158 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.RecoveryZkTest-1371533562554/jetty2
[junit4:junit4] 2> 1722854 T3250 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89884823556063242-127.0.0.1:63822_ik_x%2Fxx-n_0000000003) am no longer a leader.
[junit4:junit4] 2> 1722856 T3240 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1722856 T3240 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 1722856 T3158 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/ik_x/xx,null}
[junit4:junit4] 2> 1722856 T3240 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 1722922 T3158 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4] 2> 1722924 T3158 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:63812 63812
[junit4:junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4] 1> safe stop:
[junit4:junit4] 1> safe stop:
[junit4:junit4] 1> safe stop:
[junit4:junit4] 1> safe stop:
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=RecoveryZkTest -Dtests.method=testDistribSearch -Dtests.seed=7E1360AB42849902 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=de_CH -Dtests.timezone=Europe/Warsaw -Dtests.file.encoding=ISO-8859-1
[junit4:junit4] FAILURE 114s J1 | RecoveryZkTest.testDistribSearch <<<
[junit4:junit4] > Throwable #1: java.lang.AssertionError: expected:<182> but was:<74>
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([7E1360AB42849902:FFF5EEB335DBF93E]:0)
[junit4:junit4] > at org.apache.solr.cloud.RecoveryZkTest.doTest(RecoveryZkTest.java:108)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 1723078 T3158 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> NOTE: test params are: codec=FastDecompressionCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST_DECOMPRESSION, chunkSize=310), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST_DECOMPRESSION, chunkSize=310)), sim=RandomSimilarityProvider(queryNorm=true,coord=yes): {}, locale=de_CH, timezone=Europe/Warsaw
[junit4:junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_21 (64-bit)/cpus=16,threads=1,free=125389904,total=533725184
[junit4:junit4] 2> NOTE: All tests run in this JVM: [LukeRequestHandlerTest, CircularListTest, TestDFRSimilarityFactory, TestJoin, SolrTestCaseJ4Test, NotRequiredUniqueKeyTest, TestArbitraryIndexDir, OutputWriterTest, QueryParsingTest, SliceStateUpdateTest, QueryResultKeyTest, TestPropInject, TestDynamicFieldResource, SuggesterWFSTTest, CopyFieldTest, CurrencyFieldXmlFileTest, WordBreakSolrSpellCheckerTest, ResourceLoaderTest, QueryEqualityTest, DOMUtilTest, TestCharFilters, TestDocSet, DistributedQueryElevationComponentTest, ClusterStateTest, RAMDirectoryFactoryTest, FastVectorHighlighterTest, TestUpdate, TestQueryTypes, TestQuerySenderListener, HighlighterConfigTest, TestIndexingPerformance, SpellCheckComponentTest, AutoCommitTest, TestFunctionQuery, CachingDirectoryFactoryTest, TestBinaryResponseWriter, DirectSolrConnectionTest, TestReloadAndDeleteDocs, ChaosMonkeySafeLeaderTest, XmlUpdateRequestHandlerTest, TestDynamicFieldCollectionResource, SearchHandlerTest, XsltUpdateRequestHandlerTest, DirectSolrSpellCheckerTest, TestRealTimeGet, ScriptEngineTest, TestPartialUpdateDeduplication, SolrIndexConfigTest, ShardRoutingCustomTest, DistributedTermsComponentTest, PluginInfoTest, FieldAnalysisRequestHandlerTest, TestSolrCoreProperties, RequestHandlersTest, TestSweetSpotSimilarityFactory, ClusterStateUpdateTest, DisMaxRequestHandlerTest, StatsComponentTest, TestDistributedSearch, ShardSplitTest, TestNumberUtils, TestCollationField, ChaosMonkeyShardSplitTest, TestFastWriter, SolrCmdDistributorTest, TestTrie, AnalysisAfterCoreReloadTest, SystemInfoHandlerTest, DocumentAnalysisRequestHandlerTest, BadIndexSchemaTest, TestRandomDVFaceting, TestReplicationHandler, UnloadDistributedZkTest, LeaderElectionIntegrationTest, RecoveryZkTest]
[junit4:junit4] Completed on J1 in 113.54s, 1 test, 1 failure <<< FAILURES!
[...truncated 421 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:392: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:372: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build.xml:181: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/common-build.xml:437: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:1246: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:890: There were test failures: 298 suites, 1253 tests, 1 error, 1 failure, 13 ignored (7 assumptions)
Total time: 54 minutes 34 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-Tests-4.x-Java7 - Build # 1339 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java7/1339/
3 tests failed.
REGRESSION: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.testDistribSearch
Error Message:
shard2 is not consistent. Got 625 from http://127.0.0.1:46686/collection1lastClient and got 456 from http://127.0.0.1:49398/collection1
Stack Trace:
java.lang.AssertionError: shard2 is not consistent. Got 625 from http://127.0.0.1:46686/collection1lastClient and got 456 from http://127.0.0.1:49398/collection1
at __randomizedtesting.SeedInfo.seed([A4E4A8173AFE001B:2502260F4DA16027]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1018)
at org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.doTest(ChaosMonkeySafeLeaderTest.java:137)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
REGRESSION: org.apache.solr.cloud.SyncSliceTest.testDistribSearch
Error Message:
shard1 is not consistent. Got 305 from http://127.0.0.1:34189/mc/m/collection1lastClient and got 256 from http://127.0.0.1:58346/mc/m/collection1
Stack Trace:
java.lang.AssertionError: shard1 is not consistent. Got 305 from http://127.0.0.1:34189/mc/m/collection1lastClient and got 256 from http://127.0.0.1:58346/mc/m/collection1
at __randomizedtesting.SeedInfo.seed([A4E4A8173AFE001B:2502260F4DA16027]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1018)
at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:238)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
FAILED: org.apache.solr.cloud.ChaosMonkeyShardSplitTest.testDistribSearch
Error Message:
Server at http://127.0.0.1:34569/zd/rp returned non ok status:500, message:Server Error
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:34569/zd/rp returned non ok status:500, message:Server Error
at __randomizedtesting.SeedInfo.seed([A4E4A8173AFE001B:2502260F4DA16027]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:228)
at org.apache.solr.cloud.ChaosMonkeyShardSplitTest.doTest(ChaosMonkeyShardSplitTest.java:136)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9589 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.ChaosMonkeyShardSplitTest
[junit4:junit4] 2> 533290 T1892 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /zd/rp
[junit4:junit4] 2> 533297 T1892 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solrtest-ChaosMonkeyShardSplitTest-1371515991204
[junit4:junit4] 2> 533299 T1892 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 533299 T1893 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 533400 T1892 oasc.ZkTestServer.run start zk server on port:62950
[junit4:junit4] 2> 533401 T1892 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 533407 T1899 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4fb5f4ae name:ZooKeeperConnection Watcher:127.0.0.1:62950 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 533407 T1892 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 533408 T1892 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 533427 T1892 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 533432 T1901 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@13f1d38 name:ZooKeeperConnection Watcher:127.0.0.1:62950/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 533433 T1892 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 533433 T1892 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 533447 T1892 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 533450 T1892 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 533453 T1892 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 533461 T1892 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 533462 T1892 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 533475 T1892 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 533476 T1892 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 533580 T1892 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 533581 T1892 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 533584 T1892 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 533585 T1892 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 533594 T1892 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 533595 T1892 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 533598 T1892 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 533599 T1892 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 533603 T1892 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 533604 T1892 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 533607 T1892 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 533608 T1892 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 533611 T1892 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 533612 T1892 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 533887 T1892 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 533892 T1892 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:55115
[junit4:junit4] 2> 533893 T1892 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 533893 T1892 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 533894 T1892 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1371515991523
[junit4:junit4] 2> 533894 T1892 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1371515991523/solr.xml
[junit4:junit4] 2> 533895 T1892 oasc.CoreContainer.<init> New CoreContainer 1937537490
[junit4:junit4] 2> 533896 T1892 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1371515991523/'
[junit4:junit4] 2> 533896 T1892 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1371515991523/'
[junit4:junit4] 2> 534028 T1892 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 534029 T1892 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 534030 T1892 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 534030 T1892 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 534031 T1892 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 534031 T1892 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 534032 T1892 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 534032 T1892 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 534033 T1892 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 534033 T1892 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 534049 T1892 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 534050 T1892 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:62950/solr
[junit4:junit4] 2> 534051 T1892 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 534052 T1892 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 534055 T1912 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4cb74520 name:ZooKeeperConnection Watcher:127.0.0.1:62950 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 534055 T1892 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 534058 T1892 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 534069 T1892 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 534071 T1914 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2b58382c name:ZooKeeperConnection Watcher:127.0.0.1:62950/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 534071 T1892 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 534074 T1892 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 534084 T1892 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 534088 T1892 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 534095 T1892 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55115_zd%2Frp
[junit4:junit4] 2> 534096 T1892 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55115_zd%2Frp
[junit4:junit4] 2> 534100 T1892 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 534117 T1892 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 534120 T1892 oasc.Overseer.start Overseer (id=89883672000069635-127.0.0.1:55115_zd%2Frp-n_0000000000) starting
[junit4:junit4] 2> 534130 T1892 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 534140 T1916 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 534141 T1892 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 534144 T1892 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 534146 T1892 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 534149 T1915 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 534154 T1917 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 534154 T1917 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 535654 T1915 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 535655 T1915 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:55115_zd%2Frp",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:55115/zd/rp"}
[junit4:junit4] 2> 535655 T1915 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 535655 T1915 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 535699 T1914 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 536157 T1917 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1371515991523/collection1
[junit4:junit4] 2> 536157 T1917 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 536158 T1917 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 536159 T1917 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 536160 T1917 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1371515991523/collection1/'
[junit4:junit4] 2> 536162 T1917 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1371515991523/collection1/lib/README' to classloader
[junit4:junit4] 2> 536162 T1917 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1371515991523/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 536216 T1917 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 536279 T1917 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 536380 T1917 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 536386 T1917 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 536971 T1917 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 536975 T1917 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 536978 T1917 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 536983 T1917 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 537011 T1917 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 537011 T1917 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1371515991523/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371515991204/control/data/
[junit4:junit4] 2> 537012 T1917 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@44e979ea
[junit4:junit4] 2> 537012 T1917 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 537013 T1917 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371515991204/control/data
[junit4:junit4] 2> 537013 T1917 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371515991204/control/data/index/
[junit4:junit4] 2> 537014 T1917 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371515991204/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 537014 T1917 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371515991204/control/data/index
[junit4:junit4] 2> 537019 T1917 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@74812e0c lockFactory=org.apache.lucene.store.NativeFSLockFactory@4f0c28b8),segFN=segments_1,generation=1}
[junit4:junit4] 2> 537019 T1917 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 537023 T1917 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 537023 T1917 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 537024 T1917 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 537025 T1917 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 537025 T1917 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 537025 T1917 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 537026 T1917 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 537026 T1917 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 537027 T1917 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 537044 T1917 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 537051 T1917 oass.SolrIndexSearcher.<init> Opening Searcher@2f61cde main
[junit4:junit4] 2> 537052 T1917 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371515991204/control/data/tlog
[junit4:junit4] 2> 537053 T1917 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 537053 T1917 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 537057 T1918 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2f61cde main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 537059 T1917 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 537059 T1917 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:55115/zd/rp collection:control_collection shard:shard1
[junit4:junit4] 2> 537060 T1917 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 537082 T1917 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 537093 T1917 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 537094 T1917 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 537094 T1917 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:55115/zd/rp/collection1/
[junit4:junit4] 2> 537094 T1917 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 537095 T1917 oasc.SyncStrategy.syncToMe http://127.0.0.1:55115/zd/rp/collection1/ has no replicas
[junit4:junit4] 2> 537095 T1917 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:55115/zd/rp/collection1/
[junit4:junit4] 2> 537095 T1917 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 537204 T1915 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 537219 T1914 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 537263 T1917 oasc.ZkController.register We are http://127.0.0.1:55115/zd/rp/collection1/ and leader is http://127.0.0.1:55115/zd/rp/collection1/
[junit4:junit4] 2> 537263 T1917 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:55115/zd/rp
[junit4:junit4] 2> 537263 T1917 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 537263 T1917 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 537264 T1917 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 537266 T1917 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 537267 T1892 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 537268 T1892 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 537268 T1892 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 537286 T1892 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 537288 T1892 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 537290 T1921 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@57bb5c8e name:ZooKeeperConnection Watcher:127.0.0.1:62950/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 537290 T1892 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 537292 T1892 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 537295 T1892 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 537560 T1892 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 537563 T1892 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:34569
[junit4:junit4] 2> 537563 T1892 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 537564 T1892 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 537565 T1892 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1371515995201
[junit4:junit4] 2> 537565 T1892 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1371515995201/solr.xml
[junit4:junit4] 2> 537566 T1892 oasc.CoreContainer.<init> New CoreContainer 83902952
[junit4:junit4] 2> 537567 T1892 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1371515995201/'
[junit4:junit4] 2> 537567 T1892 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1371515995201/'
[junit4:junit4] 2> 537696 T1892 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 537697 T1892 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 537698 T1892 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 537698 T1892 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 537699 T1892 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 537699 T1892 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 537700 T1892 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 537700 T1892 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 537701 T1892 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 537701 T1892 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 537719 T1892 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 537719 T1892 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:62950/solr
[junit4:junit4] 2> 537720 T1892 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 537721 T1892 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 537724 T1932 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@47317448 name:ZooKeeperConnection Watcher:127.0.0.1:62950 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 537725 T1892 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 537741 T1892 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 537753 T1892 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 537756 T1934 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7a10bec8 name:ZooKeeperConnection Watcher:127.0.0.1:62950/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 537756 T1892 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 537767 T1892 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 538732 T1915 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 538733 T1915 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:55115_zd%2Frp_collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:55115_zd%2Frp",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:55115/zd/rp"}
[junit4:junit4] 2> 538747 T1914 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 538747 T1921 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 538747 T1934 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 538771 T1892 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34569_zd%2Frp
[junit4:junit4] 2> 538773 T1892 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:34569_zd%2Frp
[junit4:junit4] 2> 538776 T1921 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 538776 T1914 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 538776 T1934 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 538776 T1914 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 538776 T1934 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 538777 T1921 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 538785 T1935 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 538785 T1935 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 540258 T1915 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 540259 T1915 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:34569_zd%2Frp",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:34569/zd/rp"}
[junit4:junit4] 2> 540259 T1915 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 540259 T1915 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 540275 T1934 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 540275 T1921 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 540275 T1914 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 540788 T1935 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1371515995201/collection1
[junit4:junit4] 2> 540788 T1935 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 540789 T1935 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 540790 T1935 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 540792 T1935 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1371515995201/collection1/'
[junit4:junit4] 2> 540793 T1935 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1371515995201/collection1/lib/README' to classloader
[junit4:junit4] 2> 540794 T1935 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1371515995201/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 540851 T1935 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 540916 T1935 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 541023 T1935 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 541028 T1935 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 541425 T1935 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 541428 T1935 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 541430 T1935 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 541434 T1935 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 541457 T1935 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 541458 T1935 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1371515995201/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371515991204/jetty1/
[junit4:junit4] 2> 541458 T1935 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@44e979ea
[junit4:junit4] 2> 541459 T1935 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 541459 T1935 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371515991204/jetty1
[junit4:junit4] 2> 541460 T1935 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371515991204/jetty1/index/
[junit4:junit4] 2> 541460 T1935 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371515991204/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 541460 T1935 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371515991204/jetty1/index
[junit4:junit4] 2> 541463 T1935 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@55976d4e lockFactory=org.apache.lucene.store.NativeFSLockFactory@6e3a732b),segFN=segments_1,generation=1}
[junit4:junit4] 2> 541463 T1935 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 541466 T1935 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 541466 T1935 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 541467 T1935 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 541467 T1935 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 541468 T1935 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 541468 T1935 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 541468 T1935 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 541468 T1935 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 541469 T1935 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 541480 T1935 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 541486 T1935 oass.SolrIndexSearcher.<init> Opening Searcher@5ad7b772 main
[junit4:junit4] 2> 541486 T1935 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371515991204/jetty1/tlog
[junit4:junit4] 2> 541487 T1935 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 541488 T1935 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 541491 T1936 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5ad7b772 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 541493 T1935 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 541493 T1935 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:34569/zd/rp collection:collection1 shard:shard1
[junit4:junit4] 2> 541494 T1935 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 541512 T1935 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 541515 T1935 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 541516 T1935 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 541516 T1935 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:34569/zd/rp/collection1/
[junit4:junit4] 2> 541516 T1935 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 541517 T1935 oasc.SyncStrategy.syncToMe http://127.0.0.1:34569/zd/rp/collection1/ has no replicas
[junit4:junit4] 2> 541517 T1935 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:34569/zd/rp/collection1/
[junit4:junit4] 2> 541517 T1935 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 541780 T1915 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 541799 T1914 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 541799 T1921 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 541799 T1934 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 541830 T1935 oasc.ZkController.register We are http://127.0.0.1:34569/zd/rp/collection1/ and leader is http://127.0.0.1:34569/zd/rp/collection1/
[junit4:junit4] 2> 541830 T1935 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:34569/zd/rp
[junit4:junit4] 2> 541830 T1935 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 541830 T1935 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 541831 T1935 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 541833 T1935 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 541834 T1892 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 541834 T1892 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 541835 T1892 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 542128 T1892 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 542131 T1892 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:28682
[junit4:junit4] 2> 542132 T1892 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 542133 T1892 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 542133 T1892 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1371515999757
[junit4:junit4] 2> 542134 T1892 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1371515999757/solr.xml
[junit4:junit4] 2> 542134 T1892 oasc.CoreContainer.<init> New CoreContainer 837918191
[junit4:junit4] 2> 542135 T1892 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1371515999757/'
[junit4:junit4] 2> 542136 T1892 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1371515999757/'
[junit4:junit4] 2> 542268 T1892 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 542269 T1892 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 542269 T1892 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 542270 T1892 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 542270 T1892 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 542271 T1892 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 542271 T1892 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 542272 T1892 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 542273 T1892 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 542273 T1892 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 542289 T1892 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 542290 T1892 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:62950/solr
[junit4:junit4] 2> 542290 T1892 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 542292 T1892 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 542295 T1948 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@40590f0b name:ZooKeeperConnection Watcher:127.0.0.1:62950 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 542295 T1892 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 542308 T1892 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 542319 T1892 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 542321 T1950 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@26684dea name:ZooKeeperConnection Watcher:127.0.0.1:62950/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 542321 T1892 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 542332 T1892 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 543313 T1915 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 543314 T1915 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:34569_zd%2Frp_collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:34569_zd%2Frp",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:34569/zd/rp"}
[junit4:junit4] 2> 543330 T1950 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 543330 T1921 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 543330 T1934 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 543330 T1914 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 543341 T1892 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:28682_zd%2Frp
[junit4:junit4] 2> 543343 T1892 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:28682_zd%2Frp
[junit4:junit4] 2> 543350 T1950 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 543350 T1921 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 543350 T1914 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 543351 T1934 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 543351 T1914 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 543351 T1934 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 543352 T1950 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 543354 T1921 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 543358 T1951 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 543358 T1951 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 544843 T1915 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 544844 T1915 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:28682_zd%2Frp",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:28682/zd/rp"}
[junit4:junit4] 2> 544845 T1915 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 544845 T1915 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 544862 T1950 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 544862 T1914 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 544862 T1921 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 544862 T1934 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 545362 T1951 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1371515999757/collection1
[junit4:junit4] 2> 545362 T1951 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 545364 T1951 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 545364 T1951 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 545366 T1951 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1371515999757/collection1/'
[junit4:junit4] 2> 545367 T1951 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1371515999757/collection1/lib/README' to classloader
[junit4:junit4] 2> 545368 T1951 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1371515999757/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 545429 T1951 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 545497 T1951 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 545599 T1951 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 545605 T1951 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 546257 T1951 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 546262 T1951 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 546265 T1951 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 546270 T1951 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 546296 T1951 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 546296 T1951 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1371515999757/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371515991204/jetty2/
[junit4:junit4] 2> 546297 T1951 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@44e979ea
[junit4:junit4] 2> 546297 T1951 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 546298 T1951 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371515991204/jetty2
[junit4:junit4] 2> 546299 T1951 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371515991204/jetty2/index/
[junit4:junit4] 2> 546299 T1951 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371515991204/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 546299 T1951 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371515991204/jetty2/index
[junit4:junit4] 2> 546304 T1951 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3e07e88 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1474905f),segFN=segments_1,generation=1}
[junit4:junit4] 2> 546304 T1951 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 546307 T1951 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 546308 T1951 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 546309 T1951 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 546309 T1951 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 546310 T1951 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 546310 T1951 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 546311 T1951 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 546311 T1951 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 546312 T1951 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 546332 T1951 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 546341 T1951 oass.SolrIndexSearcher.<init> Opening Searcher@3970a3cd main
[junit4:junit4] 2> 546341 T1951 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371515991204/jetty2/tlog
[junit4:junit4] 2> 546342 T1951 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 546343 T1951 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 546347 T1952 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3970a3cd main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 546349 T1951 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 546349 T1951 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:28682/zd/rp collection:collection1 shard:shard2
[junit4:junit4] 2> 546350 T1951 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 546371 T1951 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 546382 T1951 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 546382 T1951 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 546382 T1951 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:28682/zd/rp/collection1/
[junit4:junit4] 2> 546383 T1951 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 546383 T1951 oasc.SyncStrategy.syncToMe http://127.0.0.1:28682/zd/rp/collection1/ has no replicas
[junit4:junit4] 2> 546383 T1951 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:28682/zd/rp/collection1/
[junit4:junit4] 2> 546383 T1951 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 547872 T1915 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 547943 T1950 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 547943 T1921 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 547943 T1914 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 547943 T1934 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 547978 T1951 oasc.ZkController.register We are http://127.0.0.1:28682/zd/rp/collection1/ and leader is http://127.0.0.1:28682/zd/rp/collection1/
[junit4:junit4] 2> 547978 T1951 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:28682/zd/rp
[junit4:junit4] 2> 547978 T1951 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 547979 T1951 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 547979 T1951 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 548045 T1951 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 548046 T1892 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 548047 T1892 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 548048 T1892 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 548388 T1892 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 548392 T1892 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:24128
[junit4:junit4] 2> 548393 T1892 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 548393 T1892 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 548394 T1892 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1371516005975
[junit4:junit4] 2> 548394 T1892 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1371516005975/solr.xml
[junit4:junit4] 2> 548395 T1892 oasc.CoreContainer.<init> New CoreContainer 278838644
[junit4:junit4] 2> 548396 T1892 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1371516005975/'
[junit4:junit4] 2> 548396 T1892 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1371516005975/'
[junit4:junit4] 2> 548557 T1892 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 548558 T1892 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 548558 T1892 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 548559 T1892 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 548560 T1892 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 548560 T1892 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 548561 T1892 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 548561 T1892 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 548562 T1892 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 548562 T1892 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 548583 T1892 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 548584 T1892 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:62950/solr
[junit4:junit4] 2> 548584 T1892 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 548585 T1892 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 548618 T1964 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@424e7336 name:ZooKeeperConnection Watcher:127.0.0.1:62950 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 548618 T1892 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 548640 T1892 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 548653 T1892 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 548655 T1966 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5e28c21c name:ZooKeeperConnection Watcher:127.0.0.1:62950/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 548656 T1892 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 548661 T1892 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 549547 T1915 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 549548 T1915 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:28682_zd%2Frp_collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:28682_zd%2Frp",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:28682/zd/rp"}
[junit4:junit4] 2> 549553 T1950 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 549553 T1966 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 549553 T1934 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 549553 T1921 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 549553 T1914 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 549665 T1892 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:24128_zd%2Frp
[junit4:junit4] 2> 549667 T1892 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:24128_zd%2Frp
[junit4:junit4] 2> 549669 T1950 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 549669 T1914 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 549669 T1934 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 549669 T1966 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 549669 T1921 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 549670 T1966 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 549670 T1934 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 549670 T1914 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 549671 T1950 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 549672 T1921 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 549675 T1967 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 549676 T1967 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 551072 T1915 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 551073 T1915 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:24128_zd%2Frp",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:24128/zd/rp"}
[junit4:junit4] 2> 551073 T1915 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 551073 T1915 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 551114 T1950 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 551114 T1914 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 551114 T1966 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 551114 T1921 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 551114 T1934 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 551679 T1967 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1371516005975/collection1
[junit4:junit4] 2> 551679 T1967 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 551680 T1967 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 551680 T1967 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 551681 T1967 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1371516005975/collection1/'
[junit4:junit4] 2> 551682 T1967 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1371516005975/collection1/lib/README' to classloader
[junit4:junit4] 2> 551683 T1967 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1371516005975/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 551719 T1967 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 551761 T1967 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 551862 T1967 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 551866 T1967 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 552275 T1967 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 552278 T1967 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 552279 T1967 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 552284 T1967 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 552304 T1967 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 552305 T1967 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1371516005975/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371515991204/jetty3/
[junit4:junit4] 2> 552305 T1967 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@44e979ea
[junit4:junit4] 2> 552306 T1967 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 552306 T1967 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371515991204/jetty3
[junit4:junit4] 2> 552306 T1967 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371515991204/jetty3/index/
[junit4:junit4] 2> 552307 T1967 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371515991204/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 552307 T1967 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371515991204/jetty3/index
[junit4:junit4] 2> 552310 T1967 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5fb42527 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1fdb22b6),segFN=segments_1,generation=1}
[junit4:junit4] 2> 552310 T1967 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 552312 T1967 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 552313 T1967 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 552313 T1967 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 552314 T1967 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 552314 T1967 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 552314 T1967 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 552315 T1967 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 552315 T1967 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 552315 T1967 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 552327 T1967 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 552332 T1967 oass.SolrIndexSearcher.<init> Opening Searcher@1fbbf4cb main
[junit4:junit4] 2> 552333 T1967 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371515991204/jetty3/tlog
[junit4:junit4] 2> 552334 T1967 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 552334 T1967 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 552337 T1968 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1fbbf4cb main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 552339 T1967 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 552339 T1967 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:24128/zd/rp collection:collection1 shard:shard1
[junit4:junit4] 2> 552378 T1967 oasc.ZkController.register We are http://127.0.0.1:24128/zd/rp/collection1/ and leader is http://127.0.0.1:34569/zd/rp/collection1/
[junit4:junit4] 2> 552379 T1967 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:24128/zd/rp
[junit4:junit4] 2> 552379 T1967 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 552379 T1967 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C566 name=collection1 org.apache.solr.core.SolrCore@3a3cc380 url=http://127.0.0.1:24128/zd/rp/collection1 node=127.0.0.1:24128_zd%2Frp C566_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:24128_zd%2Frp, base_url=http://127.0.0.1:24128/zd/rp}
[junit4:junit4] 2> 552380 T1969 C566 P24128 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 552380 T1967 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 552380 T1969 C566 P24128 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 552381 T1969 C566 P24128 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 552381 T1969 C566 P24128 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 552381 T1892 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 552382 T1892 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 552382 T1969 C566 P24128 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 552382 T1892 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 552397 T1924 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:24128_zd%2Frp_collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 552592 T1892 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 552594 T1892 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:44781
[junit4:junit4] 2> 552594 T1892 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 552595 T1892 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 552595 T1892 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1371516010302
[junit4:junit4] 2> 552596 T1892 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1371516010302/solr.xml
[junit4:junit4] 2> 552596 T1892 oasc.CoreContainer.<init> New CoreContainer 31811592
[junit4:junit4] 2> 552596 T1892 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1371516010302/'
[junit4:junit4] 2> 552597 T1892 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1371516010302/'
[junit4:junit4] 2> 552626 T1915 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 552627 T1915 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:24128_zd%2Frp_collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:24128_zd%2Frp",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:24128/zd/rp"}
[junit4:junit4] 2> 552643 T1950 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 552643 T1966 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 552643 T1934 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 552643 T1921 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 552643 T1914 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 552685 T1892 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 552686 T1892 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 552686 T1892 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 552687 T1892 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 552687 T1892 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 552687 T1892 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 552688 T1892 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 552688 T1892 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 552688 T1892 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 552689 T1892 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 552701 T1892 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 552702 T1892 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:62950/solr
[junit4:junit4] 2> 552702 T1892 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 552703 T1892 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 552705 T1981 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@137b03f2 name:ZooKeeperConnection Watcher:127.0.0.1:62950 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 552706 T1892 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 552708 T1892 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 552717 T1892 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 552718 T1983 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7b90c764 name:ZooKeeperConnection Watcher:127.0.0.1:62950/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 552718 T1892 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 552730 T1892 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 553399 T1924 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:24128_zd%2Frp_collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 553399 T1924 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:24128_zd%252Frp_collection1&state=recovering&nodeName=127.0.0.1:24128_zd%252Frp&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1002
[junit4:junit4] 2> 553733 T1892 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44781_zd%2Frp
[junit4:junit4] 2> 553737 T1892 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:44781_zd%2Frp
[junit4:junit4] 2> 553740 T1950 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 553741 T1921 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 553741 T1914 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 553741 T1934 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 553742 T1983 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 553742 T1914 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 553741 T1966 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 553742 T1934 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 553742 T1966 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 553742 T1950 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 553743 T1921 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 553762 T1984 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 553762 T1984 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 554147 T1915 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 554148 T1915 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:44781_zd%2Frp",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:44781/zd/rp"}
[junit4:junit4] 2> 554148 T1915 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 554149 T1915 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 554167 T1966 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 554167 T1983 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 554167 T1921 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 554167 T1950 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 554167 T1934 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 554167 T1914 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 554765 T1984 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1371516010302/collection1
[junit4:junit4] 2> 554765 T1984 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 554766 T1984 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 554766 T1984 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 554768 T1984 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1371516010302/collection1/'
[junit4:junit4] 2> 554769 T1984 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1371516010302/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 554769 T1984 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1371516010302/collection1/lib/README' to classloader
[junit4:junit4] 2> 554806 T1984 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 554848 T1984 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 554949 T1984 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 554953 T1984 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 555386 T1984 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 555389 T1984 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 555391 T1984 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 555396 T1984 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> ASYNC NEW_CORE C567 name=collection1 org.apache.solr.core.SolrCore@3a3cc380 url=http://127.0.0.1:24128/zd/rp/collection1 node=127.0.0.1:24128_zd%2Frp C567_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:24128_zd%2Frp, base_url=http://127.0.0.1:24128/zd/rp}
[junit4:junit4] 2> 555401 T1969 C567 P24128 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:34569/zd/rp/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 555401 T1969 C567 P24128 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:24128/zd/rp START replicas=[http://127.0.0.1:34569/zd/rp/collection1/] nUpdates=100
[junit4:junit4] 2> 555402 T1969 C567 P24128 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 555402 T1969 C567 P24128 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 555402 T1969 C567 P24128 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 555402 T1969 C567 P24128 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 555402 T1969 C567 P24128 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 555403 T1969 C567 P24128 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:34569/zd/rp/collection1/. core=collection1
[junit4:junit4] 2> 555403 T1969 C567 P24128 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C568 name=collection1 org.apache.solr.core.SolrCore@5e698118 url=http://127.0.0.1:34569/zd/rp/collection1 node=127.0.0.1:34569_zd%2Frp C568_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:34569_zd%2Frp, base_url=http://127.0.0.1:34569/zd/rp, leader=true}
[junit4:junit4] 2> 555411 T1925 C568 P34569 oasc.SolrCore.execute [collection1] webapp=/zd/rp path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 555415 T1926 C568 P34569 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 555418 T1926 C568 P34569 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@55976d4e lockFactory=org.apache.lucene.store.NativeFSLockFactory@6e3a732b),segFN=segments_1,generation=1}
[junit4:junit4] 2> 555418 T1926 C568 P34569 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 555419 T1926 C568 P34569 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@55976d4e lockFactory=org.apache.lucene.store.NativeFSLockFactory@6e3a732b),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@55976d4e lockFactory=org.apache.lucene.store.NativeFSLockFactory@6e3a732b),segFN=segments_2,generation=2}
[junit4:junit4] 2> 555419 T1926 C568 P34569 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 555420 T1984 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 555420 T1926 C568 P34569 oass.SolrIndexSearcher.<init> Opening Searcher@2b458fb6 realtime
[junit4:junit4] 2> 555420 T1984 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1371516010302/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371515991204/jetty4/
[junit4:junit4] 2> 555421 T1926 C568 P34569 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 555421 T1984 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@44e979ea
[junit4:junit4] 2> 555421 T1926 C568 P34569 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> 555422 T1984 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 555423 T1969 C567 P24128 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 555423 T1984 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371515991204/jetty4
[junit4:junit4] 2> 555423 T1969 C567 P24128 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 555423 T1984 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371515991204/jetty4/index/
[junit4:junit4] 2> 555424 T1984 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371515991204/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 555424 T1984 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371515991204/jetty4/index
[junit4:junit4] 2> 555425 T1927 C568 P34569 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 555426 T1927 C568 P34569 oasc.SolrCore.execute [collection1] webapp=/zd/rp path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=2
[junit4:junit4] 2> 555426 T1969 C567 P24128 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 555427 T1969 C567 P24128 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 555427 T1969 C567 P24128 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 555427 T1984 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@304026f6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3edda89e),segFN=segments_1,generation=1}
[junit4:junit4] 2> 555427 T1984 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 555429 T1927 C568 P34569 oasc.SolrCore.execute [collection1] webapp=/zd/rp path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 555430 T1969 C567 P24128 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 555430 T1984 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 555431 T1984 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 555431 T1969 C567 P24128 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371515991204/jetty3/index.20130618014013336
[junit4:junit4] 2> 555431 T1969 C567 P24128 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@58b69833 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1086863b) fullCopy=false
[junit4:junit4] 2> 555431 T1984 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 555432 T1984 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 555432 T1984 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 555433 T1984 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 555433 T1984 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 555434 T1984 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 555434 T1984 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 555434 T1927 C568 P34569 oasc.SolrCore.execute [collection1] webapp=/zd/rp path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 555436 T1969 C567 P24128 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 555436 T1969 C567 P24128 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 555437 T1969 C567 P24128 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 555439 T1969 C567 P24128 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5fb42527 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1fdb22b6),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5fb42527 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1fdb22b6),segFN=segments_2,generation=2}
[junit4:junit4] 2> 555440 T1969 C567 P24128 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 555440 T1969 C567 P24128 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 555440 T1969 C567 P24128 oass.SolrIndexSearcher.<init> Opening Searcher@2a3527d4 main
[junit4:junit4] 2> 555441 T1968 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2a3527d4 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 555442 T1969 C567 P24128 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371515991204/jetty3/index.20130618014013336 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371515991204/jetty3/index.20130618014013336;done=true>>]
[junit4:junit4] 2> 555442 T1969 C567 P24128 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371515991204/jetty3/index.20130618014013336
[junit4:junit4] 2> 555442 T1969 C567 P24128 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371515991204/jetty3/index.20130618014013336
[junit4:junit4] 2> 555443 T1969 C567 P24128 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 555443 T1969 C567 P24128 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 555443 T1969 C567 P24128 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 555443 T1969 C567 P24128 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 555445 T1969 C567 P24128 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 555447 T1984 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 555453 T1984 oass.SolrIndexSearcher.<init> Opening Searcher@65a788f8 main
[junit4:junit4] 2> 555454 T1984 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371515991204/jetty4/tlog
[junit4:junit4] 2> 555455 T1984 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 555455 T1984 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 555459 T1987 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@65a788f8 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 555460 T1984 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 555461 T1984 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:44781/zd/rp collection:collection1 shard:shard2
[junit4:junit4] 2> 555464 T1984 oasc.ZkController.register We are http://127.0.0.1:44781/zd/rp/collection1/ and leader is http://127.0.0.1:28682/zd/rp/collection1/
[junit4:junit4] 2> 555464 T1984 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:44781/zd/rp
[junit4:junit4] 2> 555464 T1984 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 555465 T1984 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C569 name=collection1 org.apache.solr.core.SolrCore@63de0beb url=http://127.0.0.1:44781/zd/rp/collection1 node=127.0.0.1:44781_zd%2Frp C569_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:44781_zd%2Frp, base_url=http://127.0.0.1:44781/zd/rp}
[junit4:junit4] 2> 555465 T1988 C569 P44781 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 555466 T1988 C569 P44781 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 555466 T1984 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 555466 T1988 C569 P44781 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 555467 T1988 C569 P44781 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 555467 T1892 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 555468 T1892 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 555468 T1988 C569 P44781 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 555468 T1892 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 555488 T1892 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 555489 T1940 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:44781_zd%2Frp_collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 555489 T1892 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 2> 555491 T1892 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 2> 555491 T1892 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 555672 T1915 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 555673 T1915 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:24128_zd%2Frp_collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:24128_zd%2Frp",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:24128/zd/rp"}
[junit4:junit4] 2> 555676 T1915 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:44781_zd%2Frp_collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:44781_zd%2Frp",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:44781/zd/rp"}
[junit4:junit4] 2> 555693 T1950 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 555693 T1934 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 555693 T1966 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 555693 T1983 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 555693 T1921 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 555693 T1914 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 556491 T1940 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:44781_zd%2Frp_collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 556491 T1940 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:44781_zd%252Frp_collection1&state=recovering&nodeName=127.0.0.1:44781_zd%252Frp&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1002
[junit4:junit4] 2> 556493 T1892 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 557495 T1892 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C569_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:44781_zd%2Frp, base_url=http://127.0.0.1:44781/zd/rp}
[junit4:junit4] 2> 558493 T1988 C569 P44781 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:28682/zd/rp/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 558493 T1988 C569 P44781 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:44781/zd/rp START replicas=[http://127.0.0.1:28682/zd/rp/collection1/] nUpdates=100
[junit4:junit4] 2> 558494 T1988 C569 P44781 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 558494 T1988 C569 P44781 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 558494 T1988 C569 P44781 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 558494 T1988 C569 P44781 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 558494 T1988 C569 P44781 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 558495 T1988 C569 P44781 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:28682/zd/rp/collection1/. core=collection1
[junit4:junit4] 2> 558495 T1988 C569 P44781 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 558497 T1892 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> ASYNC NEW_CORE C570 name=collection1 org.apache.solr.core.SolrCore@1a70b3f2 url=http://127.0.0.1:28682/zd/rp/collection1 node=127.0.0.1:28682_zd%2Frp C570_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:28682_zd%2Frp, base_url=http://127.0.0.1:28682/zd/rp, leader=true}
[junit4:junit4] 2> 558501 T1941 C570 P28682 oasc.SolrCore.execute [collection1] webapp=/zd/rp path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 558504 T1942 C570 P28682 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 558506 T1942 C570 P28682 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3e07e88 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1474905f),segFN=segments_1,generation=1}
[junit4:junit4] 2> 558506 T1942 C570 P28682 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 558507 T1942 C570 P28682 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3e07e88 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1474905f),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3e07e88 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1474905f),segFN=segments_2,generation=2}
[junit4:junit4] 2> 558507 T1942 C570 P28682 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 558508 T1942 C570 P28682 oass.SolrIndexSearcher.<init> Opening Searcher@6ae4d22 realtime
[junit4:junit4] 2> 558508 T1942 C570 P28682 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 558508 T1942 C570 P28682 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 4
[junit4:junit4] 2> 558509 T1988 C569 P44781 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 558509 T1988 C569 P44781 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 558511 T1943 C570 P28682 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 558511 T1943 C570 P28682 oasc.SolrCore.execute [collection1] webapp=/zd/rp path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4] 2> 558512 T1988 C569 P44781 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 558512 T1988 C569 P44781 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 558512 T1988 C569 P44781 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 558515 T1943 C570 P28682 oasc.SolrCore.execute [collection1] webapp=/zd/rp path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 558516 T1988 C569 P44781 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 558516 T1988 C569 P44781 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371515991204/jetty4/index.20130618014016422
[junit4:junit4] 2> 558517 T1988 C569 P44781 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@1fd46691 lockFactory=org.apache.lucene.store.NativeFSLockFactory@79a8567b) fullCopy=false
[junit4:junit4] 2> 558519 T1943 C570 P28682 oasc.SolrCore.execute [collection1] webapp=/zd/rp path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 558520 T1988 C569 P44781 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 558521 T1988 C569 P44781 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 558521 T1988 C569 P44781 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 558522 T1988 C569 P44781 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@304026f6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3edda89e),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@304026f6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3edda89e),segFN=segments_2,generation=2}
[junit4:junit4] 2> 558523 T1988 C569 P44781 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 558524 T1988 C569 P44781 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 558524 T1988 C569 P44781 oass.SolrIndexSearcher.<init> Opening Searcher@54b04b4f main
[junit4:junit4] 2> 558525 T1987 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@54b04b4f main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 558525 T1988 C569 P44781 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371515991204/jetty4/index.20130618014016422 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371515991204/jetty4/index.20130618014016422;done=true>>]
[junit4:junit4] 2> 558525 T1988 C569 P44781 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371515991204/jetty4/index.20130618014016422
[junit4:junit4] 2> 558526 T1988 C569 P44781 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371515991204/jetty4/index.20130618014016422
[junit4:junit4] 2> 558526 T1988 C569 P44781 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 558526 T1988 C569 P44781 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 558526 T1988 C569 P44781 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 558526 T1988 C569 P44781 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 558555 T1988 C569 P44781 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 558707 T1915 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 558708 T1915 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:44781_zd%2Frp_collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:44781_zd%2Frp",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:44781/zd/rp"}
[junit4:junit4] 2> 558720 T1914 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 558720 T1983 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 558720 T1934 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 558720 T1966 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 558720 T1921 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 558720 T1950 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 559499 T1892 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 559501 T1892 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> ASYNC NEW_CORE C571 name=collection1 org.apache.solr.core.SolrCore@29c5b1e7 url=http://127.0.0.1:55115/zd/rp/collection1 node=127.0.0.1:55115_zd%2Frp C571_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:55115_zd%2Frp, base_url=http://127.0.0.1:55115/zd/rp, leader=true}
[junit4:junit4] 2> 559510 T1904 C571 P55115 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 559513 T1904 C571 P55115 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@74812e0c lockFactory=org.apache.lucene.store.NativeFSLockFactory@4f0c28b8),segFN=segments_1,generation=1}
[junit4:junit4] 2> 559514 T1904 C571 P55115 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 559515 T1904 C571 P55115 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@74812e0c lockFactory=org.apache.lucene.store.NativeFSLockFactory@4f0c28b8),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@74812e0c lockFactory=org.apache.lucene.store.NativeFSLockFactory@4f0c28b8),segFN=segments_2,generation=2}
[junit4:junit4] 2> 559515 T1904 C571 P55115 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 559516 T1904 C571 P55115 oass.SolrIndexSearcher.<init> Opening Searcher@74709ec3 main
[junit4:junit4] 2> 559516 T1904 C571 P55115 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 559517 T1918 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@74709ec3 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 559518 T1904 C571 P55115 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 8
[junit4:junit4] 2> 559531 T1928 C568 P34569 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:34569/zd/rp/collection1/, StdNode: http://127.0.0.1:24128/zd/rp/collection1/, StdNode: http://127.0.0.1:28682/zd/rp/collection1/, StdNode: http://127.0.0.1:44781/zd/rp/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 559534 T1929 C568 P34569 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 559534 T1944 C570 P28682 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 559534 T1929 C568 P34569 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@55976d4e lockFactory=org.apache.lucene.store.NativeFSLockFactory@6e3a732b),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@55976d4e lockFactory=org.apache.lucene.store.NativeFSLockFactory@6e3a732b),segFN=segments_3,generation=3}
[junit4:junit4] 2> 559535 T1944 C570 P28682 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3e07e88 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1474905f),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3e07e88 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1474905f),segFN=segments_3,generation=3}
[junit4:junit4] 2> 559535 T1929 C568 P34569 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 559536 T1944 C570 P28682 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 559536 T1929 C568 P34569 oass.SolrIndexSearcher.<init> Opening Searcher@1def7697 main
[junit4:junit4] 2> 559537 T1944 C570 P28682 oass.SolrIndexSearcher.<init> Opening Searcher@576e31d main
[junit4:junit4] 2> 559537 T1929 C568 P34569 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 559538 T1936 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1def7697 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 559538 T1944 C570 P28682 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 559539 T1929 C568 P34569 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 5
[junit4:junit4] 2> 559538 T1952 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@576e31d main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 559540 T1944 C570 P28682 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> C567_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:24128_zd%2Frp, base_url=http://127.0.0.1:24128/zd/rp}
[junit4:junit4] 2> 559541 T1956 C567 P24128 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> C569_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:44781_zd%2Frp, base_url=http://127.0.0.1:44781/zd/rp}
[junit4:junit4] 2> 559541 T1973 C569 P44781 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 559542 T1956 C567 P24128 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5fb42527 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1fdb22b6),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5fb42527 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1fdb22b6),segFN=segments_3,generation=3}
[junit4:junit4] 2> 559542 T1973 C569 P44781 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@304026f6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3edda89e),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@304026f6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3edda89e),segFN=segments_3,generation=3}
[junit4:junit4] 2> 559542 T1956 C567 P24128 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 559543 T1973 C569 P44781 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 559544 T1956 C567 P24128 oass.SolrIndexSearcher.<init> Opening Searcher@2c96cf7b main
[junit4:junit4] 2> 559544 T1973 C569 P44781 oass.SolrIndexSearcher.<init> Opening Searcher@6d32b957 main
[junit4:junit4] 2> 559545 T1956 C567 P24128 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 559545 T1968 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2c96cf7b main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 559545 T1973 C569 P44781 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 559546 T1956 C567 P24128 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 5
[junit4:junit4] 2> 559546 T1987 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6d32b957 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 559547 T1973 C569 P44781 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> 559548 T1928 C568 P34569 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 18
[junit4:junit4] 2> 559549 T1892 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 559552 T1930 C568 P34569 oasc.SolrCore.execute [collection1] webapp=/zd/rp path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 559554 T1957 C567 P24128 oasc.SolrCore.execute [collection1] webapp=/zd/rp path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 559555 T1945 C570 P28682 oasc.SolrCore.execute [collection1] webapp=/zd/rp path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 559557 T1974 C569 P44781 oasc.SolrCore.execute [collection1] webapp=/zd/rp path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 561562 T1904 C571 P55115 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1438138781628628992)} 0 2
[junit4:junit4] 2> 561570 T1956 C567 P24128 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={update.distrib=FROMLEADER&_version_=-1438138781632823296&update.from=http://127.0.0.1:34569/zd/rp/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1438138781632823296)} 0 1
[junit4:junit4] 2> 561574 T1975 C569 P44781 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={update.distrib=FROMLEADER&_version_=-1438138781637017600&update.from=http://127.0.0.1:28682/zd/rp/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1438138781637017600)} 0 1
[junit4:junit4] 2> 561575 T1944 C570 P28682 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={update.distrib=TOLEADER&wt=javabin&version=2} {deleteByQuery=*:* (-1438138781637017600)} 0 6
[junit4:junit4] 2> 561575 T1928 C568 P34569 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1438138781632823296)} 0 10
[junit4:junit4] 2> 561579 T1904 C571 P55115 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[0 (1438138781646454784)]} 0 1
[junit4:junit4] 2> 561584 T1956 C567 P24128 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:34569/zd/rp/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1438138781649600512)]} 0 0
[junit4:junit4] 2> 561585 T1924 C568 P34569 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:28682/zd/rp/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[0 (1438138781649600512)]} 0 4
[junit4:junit4] 2> 561585 T1946 C570 P28682 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[0]} 0 5
[junit4:junit4] 2> 561588 T1904 C571 P55115 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[1 (1438138781656940544)]} 0 0
[junit4:junit4] 2> 561595 T1956 C567 P24128 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:34569/zd/rp/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1438138781662183424)]} 0 0
[junit4:junit4] 2> 561596 T1924 C568 P34569 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:28682/zd/rp/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[1 (1438138781662183424)]} 0 3
[junit4:junit4] 2> 561596 T1946 C570 P28682 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[1]} 0 5
[junit4:junit4] 2> 561599 T1904 C571 P55115 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[2 (1438138781668474880)]} 0 0
[junit4:junit4] 2> 561608 T1975 C569 P44781 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:28682/zd/rp/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[2 (1438138781674766336)]} 0 1
[junit4:junit4] 2> 561608 T1944 C570 P28682 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:34569/zd/rp/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[2 (1438138781674766336)]} 0 3
[junit4:junit4] 2> 561609 T1928 C568 P34569 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[2]} 0 7
[junit4:junit4] 2> 561611 T1904 C571 P55115 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[3 (1438138781681057792)]} 0 0
[junit4:junit4] 2> 561617 T1975 C569 P44781 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:28682/zd/rp/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[3 (1438138781684203520)]} 0 0
[junit4:junit4] 2> 561618 T1946 C570 P28682 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[3 (1438138781684203520)]} 0 4
[junit4:junit4] 2> 561621 T1904 C571 P55115 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[4 (1438138781691543552)]} 0 0
[junit4:junit4] 2> 561627 T1956 C567 P24128 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:34569/zd/rp/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[4 (1438138781694689280)]} 0 0
[junit4:junit4] 2> 561628 T1928 C568 P34569 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[4 (1438138781694689280)]} 0 4
[junit4:junit4] 2> 561632 T1904 C571 P55115 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[5 (1438138781702029312)]} 0 1
[junit4:junit4] 2> 561638 T1975 C569 P44781 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:28682/zd/rp/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[5 (1438138781706223616)]} 0 0
[junit4:junit4] 2> 561639 T1946 C570 P28682 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[5 (1438138781706223616)]} 0 4
[junit4:junit4] 2> 561642 T1904 C571 P55115 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[6 (1438138781713563648)]} 0 0
[junit4:junit4] 2> 561650 T1975 C569 P44781 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:28682/zd/rp/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[6 (1438138781718806528)]} 0 1
[junit4:junit4] 2> 561650 T1944 C570 P28682 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:34569/zd/rp/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[6 (1438138781718806528)]} 0 3
[junit4:junit4] 2> 561651 T1928 C568 P34569 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[6]} 0 6
[junit4:junit4] 2> 561653 T1904 C571 P55115 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[7 (1438138781725097984)]} 0 0
[junit4:junit4] 2> 561659 T1975 C569 P44781 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:28682/zd/rp/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[7 (1438138781728243712)]} 0 0
[junit4:junit4] 2> 561660 T1946 C570 P28682 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[7 (1438138781728243712)]} 0 4
[junit4:junit4] 2> 561663 T1904 C571 P55115 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[8 (1438138781735583744)]} 0 0
[junit4:junit4] 2> 561671 T1956 C567 P24128 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:34569/zd/rp/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[8 (1438138781740826624)]} 0 0
[junit4:junit4] 2> 561672 T1924 C568 P34569 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:28682/zd/rp/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[8 (1438138781740826624)]} 0 4
[junit4:junit4] 2> 561673 T1946 C570 P28682 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[8]} 0 7
[junit4:junit4] 2> 561676 T1904 C571 P55115 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[9 (1438138781749215232)]} 0 0
[junit4:junit4] 2> 561682 T1975 C569 P44781 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:28682/zd/rp/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[9 (1438138781752360960)]} 0 0
[junit4:junit4] 2> 561683 T1946 C570 P28682 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[9 (1438138781752360960)]} 0 4
[junit4:junit4] 2> 561686 T1904 C571 P55115 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[10 (1438138781759700992)]} 0 0
[junit4:junit4] 2> 561694 T1956 C567 P24128 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:34569/zd/rp/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10 (1438138781764943872)]} 0 0
[junit4:junit4] 2> 561695 T1924 C568 P34569 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:28682/zd/rp/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[10 (1438138781764943872)]} 0 4
[junit4:junit4] 2> 561696 T1946 C570 P28682 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[10]} 0 7
[junit4:junit4] 2> 561699 T1904 C571 P55115 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[11 (1438138781773332480)]} 0 0
[junit4:junit4] 2> 561705 T1956 C567 P24128 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:34569/zd/rp/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[11 (1438138781776478208)]} 0 1
[junit4:junit4] 2> 561705 T1928 C568 P34569 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[11 (1438138781776478208)]} 0 3
[junit4:junit4] 2> 561708 T1904 C571 P55115 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[12 (1438138781782769664)]} 0 0
[junit4:junit4] 2> 561714 T1956 C567 P24128 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:34569/zd/rp/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[12 (1438138781785915392)]} 0 1
[junit4:junit4] 2> 561714 T1928 C568 P34569 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[12 (1438138781785915392)]} 0 3
[junit4:junit4] 2> 561717 T1904 C571 P55115 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[13 (1438138781792206848)]} 0 0
[junit4:junit4] 2> 561723 T1956 C567 P24128 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:34569/zd/rp/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[13 (1438138781795352576)]} 0 1
[junit4:junit4] 2> 561724 T1928 C568 P34569 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[13 (1438138781795352576)]} 0 4
[junit4:junit4] 2> 561727 T1904 C571 P55115 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[14 (1438138781801644032)]} 0 1
[junit4:junit4] 2> 561732 T1956 C567 P24128 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:34569/zd/rp/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[14 (1438138781804789760)]} 0 0
[junit4:junit4] 2> 561733 T1928 C568 P34569 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[14 (1438138781804789760)]} 0 4
[junit4:junit4] 2> 561736 T1904 C571 P55115 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[15 (1438138781811081216)]} 0 1
[junit4:junit4] 2> 561743 T1956 C567 P24128 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:34569/zd/rp/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[15 (1438138781816324096)]} 0 0
[junit4:junit4] 2> 561744 T1924 C568 P34569 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:28682/zd/rp/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[15 (1438138781816324096)]} 0 4
[junit4:junit4] 2> 561745 T1946 C570 P28682 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[15]} 0 7
[junit4:junit4] 2> 561747 T1904 C571 P55115 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[16 (1438138781823664128)]} 0 0
[junit4:junit4] 2> 561753 T1956 C567 P24128 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:34569/zd/rp/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[16 (1438138781826809856)]} 0 0
[junit4:junit4] 2> 561754 T1928 C568 P34569 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[16 (1438138781826809856)]} 0 4
[junit4:junit4] 2> 561756 T1904 C571 P55115 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[17 (1438138781833101312)]} 0 0
[junit4:junit4] 2> 561765 T1975 C569 P44781 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:28682/zd/rp/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[17 (1438138781838344192)]} 0 0
[junit4:junit4] 2> 561765 T1944 C570 P28682 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:34569/zd/rp/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[17 (1438138781838344192)]} 0 4
[junit4:junit4] 2> 561766 T1928 C568 P34569 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[17]} 0 7
[junit4:junit4] 2> 561769 T1904 C571 P55115 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[18 (1438138781846732800)]} 0 0
[junit4:junit4] 2> 561775 T1975 C569 P44781 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:28682/zd/rp/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[18 (1438138781849878528)]} 0 0
[junit4:junit4] 2> 561776 T1946 C570 P28682 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[18 (1438138781849878528)]} 0 4
[junit4:junit4] 2> 561779 T1904 C571 P55115 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[19 (1438138781857218560)]} 0 0
[junit4:junit4] 2> 561785 T1975 C569 P44781 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:28682/zd/rp/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[19 (1438138781860364288)]} 0 0
[junit4:junit4] 2> 561786 T1946 C570 P28682 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[19 (1438138781860364288)]} 0 4
[junit4:junit4] 2> 561789 T1904 C571 P55115 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[20 (1438138781867704320)]} 0 0
[junit4:junit4] 2> 561794 T1956 C567 P24128 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:34569/zd/rp/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[20 (1438138781870850048)]} 0 0
[junit4:junit4] 2> 561795 T1928 C568 P34569 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[20 (1438138781870850048)]} 0 3
[junit4:junit4] 2> 561798 T1904 C571 P55115 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[21 (1438138781877141504)]} 0 0
[junit4:junit4] 2> 561806 T1975 C569 P44781 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:28682/zd/rp/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[21 (1438138781882384384)]} 0 0
[junit4:junit4] 2> 561807 T1944 C570 P28682 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:34569/zd/rp/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[21 (1438138781882384384)]} 0 4
[junit4:junit4] 2> 561808 T1928 C568 P34569 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[21]} 0 7
[junit4:junit4] 2> 561811 T1904 C571 P55115 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[22 (1438138781890772992)]} 0 0
[junit4:junit4] 2> 561819 T1956 C567 P24128 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:34569/zd/rp/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[22 (1438138781896015872)]} 0 1
[junit4:junit4] 2> 561819 T1924 C568 P34569 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:28682/zd/rp/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[22 (1438138781896015872)]} 0 3
[junit4:junit4] 2> 561820 T1946 C570 P28682 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[22]} 0 6
[junit4:junit4] 2> 561823 T1904 C571 P55115 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[23 (1438138781903355904)]} 0 0
[junit4:junit4] 2> 561828 T1975 C569 P44781 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:28682/zd/rp/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[23 (1438138781906501632)]} 0 0
[junit4:junit4] 2> 561829 T1946 C570 P28682 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[23 (1438138781906501632)]} 0 3
[junit4:junit4] 2> 561832 T1904 C571 P55115 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[24 (1438138781911744512)]} 0 1
[junit4:junit4] 2> 561841 T1956 C567 P24128 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:34569/zd/rp/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[24 (1438138781918035968)]} 0 1
[junit4:junit4] 2> 561841 T1924 C568 P34569 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:28682/zd/rp/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[24 (1438138781918035968)]} 0 4
[junit4:junit4] 2> 561842 T1946 C570 P28682 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[24]} 0 7
[junit4:junit4] 2> 561845 T1904 C571 P55115 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[25 (1438138781926424576)]} 0 0
[junit4:junit4] 2> 561850 T1975 C569 P44781 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:28682/zd/rp/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[25 (1438138781929570304)]} 0 0
[junit4:junit4] 2> 561851 T1946 C570 P28682 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[25 (1438138781929570304)]} 0 3
[junit4:junit4] 2> 561853 T1904 C571 P55115 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[26 (1438138781934813184)]} 0 0
[junit4:junit4] 2> 561861 T1975 C569 P44781 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:28682/zd/rp/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[26 (1438138781940056064)]} 0 0
[junit4:junit4] 2> 561862 T1944 C570 P28682 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:34569/zd/rp/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[26 (1438138781940056064)]} 0 4
[junit4:junit4] 2> 561863 T1928 C568 P34569 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[26]} 0 7
[junit4:junit4] 2> 561867 T1904 C571 P55115 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[27 (1438138781948444672)]} 0 1
[junit4:junit4] 2> 561875 T1956 C567 P24128 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:34569/zd/rp/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[27 (1438138781953687552)]} 0 1
[junit4:junit4] 2> 561875 T1924 C568 P34569 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:28682/zd/rp/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[27 (1438138781953687552)]} 0 4
[junit4:junit4] 2> 561876 T1946 C570 P28682 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[27]} 0 7
[junit4:junit4] 2> 561879 T1904 C571 P55115 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[28 (1438138781962076160)]} 0 0
[junit4:junit4] 2> 561887 T1956 C567 P24128 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:34569/zd/rp/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[28 (1438138781967319040)]} 0 0
[junit4:junit4] 2> 561888 T1924 C568 P34569 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:28682/zd/rp/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[28 (1438138781967319040)]} 0 4
[junit4:junit4] 2> 561889 T1946 C570 P28682 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[28]} 0 7
[junit4:junit4] 2> 561892 T1904 C571 P55115 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[29 (1438138781975707648)]} 0 0
[junit4:junit4] 2> 561898 T1975 C569 P44781 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:28682/zd/rp/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[29 (1438138781978853376)]} 0 0
[junit4:junit4] 2> 561899 T1946 C570 P28682 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[29 (1438138781978853376)]} 0 4
[junit4:junit4] 2> 561902 T1904 C571 P55115 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[30 (1438138781986193408)]} 0 0
[junit4:junit4] 2> 561910 T1975 C569 P44781 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:28682/zd/rp/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[30 (1438138781991436288)]} 0 0
[junit4:junit4] 2> 561911 T1944 C570 P28682 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:34569/zd/rp/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[30 (1438138781991436288)]} 0 4
[junit4:junit4] 2> 561912 T1928 C568 P34569 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[30]} 0 7
[junit4:junit4] 2> 561914 T1904 C571 P55115 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[31 (1438138781998776320)]} 0 0
[junit4:junit4] 2> 561920 T1975 C569 P44781 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:28682/zd/rp/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[31 (1438138782001922048)]} 0 0
[junit4:junit4] 2> 561921 T1946 C570 P28682 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[31 (1438138782001922048)]} 0 4
[junit4:junit4] 2> 561924 T1904 C571 P55115 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[32 (1438138782009262080)]} 0 0
[junit4:junit4] 2> 561930 T1956 C567 P24128 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:34569/zd/rp/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[32 (1438138782012407808)]} 0 0
[junit4:junit4] 2> 561931 T1928 C568 P34569 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[32 (1438138782012407808)]} 0 4
[junit4:junit4] 2> 561934 T1904 C571 P55115 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[33 (1438138782019747840)]} 0 0
[junit4:junit4] 2> 561941 T1975 C569 P44781 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:28682/zd/rp/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[33 (1438138782022893568)]} 0 1
[junit4:junit4] 2> 561941 T1946 C570 P28682 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[33 (1438138782022893568)]} 0 4
[junit4:junit4] 2> 561944 T1904 C571 P55115 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[34 (1438138782030233600)]} 0 0
[junit4:junit4] 2> 561950 T1956 C567 P24128 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:34569/zd/rp/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[34 (1438138782033379328)]} 0 0
[junit4:junit4] 2> 561951 T1928 C568 P34569 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[34 (1438138782033379328)]} 0 4
[junit4:junit4] 2> 561954 T1904 C571 P55115 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[35 (1438138782040719360)]} 0 0
[junit4:junit4] 2> 561960 T1956 C567 P24128 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:34569/zd/rp/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[35 (1438138782043865088)]} 0 0
[junit4:junit4] 2> 561961 T1928 C568 P34569 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[35 (1438138782043865088)]} 0 4
[junit4:junit4] 2> 561964 T1904 C571 P55115 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[36 (1438138782051205120)]} 0 0
[junit4:junit4] 2> 561973 T1956 C567 P24128 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:34569/zd/rp/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[36 (1438138782057496576)]} 0 0
[junit4:junit4] 2> 561974 T1924 C568 P34569 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:28682/zd/rp/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[36 (1438138782057496576)]} 0 4
[junit4:junit4] 2> 561975 T1946 C570 P28682 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[36]} 0 8
[junit4:junit4] 2> 561978 T1904 C571 P55115 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[37 (1438138782065885184)]} 0 0
[junit4:junit4] 2> 561986 T1975 C569 P44781 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:28682/zd/rp/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[37 (1438138782071128064)]} 0 0
[junit4:junit4] 2> 561987 T1944 C570 P28682 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:34569/zd/rp/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[37 (1438138782071128064)]} 0 4
[junit4:junit4] 2> 561988 T1928 C568 P34569 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[37]} 0 7
[junit4:junit4] 2> 561990 T1904 C571 P55115 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[38 (1438138782078468096)]} 0 0
[junit4:junit4] 2> 561997 T1956 C567 P24128 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:34569/zd/rp/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[38 (1438138782083710976)]} 0 0
[junit4:junit4] 2> 561998 T1924 C568 P34569 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:28682/zd/rp/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[38 (1438138782083710976)]} 0 3
[junit4:junit4] 2> 561998 T1946 C570 P28682 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[38]} 0 5
[junit4:junit4] 2> 562001 T1904 C571 P55115 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[39 (1438138782090002432)]} 0 0
[junit4:junit4] 2> 562008 T1975 C569 P44781 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:28682/zd/rp/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[39 (1438138782095245312)]} 0 0
[junit4:junit4] 2> 562009 T1944 C570 P28682 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:34569/zd/rp/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[39 (1438138782095245312)]} 0 3
[junit4:junit4] 2> 562009 T1928 C568 P34569 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[39]} 0 5
[junit4:junit4] 2> 562012 T1904 C571 P55115 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[40 (1438138782101536768)]} 0 0
[junit4:junit4] 2> 562017 T1956 C567 P24128 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:34569/zd/rp/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[40 (1438138782104682496)]} 0 0
[junit4:junit4] 2> 562018 T1928 C568 P34569 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[40 (1438138782104682496)]} 0 3
[junit4:junit4] 2> 562020 T1904 C571 P55115 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[41 (1438138782109925376)]} 0 0
[junit4:junit4] 2> 562027 T1956 C567 P24128 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:34569/zd/rp/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[41 (1438138782115168256)]} 0 0
[junit4:junit4] 2> 562028 T1924 C568 P34569 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:28682/zd/rp/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[41 (1438138782115168256)]} 0 3
[junit4:junit4] 2> 562028 T1946 C570 P28682 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[41]} 0 5
[junit4:junit4] 2> 562030 T1904 C571 P55115 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[42 (1438138782120411136)]} 0 0
[junit4:junit4] 2> 562040 T1956 C567 P24128 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:34569/zd/rp/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[42 (1438138782126702592)]} 0 1
[junit4:junit4] 2> 562041 T1924 C568 P34569 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:28682/zd/rp/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[42 (1438138782126702592)]} 0 5
[junit4:junit4] 2> 562041 T1946 C570 P28682 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[42]} 0 8
[junit4:junit4] 2> 562044 T1904 C571 P55115 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[43 (1438138782135091200)]} 0 0
[junit4:junit4] 2> 562050 T1956 C567 P24128 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:34569/zd/rp/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[43 (1438138782138236928)]} 0 0
[junit4:junit4] 2> 562051 T1928 C568 P34569 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[43 (1438138782138236928)]} 0 4
[junit4:junit4] 2> 562055 T1904 C571 P55115 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[44 (1438138782145576960)]} 0 1
[junit4:junit4] 2> 562062 T1956 C567 P24128 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:34569/zd/rp/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[44 (1438138782149771264)]} 0 1
[junit4:junit4] 2> 562062 T1928 C568 P34569 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[44 (1438138782149771264)]} 0 4
[junit4:junit4] 2> 562065 T1904 C571 P55115 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[45 (1438138782157111296)]} 0 0
[junit4:junit4] 2> 562072 T1975 C569 P44781 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:28682/zd/rp/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[45 (1438138782160257024)]} 0 1
[junit4:junit4] 2> 562072 T1946 C570 P28682 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[45 (1438138782160257024)]} 0 4
[junit4:junit4] 2> 562075 T1904 C571 P55115 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[46 (1438138782167597056)]} 0 0
[junit4:junit4] 2> 562081 T1956 C567 P24128 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:34569/zd/rp/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[46 (1438138782170742784)]} 0 1
[junit4:junit4] 2> 562082 T1928 C568 P34569 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[46 (1438138782170742784)]} 0 4
[junit4:junit4] 2> 562084 T1904 C571 P55115 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[47 (1438138782177034240)]} 0 0
[junit4:junit4] 2> 562092 T1956 C567 P24128 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:34569/zd/rp/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[47 (1438138782182277120)]} 0 1
[junit4:junit4] 2> 562092 T1924 C568 P34569 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:28682/zd/rp/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[47 (1438138782182277120)]} 0 3
[junit4:junit4] 2> 562093 T1946 C570 P28682 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[47]} 0 6
[junit4:junit4] 2> 562096 T1904 C571 P55115 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[48 (1438138782189617152)]} 0 0
[junit4:junit4] 2> 562104 T1956 C567 P24128 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:34569/zd/rp/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[48 (1438138782194860032)]} 0 1
[junit4:junit4] 2> 562104 T1924 C568 P34569 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:28682/zd/rp/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[48 (1438138782194860032)]} 0 3
[junit4:junit4] 2> 562105 T1946 C570 P28682 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[48]} 0 6
[junit4:junit4] 2> 562108 T1904 C571 P55115 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[49 (1438138782202200064)]} 0 0
[junit4:junit4] 2> 562114 T1956 C567 P24128 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:34569/zd/rp/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[49 (1438138782205345792)]} 0 0
[junit4:junit4] 2> 562115 T1928 C568 P34569 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[49 (1438138782205345792)]} 0 4
[junit4:junit4] 2> 562118 T1904 C571 P55115 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[50 (1438138782212685824)]} 0 0
[junit4:junit4] 2> 562124 T1956 C567 P24128 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:34569/zd/rp/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[50 (1438138782215831552)]} 0 0
[junit4:junit4] 2> 562125 T1928 C568 P34569 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[50 (1438138782215831552)]} 0 4
[junit4:junit4] 2> 562128 T1904 C571 P55115 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[51 (1438138782223171584)]} 0 0
[junit4:junit4] 2> 562133 T1956 C567 P24128 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:34569/zd/rp/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[51 (1438138782226317312)]} 0 0
[junit4:junit4] 2> 562134 T1928 C568 P34569 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[51 (1438138782226317312)]} 0 3
[junit4:junit4] 2> 562137 T1904 C571 P55115 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[52 (1438138782231560192)]} 0 1
[junit4:junit4] 2> 562143 T1956 C567 P24128 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:34569/zd/rp/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[52 (1438138782235754496)]} 0 0
[junit4:junit4] 2> 562144 T1928 C568 P34569 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[52 (1438138782235754496)]} 0 4
[junit4:junit4] 2> 562147 T1904 C571 P55115 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[53 (1438138782242045952)]} 0 1
[junit4:junit4] 2> 562154 T1975 C569 P44781 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:28682/zd/rp/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[53 (1438138782247288832)]} 0 0
[junit4:junit4] 2> 562155 T1944 C570 P28682 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:34569/zd/rp/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[53 (1438138782247288832)]} 0 4
[junit4:junit4] 2> 562156 T1928 C568 P34569 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[53]} 0 7
[junit4:junit4] 2> 562158 T1904 C571 P55115 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={wt=javabin&version=2} {add=[54 (1438138782254628864)]} 0 0
[junit4:junit4] 2> 562165 T1956 C567 P24128 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:34569/zd/rp/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[54 (1438138782259871744)]} 0 0
[junit4:junit4] 2> 562166 T1924 C568 P34569 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update params={distrib.from=http://127.0.0.1:28682/zd/rp/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[54 (1438138782259871744)]} 0 3
[junit4:junit4] 2> 562166 T1946 C570 P28682 oasup.LogUpdateProcessor.finish [collection1] webapp=/zd/rp path=/update par
[...truncated too long message...]
"base_url":"http://127.0.0.1:58346/mc/m",
[junit4:junit4] 1> "leader":"true"},
[junit4:junit4] 1> "127.0.0.1:65174_mc%2Fm_collection1":{
[junit4:junit4] 1> "shard":"shard1",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "collection":"collection1",
[junit4:junit4] 1> "node_name":"127.0.0.1:65174_mc%2Fm",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:65174/mc/m"}}}},
[junit4:junit4] 1> "router":"compositeId"},
[junit4:junit4] 1> "control_collection":{
[junit4:junit4] 1> "shards":{"shard1":{
[junit4:junit4] 1> "range":"80000000-7fffffff",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "replicas":{"127.0.0.1:16010_mc%2Fm_collection1":{
[junit4:junit4] 1> "shard":"shard1",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "collection":"control_collection",
[junit4:junit4] 1> "node_name":"127.0.0.1:16010_mc%2Fm",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:16010/mc/m",
[junit4:junit4] 1> "leader":"true"}}}},
[junit4:junit4] 1> "router":"compositeId"}}
[junit4:junit4] 1> /solr/aliases.json (0)
[junit4:junit4] 1> /solr/live_nodes (4)
[junit4:junit4] 1> /solr/live_nodes/127.0.0.1:58346_mc%2Fm (0)
[junit4:junit4] 1> /solr/live_nodes/127.0.0.1:65174_mc%2Fm (0)
[junit4:junit4] 1> /solr/live_nodes/127.0.0.1:34189_mc%2Fm (0)
[junit4:junit4] 1> /solr/live_nodes/127.0.0.1:16010_mc%2Fm (0)
[junit4:junit4] 1> /solr/overseer (3)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1>
[junit4:junit4] 1> /solr/overseer/queue (0)
[junit4:junit4] 1> /solr/overseer/queue-work (0)
[junit4:junit4] 1> /solr/overseer/collection-queue-work (0)
[junit4:junit4] 1> /solr/collections (2)
[junit4:junit4] 1> /solr/collections/collection1 (3)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {"configName":"conf1"}
[junit4:junit4] 1> /solr/collections/collection1/shards (0)
[junit4:junit4] 1> /solr/collections/collection1/leader_elect (1)
[junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard1 (1)
[junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard1/election (3)
[junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard1/election/89883710635245582-127.0.0.1:34189_mc%2Fm_collection1-n_0000000004 (0)
[junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard1/election/89883710635245578-127.0.0.1:58346_mc%2Fm_collection1-n_0000000002 (0)
[junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard1/election/89883710635245580-127.0.0.1:65174_mc%2Fm_collection1-n_0000000003 (0)
[junit4:junit4] 1> /solr/collections/collection1/leaders (1)
[junit4:junit4] 1> /solr/collections/collection1/leaders/shard1 (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "node_name":"127.0.0.1:58346_mc%2Fm",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:58346/mc/m"}
[junit4:junit4] 1> /solr/collections/control_collection (3)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {"configName":"conf1"}
[junit4:junit4] 1> /solr/collections/control_collection/shards (0)
[junit4:junit4] 1> /solr/collections/control_collection/leader_elect (1)
[junit4:junit4] 1> /solr/collections/control_collection/leader_elect/shard1 (1)
[junit4:junit4] 1> /solr/collections/control_collection/leader_elect/shard1/election (1)
[junit4:junit4] 1> /solr/collections/control_collection/leader_elect/shard1/election/89883710635245571-127.0.0.1:16010_mc%2Fm_collection1-n_0000000000 (0)
[junit4:junit4] 1> /solr/collections/control_collection/leaders (1)
[junit4:junit4] 1> /solr/collections/control_collection/leaders/shard1 (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "node_name":"127.0.0.1:16010_mc%2Fm",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:16010/mc/m"}
[junit4:junit4] 1> /solr/overseer_elect (2)
[junit4:junit4] 1> /solr/overseer_elect/election (4)
[junit4:junit4] 1> /solr/overseer_elect/election/89883710635245582-127.0.0.1:34189_mc%2Fm-n_0000000005 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89883710635245571-127.0.0.1:16010_mc%2Fm-n_0000000000 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89883710635245580-127.0.0.1:65174_mc%2Fm-n_0000000004 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89883710635245578-127.0.0.1:58346_mc%2Fm-n_0000000003 (0)
[junit4:junit4] 1> /solr/overseer_elect/leader (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {"id":"89883710635245571-127.0.0.1:16010_mc%2Fm-n_0000000000"}
[junit4:junit4] 1> /zookeeper (1)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1>
[junit4:junit4] 1>
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=SyncSliceTest -Dtests.method=testDistribSearch -Dtests.seed=A4E4A8173AFE001B -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ar -Dtests.timezone=Asia/Saigon -Dtests.file.encoding=UTF-8
[junit4:junit4] FAILURE 519s J0 | SyncSliceTest.testDistribSearch <<<
[junit4:junit4] > Throwable #1: java.lang.AssertionError: shard1 is not consistent. Got 305 from http://127.0.0.1:34189/mc/m/collection1lastClient and got 256 from http://127.0.0.1:58346/mc/m/collection1
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([A4E4A8173AFE001B:2502260F4DA16027]:0)
[junit4:junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1018)
[junit4:junit4] > at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:238)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 1641669 T2082 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 518803 T2081 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 1 leaked thread(s).
[junit4:junit4] 2> NOTE: test params are: codec=Lucene3x, sim=RandomSimilarityProvider(queryNorm=false,coord=no): {}, locale=ar, timezone=Asia/Saigon
[junit4:junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_21 (64-bit)/cpus=16,threads=2,free=152013000,total=495976448
[junit4:junit4] 2> NOTE: All tests run in this JVM: [SolrIndexSplitterTest, TestBM25SimilarityFactory, SolrRequestParserTest, ZkControllerTest, DistanceFunctionTest, CSVRequestHandlerTest, TestJoin, URLClassifyProcessorTest, TestComponentsName, TestJmxIntegration, RecoveryZkTest, NumericFieldsTest, PingRequestHandlerTest, TestDistributedGrouping, OutputWriterTest, TestSolrIndexConfig, TestJmxMonitoredMap, TestFieldResource, UnloadDistributedZkTest, OverseerTest, TestLMDirichletSimilarityFactory, PreAnalyzedUpdateProcessorTest, ResponseLogComponentTest, TestMultiCoreConfBootstrap, PeerSyncTest, TestSolrQueryParserResource, BasicDistributedZk2Test, TestSolr4Spatial, SchemaVersionSpecificBehaviorTest, SynonymTokenizerTest, NotRequiredUniqueKeyTest, TestRandomDVFaceting, CoreAdminHandlerTest, XmlUpdateRequestHandlerTest, TestFastLRUCache, FieldMutatingUpdateProcessorTest, TestBinaryField, TestSerializedLuceneMatchVersion, QueryParsingTest, DirectUpdateHandlerOptimizeTest, TestSchemaNameResource, TestSolrJ, MultiTermTest, TestCoreContainer, RegexBoostProcessorTest, MinimalSchemaTest, TestSchemaSimilarityResource, TestQueryUtils, IndexReaderFactoryTest, TestReloadAndDeleteDocs, SolrPluginUtilsTest, AliasIntegrationTest, TestPluginEnable, MoreLikeThisHandlerTest, TestLFUCache, SolrIndexConfigTest, CurrencyFieldXmlFileTest, TestUpdate, SolrInfoMBeanTest, PathHierarchyTokenizerFactoryTest, StatsComponentTest, TestExtendedDismaxParser, WordBreakSolrSpellCheckerTest, SortByFunctionTest, TestRemoteStreaming, TestAddFieldRealTimeGet, SoftAutoCommitTest, TestBadConfig, TestSolrXml, TestSolrQueryParser, SpellingQueryConverterTest, BasicZkTest, SyncSliceTest]
[junit4:junit4] Completed on J0 in 519.34s, 1 test, 1 failure <<< FAILURES!
[...truncated 459 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:392: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:372: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build.xml:181: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/common-build.xml:437: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:1246: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:890: There were test failures: 298 suites, 1252 tests, 1 error, 2 failures, 14 ignored (8 assumptions)
Total time: 55 minutes 22 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-Tests-4.x-Java7 - Build # 1338 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java7/1338/
2 tests failed.
REGRESSION: org.apache.solr.cloud.ShardSplitTest.testDistribSearch
Error Message:
Server at http://127.0.0.1:22001 returned non ok status:500, message:Server Error
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:22001 returned non ok status:500, message:Server Error
at __randomizedtesting.SeedInfo.seed([44F9FBB18068BA67:C51F75A9F737DA5B]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:228)
at org.apache.solr.cloud.ShardSplitTest.doTest(ShardSplitTest.java:150)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
FAILED: org.apache.solr.cloud.ChaosMonkeyShardSplitTest.testDistribSearch
Error Message:
Server at http://127.0.0.1:41869 returned non ok status:500, message:Server Error
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:41869 returned non ok status:500, message:Server Error
at __randomizedtesting.SeedInfo.seed([44F9FBB18068BA67:C51F75A9F737DA5B]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:228)
at org.apache.solr.cloud.ChaosMonkeyShardSplitTest.doTest(ChaosMonkeyShardSplitTest.java:136)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9490 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.ShardSplitTest
[junit4:junit4] 2> 353002 T958 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4] 2> 353006 T958 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solrtest-ShardSplitTest-1371473380517
[junit4:junit4] 2> 353008 T958 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 353008 T959 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 353109 T958 oasc.ZkTestServer.run start zk server on port:21719
[junit4:junit4] 2> 353110 T958 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 353115 T965 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@33cdc5bb name:ZooKeeperConnection Watcher:127.0.0.1:21719 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 353115 T958 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 353116 T958 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 353127 T958 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 353129 T967 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@15721cbd name:ZooKeeperConnection Watcher:127.0.0.1:21719/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 353129 T958 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 353130 T958 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 353141 T958 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 353145 T958 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 353148 T958 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 353152 T958 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 353153 T958 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 353166 T958 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 353167 T958 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 353272 T958 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 353273 T958 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 353295 T958 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 353296 T958 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 353301 T958 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 353302 T958 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 353306 T958 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 353307 T958 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 353311 T958 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 353312 T958 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 353317 T958 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 353317 T958 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 353322 T958 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 353322 T958 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 353591 T958 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 353596 T958 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:58032
[junit4:junit4] 2> 353597 T958 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 353597 T958 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 353598 T958 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1371473380838
[junit4:junit4] 2> 353598 T958 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1371473380838/solr.xml
[junit4:junit4] 2> 353599 T958 oasc.CoreContainer.<init> New CoreContainer 1852941820
[junit4:junit4] 2> 353600 T958 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1371473380838/'
[junit4:junit4] 2> 353600 T958 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1371473380838/'
[junit4:junit4] 2> 353729 T958 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 353730 T958 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 353731 T958 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 353731 T958 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 353732 T958 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 353732 T958 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 353733 T958 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 353733 T958 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 353734 T958 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 353734 T958 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 353753 T958 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 353754 T958 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:21719/solr
[junit4:junit4] 2> 353754 T958 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 353756 T958 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 353759 T978 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@77bae77f name:ZooKeeperConnection Watcher:127.0.0.1:21719 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 353759 T958 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 353762 T958 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 353776 T958 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 353778 T980 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@39b14771 name:ZooKeeperConnection Watcher:127.0.0.1:21719/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 353778 T958 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 353781 T958 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 353793 T958 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 353798 T958 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 353802 T958 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58032_
[junit4:junit4] 2> 353803 T958 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:58032_
[junit4:junit4] 2> 353813 T958 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 353828 T958 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 353832 T958 oasc.Overseer.start Overseer (id=89880879465889795-127.0.0.1:58032_-n_0000000000) starting
[junit4:junit4] 2> 353845 T958 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 353857 T982 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 353858 T958 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 353861 T958 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 353865 T958 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 353869 T981 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 353873 T983 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 353873 T983 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 355375 T981 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 355376 T981 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:58032_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:58032"}
[junit4:junit4] 2> 355376 T981 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 355377 T981 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 355391 T980 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 355877 T983 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1371473380838/collection1
[junit4:junit4] 2> 355877 T983 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 355878 T983 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 355879 T983 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 355881 T983 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1371473380838/collection1/'
[junit4:junit4] 2> 355883 T983 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-controljetty-1371473380838/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 355883 T983 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-controljetty-1371473380838/collection1/lib/README' to classloader
[junit4:junit4] 2> 355939 T983 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 356000 T983 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 356102 T983 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 356109 T983 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 356702 T983 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 356706 T983 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 356709 T983 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 356715 T983 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 356758 T983 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 356759 T983 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1371473380838/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1371473380517/control/data/
[junit4:junit4] 2> 356759 T983 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6fd12d1f
[junit4:junit4] 2> 356760 T983 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 356760 T983 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1371473380517/control/data
[junit4:junit4] 2> 356761 T983 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1371473380517/control/data/index/
[junit4:junit4] 2> 356761 T983 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1371473380517/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 356762 T983 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1371473380517/control/data/index
[junit4:junit4] 2> 356767 T983 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7ead3503 lockFactory=org.apache.lucene.store.NativeFSLockFactory@254ca1ff),segFN=segments_1,generation=1}
[junit4:junit4] 2> 356767 T983 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 356771 T983 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 356771 T983 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 356772 T983 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 356773 T983 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 356773 T983 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 356773 T983 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 356774 T983 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 356775 T983 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 356775 T983 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 356792 T983 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 356800 T983 oass.SolrIndexSearcher.<init> Opening Searcher@7d14e404 main
[junit4:junit4] 2> 356801 T983 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1371473380517/control/data/tlog
[junit4:junit4] 2> 356802 T983 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 356802 T983 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 356807 T984 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7d14e404 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 356809 T983 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 356810 T983 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:58032 collection:control_collection shard:shard1
[junit4:junit4] 2> 356811 T983 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 356842 T983 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 356886 T983 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 356886 T983 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 356886 T983 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:58032/collection1/
[junit4:junit4] 2> 356887 T983 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 356887 T983 oasc.SyncStrategy.syncToMe http://127.0.0.1:58032/collection1/ has no replicas
[junit4:junit4] 2> 356887 T983 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:58032/collection1/
[junit4:junit4] 2> 356887 T983 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 356907 T981 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 356923 T980 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 356958 T983 oasc.ZkController.register We are http://127.0.0.1:58032/collection1/ and leader is http://127.0.0.1:58032/collection1/
[junit4:junit4] 2> 356958 T983 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:58032
[junit4:junit4] 2> 356958 T983 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 356958 T983 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 356959 T983 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 356961 T983 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 356962 T958 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 356963 T958 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 356964 T958 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 356981 T958 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 356983 T958 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 356985 T987 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@44d93a51 name:ZooKeeperConnection Watcher:127.0.0.1:21719/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 356986 T958 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 356988 T958 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 356991 T958 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 357257 T958 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 357260 T958 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:22001
[junit4:junit4] 2> 357261 T958 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 357261 T958 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 357262 T958 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1371473384502
[junit4:junit4] 2> 357262 T958 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1371473384502/solr.xml
[junit4:junit4] 2> 357263 T958 oasc.CoreContainer.<init> New CoreContainer 1063066389
[junit4:junit4] 2> 357264 T958 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1371473384502/'
[junit4:junit4] 2> 357264 T958 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1371473384502/'
[junit4:junit4] 2> 357394 T958 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 357395 T958 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 357395 T958 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 357396 T958 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 357396 T958 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 357397 T958 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 357397 T958 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 357398 T958 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 357398 T958 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 357399 T958 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 357417 T958 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 357418 T958 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:21719/solr
[junit4:junit4] 2> 357419 T958 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 357420 T958 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 357422 T998 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6ca2a729 name:ZooKeeperConnection Watcher:127.0.0.1:21719 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 357423 T958 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 357426 T958 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 357439 T958 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 357441 T1000 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@63667a48 name:ZooKeeperConnection Watcher:127.0.0.1:21719/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 357441 T958 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 357454 T958 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 358432 T981 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 358434 T981 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:58032_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:58032"}
[junit4:junit4] 2> 358452 T987 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 358452 T980 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 358452 T1000 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 358458 T958 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:22001_
[junit4:junit4] 2> 358466 T958 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:22001_
[junit4:junit4] 2> 358469 T1000 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 358470 T987 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 358470 T980 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 358470 T987 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 358470 T980 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 358472 T1000 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 358480 T1001 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 358480 T1001 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 359960 T981 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 359961 T981 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:22001_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:22001"}
[junit4:junit4] 2> 359961 T981 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 359961 T981 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 359968 T987 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 359968 T1000 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 359968 T980 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 360487 T1001 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1371473384502/collection1
[junit4:junit4] 2> 360487 T1001 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 360488 T1001 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 360488 T1001 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 360491 T1001 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1371473384502/collection1/'
[junit4:junit4] 2> 360492 T1001 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty1-1371473384502/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 360493 T1001 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty1-1371473384502/collection1/lib/README' to classloader
[junit4:junit4] 2> 360546 T1001 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 360607 T1001 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 360709 T1001 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 360716 T1001 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 361296 T1001 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 361300 T1001 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 361302 T1001 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 361310 T1001 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 361368 T1001 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 361368 T1001 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1371473384502/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1371473380517/jetty1/
[junit4:junit4] 2> 361369 T1001 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6fd12d1f
[junit4:junit4] 2> 361369 T1001 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 361370 T1001 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1371473380517/jetty1
[junit4:junit4] 2> 361370 T1001 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1371473380517/jetty1/index/
[junit4:junit4] 2> 361371 T1001 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1371473380517/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 361371 T1001 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1371473380517/jetty1/index
[junit4:junit4] 2> 361375 T1001 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@17c532bb lockFactory=org.apache.lucene.store.NativeFSLockFactory@19e0a697),segFN=segments_1,generation=1}
[junit4:junit4] 2> 361376 T1001 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 361379 T1001 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 361380 T1001 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 361381 T1001 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 361381 T1001 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 361382 T1001 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 361382 T1001 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 361383 T1001 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 361384 T1001 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 361384 T1001 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 361401 T1001 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 361408 T1001 oass.SolrIndexSearcher.<init> Opening Searcher@57cb7ea main
[junit4:junit4] 2> 361409 T1001 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1371473380517/jetty1/tlog
[junit4:junit4] 2> 361410 T1001 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 361410 T1001 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 361416 T1002 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@57cb7ea main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 361419 T1001 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 361419 T1001 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:22001 collection:collection1 shard:shard1
[junit4:junit4] 2> 361420 T1001 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 361502 T1001 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 361577 T1001 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 361577 T1001 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 361578 T1001 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:22001/collection1/
[junit4:junit4] 2> 361578 T1001 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 361578 T1001 oasc.SyncStrategy.syncToMe http://127.0.0.1:22001/collection1/ has no replicas
[junit4:junit4] 2> 361578 T1001 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:22001/collection1/
[junit4:junit4] 2> 361579 T1001 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 363004 T981 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 363022 T987 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 363022 T1000 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 363022 T980 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 363073 T1001 oasc.ZkController.register We are http://127.0.0.1:22001/collection1/ and leader is http://127.0.0.1:22001/collection1/
[junit4:junit4] 2> 363073 T1001 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:22001
[junit4:junit4] 2> 363073 T1001 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 363073 T1001 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 363074 T1001 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 363076 T1001 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 363078 T958 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 363079 T958 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 363079 T958 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 363365 T958 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 363368 T958 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:22007
[junit4:junit4] 2> 363369 T958 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 363369 T958 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 363370 T958 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1371473390606
[junit4:junit4] 2> 363370 T958 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1371473390606/solr.xml
[junit4:junit4] 2> 363371 T958 oasc.CoreContainer.<init> New CoreContainer 962656283
[junit4:junit4] 2> 363372 T958 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1371473390606/'
[junit4:junit4] 2> 363372 T958 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1371473390606/'
[junit4:junit4] 2> 363501 T958 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 363502 T958 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 363502 T958 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 363503 T958 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 363503 T958 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 363504 T958 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 363504 T958 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 363505 T958 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 363505 T958 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 363506 T958 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 363522 T958 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 363523 T958 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:21719/solr
[junit4:junit4] 2> 363524 T958 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 363525 T958 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 363528 T1014 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4a86a8b0 name:ZooKeeperConnection Watcher:127.0.0.1:21719 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 363529 T958 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 363543 T958 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 363556 T958 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 363558 T1016 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2f2cf924 name:ZooKeeperConnection Watcher:127.0.0.1:21719/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 363558 T958 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 363571 T958 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 364538 T981 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 364539 T981 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:22001_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:22001"}
[junit4:junit4] 2> 364580 T987 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 364580 T1000 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 364580 T958 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:22007_
[junit4:junit4] 2> 364580 T980 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 364580 T1016 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 364583 T958 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:22007_
[junit4:junit4] 2> 364594 T1000 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 364595 T987 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 364595 T980 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 364595 T987 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 364595 T1016 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 364595 T980 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 364596 T1016 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 364597 T1000 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 364605 T1017 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 364605 T1017 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 366089 T981 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 366090 T981 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:22007_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:22007"}
[junit4:junit4] 2> 366090 T981 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 366090 T981 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 366109 T987 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 366109 T1000 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 366109 T980 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 366109 T1016 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 366609 T1017 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1371473390606/collection1
[junit4:junit4] 2> 366609 T1017 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 366610 T1017 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 366611 T1017 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 366613 T1017 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1371473390606/collection1/'
[junit4:junit4] 2> 366614 T1017 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty2-1371473390606/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 366615 T1017 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty2-1371473390606/collection1/lib/README' to classloader
[junit4:junit4] 2> 366669 T1017 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 366732 T1017 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 366834 T1017 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 366841 T1017 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 367420 T1017 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 367424 T1017 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 367427 T1017 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 367433 T1017 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 367475 T1017 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 367476 T1017 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1371473390606/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1371473380517/jetty2/
[junit4:junit4] 2> 367476 T1017 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6fd12d1f
[junit4:junit4] 2> 367477 T1017 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 367478 T1017 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1371473380517/jetty2
[junit4:junit4] 2> 367478 T1017 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1371473380517/jetty2/index/
[junit4:junit4] 2> 367479 T1017 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1371473380517/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 367479 T1017 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1371473380517/jetty2/index
[junit4:junit4] 2> 367483 T1017 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@18e55c11 lockFactory=org.apache.lucene.store.NativeFSLockFactory@773d34fd),segFN=segments_1,generation=1}
[junit4:junit4] 2> 367483 T1017 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 367487 T1017 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 367488 T1017 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 367488 T1017 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 367489 T1017 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 367490 T1017 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 367490 T1017 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 367491 T1017 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 367491 T1017 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 367492 T1017 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 367508 T1017 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 367516 T1017 oass.SolrIndexSearcher.<init> Opening Searcher@2d9b110a main
[junit4:junit4] 2> 367517 T1017 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1371473380517/jetty2/tlog
[junit4:junit4] 2> 367518 T1017 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 367518 T1017 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 367524 T1018 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2d9b110a main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 367528 T1017 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 367528 T1017 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:22007 collection:collection1 shard:shard2
[junit4:junit4] 2> 367529 T1017 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 367558 T1017 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 367570 T1017 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 367570 T1017 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 367570 T1017 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:22007/collection1/
[junit4:junit4] 2> 367570 T1017 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 367571 T1017 oasc.SyncStrategy.syncToMe http://127.0.0.1:22007/collection1/ has no replicas
[junit4:junit4] 2> 367571 T1017 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:22007/collection1/
[junit4:junit4] 2> 367571 T1017 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 367615 T981 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 367637 T987 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 367638 T1000 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 367638 T980 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 367638 T1016 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 367689 T1017 oasc.ZkController.register We are http://127.0.0.1:22007/collection1/ and leader is http://127.0.0.1:22007/collection1/
[junit4:junit4] 2> 367689 T1017 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:22007
[junit4:junit4] 2> 367689 T1017 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 367689 T1017 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 367690 T1017 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 367696 T1017 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 367698 T958 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 367698 T958 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 367699 T958 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 367990 T958 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 367993 T958 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:22011
[junit4:junit4] 2> 367994 T958 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 367994 T958 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 367995 T958 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1371473395238
[junit4:junit4] 2> 367995 T958 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1371473395238/solr.xml
[junit4:junit4] 2> 367996 T958 oasc.CoreContainer.<init> New CoreContainer 1443936274
[junit4:junit4] 2> 367997 T958 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1371473395238/'
[junit4:junit4] 2> 367997 T958 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1371473395238/'
[junit4:junit4] 2> 368126 T958 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 368127 T958 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 368127 T958 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 368128 T958 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 368128 T958 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 368129 T958 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 368129 T958 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 368130 T958 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 368130 T958 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 368131 T958 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 368148 T958 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 368149 T958 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:21719/solr
[junit4:junit4] 2> 368149 T958 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 368150 T958 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 368154 T1030 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@32096a17 name:ZooKeeperConnection Watcher:127.0.0.1:21719 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 368155 T958 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 368173 T958 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 368186 T958 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 368189 T1032 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7a538398 name:ZooKeeperConnection Watcher:127.0.0.1:21719/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 368189 T958 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 368196 T958 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 369153 T981 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 369155 T981 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:22007_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:22007"}
[junit4:junit4] 2> 369170 T987 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 369170 T980 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 369170 T1000 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 369170 T1016 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 369170 T1032 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 369201 T958 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:22011_
[junit4:junit4] 2> 369204 T958 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:22011_
[junit4:junit4] 2> 369207 T1000 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 369208 T987 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 369208 T1032 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 369208 T980 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 369208 T987 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 369208 T1016 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 369208 T980 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 369208 T1032 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 369209 T1016 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 369210 T1000 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 369218 T1033 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 369218 T1033 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 370678 T981 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 370680 T981 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:22011_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:22011"}
[junit4:junit4] 2> 370680 T981 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 370680 T981 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 370699 T987 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 370699 T1032 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 370699 T1000 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 370699 T980 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 370699 T1016 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 371222 T1033 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1371473395238/collection1
[junit4:junit4] 2> 371222 T1033 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 371223 T1033 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 371223 T1033 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 371225 T1033 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1371473395238/collection1/'
[junit4:junit4] 2> 371227 T1033 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty3-1371473395238/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 371228 T1033 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty3-1371473395238/collection1/lib/README' to classloader
[junit4:junit4] 2> 371282 T1033 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 371346 T1033 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 371448 T1033 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 371455 T1033 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 372034 T1033 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 372038 T1033 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 372040 T1033 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 372046 T1033 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 372090 T1033 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 372090 T1033 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1371473395238/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1371473380517/jetty3/
[junit4:junit4] 2> 372091 T1033 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6fd12d1f
[junit4:junit4] 2> 372091 T1033 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 372092 T1033 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1371473380517/jetty3
[junit4:junit4] 2> 372092 T1033 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1371473380517/jetty3/index/
[junit4:junit4] 2> 372093 T1033 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1371473380517/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 372093 T1033 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1371473380517/jetty3/index
[junit4:junit4] 2> 372097 T1033 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4819f090 lockFactory=org.apache.lucene.store.NativeFSLockFactory@390894ef),segFN=segments_1,generation=1}
[junit4:junit4] 2> 372097 T1033 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 372101 T1033 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 372101 T1033 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 372102 T1033 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 372103 T1033 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 372103 T1033 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 372104 T1033 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 372104 T1033 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 372105 T1033 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 372105 T1033 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 372121 T1033 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 372127 T1033 oass.SolrIndexSearcher.<init> Opening Searcher@2cdc45e main
[junit4:junit4] 2> 372128 T1033 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1371473380517/jetty3/tlog
[junit4:junit4] 2> 372129 T1033 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 372129 T1033 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 372135 T1034 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2cdc45e main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 372137 T1033 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 372138 T1033 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:22011 collection:collection1 shard:shard1
[junit4:junit4] 2> 372169 T1033 oasc.ZkController.register We are http://127.0.0.1:22011/collection1/ and leader is http://127.0.0.1:22001/collection1/
[junit4:junit4] 2> 372170 T1033 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:22011
[junit4:junit4] 2> 372170 T1033 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 372170 T1033 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C127 name=collection1 org.apache.solr.core.SolrCore@7d35b264 url=http://127.0.0.1:22011/collection1 node=127.0.0.1:22011_ C127_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:22011_, base_url=http://127.0.0.1:22011}
[junit4:junit4] 2> 372171 T1035 C127 P22011 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 372171 T1035 C127 P22011 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 372171 T1035 C127 P22011 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 372172 T1035 C127 P22011 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 372171 T1033 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 372174 T1035 C127 P22011 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 372175 T958 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 372175 T958 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 372176 T958 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 372194 T990 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 372207 T981 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 372208 T981 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:22011_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:22011"}
[junit4:junit4] 2> 372226 T987 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 372226 T1032 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 372226 T1000 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 372226 T1016 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 372226 T980 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 372438 T958 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 372453 T958 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:22015
[junit4:junit4] 2> 372454 T958 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 372455 T958 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 372455 T958 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1371473399703
[junit4:junit4] 2> 372456 T958 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1371473399703/solr.xml
[junit4:junit4] 2> 372456 T958 oasc.CoreContainer.<init> New CoreContainer 883191739
[junit4:junit4] 2> 372457 T958 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1371473399703/'
[junit4:junit4] 2> 372458 T958 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1371473399703/'
[junit4:junit4] 2> 372589 T958 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 372590 T958 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 372591 T958 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 372591 T958 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 372592 T958 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 372592 T958 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 372593 T958 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 372593 T958 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 372594 T958 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 372594 T958 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 372612 T958 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 372613 T958 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:21719/solr
[junit4:junit4] 2> 372613 T958 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 372615 T958 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 372618 T1047 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6763af88 name:ZooKeeperConnection Watcher:127.0.0.1:21719 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 372619 T958 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 372622 T958 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 372634 T958 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 372637 T1049 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7607d6e6 name:ZooKeeperConnection Watcher:127.0.0.1:21719/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 372637 T958 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 372643 T958 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 373196 T990 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 373196 T990 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=4&state=recovering&nodeName=127.0.0.1:22011_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1002
[junit4:junit4] 2> 373649 T958 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:22015_
[junit4:junit4] 2> 373658 T958 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:22015_
[junit4:junit4] 2> 373662 T1000 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 373663 T987 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 373663 T1032 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 373663 T980 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 373663 T1032 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 373663 T1049 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 373663 T987 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 373663 T1016 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 373663 T980 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 373664 T1016 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 373665 T1000 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 373672 T1050 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 373673 T1050 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 373732 T981 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 373733 T981 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:22015_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:22015"}
[junit4:junit4] 2> 373734 T981 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 373734 T981 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 373747 T987 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 373747 T1032 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 373747 T1000 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 373747 T1049 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 373747 T980 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 373747 T1016 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 374676 T1050 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1371473399703/collection1
[junit4:junit4] 2> 374676 T1050 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 374677 T1050 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 374678 T1050 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 374680 T1050 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1371473399703/collection1/'
[junit4:junit4] 2> 374682 T1050 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty4-1371473399703/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 374682 T1050 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty4-1371473399703/collection1/lib/README' to classloader
[junit4:junit4] 2> 374736 T1050 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 374798 T1050 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 374900 T1050 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 374907 T1050 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> ASYNC NEW_CORE C128 name=collection1 org.apache.solr.core.SolrCore@7d35b264 url=http://127.0.0.1:22011/collection1 node=127.0.0.1:22011_ C128_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:22011_, base_url=http://127.0.0.1:22011}
[junit4:junit4] 2> 375198 T1035 C128 P22011 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:22001/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 375198 T1035 C128 P22011 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:22011 START replicas=[http://127.0.0.1:22001/collection1/] nUpdates=100
[junit4:junit4] 2> 375199 T1035 C128 P22011 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 375200 T1035 C128 P22011 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 375200 T1035 C128 P22011 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 375200 T1035 C128 P22011 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 375200 T1035 C128 P22011 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 375201 T1035 C128 P22011 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:22001/collection1/. core=collection1
[junit4:junit4] 2> 375201 T1035 C128 P22011 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C129 name=collection1 org.apache.solr.core.SolrCore@fc39c9f url=http://127.0.0.1:22001/collection1 node=127.0.0.1:22001_ C129_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:22001_, base_url=http://127.0.0.1:22001, leader=true}
[junit4:junit4] 2> 375208 T991 C129 P22001 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 375213 T992 C129 P22001 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 375216 T992 C129 P22001 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@17c532bb lockFactory=org.apache.lucene.store.NativeFSLockFactory@19e0a697),segFN=segments_1,generation=1}
[junit4:junit4] 2> 375216 T992 C129 P22001 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 375217 T992 C129 P22001 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@17c532bb lockFactory=org.apache.lucene.store.NativeFSLockFactory@19e0a697),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@17c532bb lockFactory=org.apache.lucene.store.NativeFSLockFactory@19e0a697),segFN=segments_2,generation=2}
[junit4:junit4] 2> 375218 T992 C129 P22001 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 375218 T992 C129 P22001 oass.SolrIndexSearcher.<init> Opening Searcher@46e2ea55 realtime
[junit4:junit4] 2> 375219 T992 C129 P22001 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 375219 T992 C129 P22001 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> 375220 T1035 C128 P22011 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 375220 T1035 C128 P22011 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 375223 T993 C129 P22001 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 375223 T993 C129 P22001 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 375224 T1035 C128 P22011 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 375224 T1035 C128 P22011 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 375225 T1035 C128 P22011 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 375227 T993 C129 P22001 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 375228 T1035 C128 P22011 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 375229 T1035 C128 P22011 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1371473380517/jetty3/index.20130617075002738
[junit4:junit4] 2> 375229 T1035 C128 P22011 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@49e5675b lockFactory=org.apache.lucene.store.NativeFSLockFactory@7ec8d76a) fullCopy=false
[junit4:junit4] 2> 375232 T993 C129 P22001 oasc.SolrCore.execute [collection1] webapp= path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 375233 T1035 C128 P22011 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 375234 T1035 C128 P22011 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 375234 T1035 C128 P22011 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 375237 T1035 C128 P22011 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4819f090 lockFactory=org.apache.lucene.store.NativeFSLockFactory@390894ef),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4819f090 lockFactory=org.apache.lucene.store.NativeFSLockFactory@390894ef),segFN=segments_2,generation=2}
[junit4:junit4] 2> 375237 T1035 C128 P22011 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 375238 T1035 C128 P22011 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 375238 T1035 C128 P22011 oass.SolrIndexSearcher.<init> Opening Searcher@659f993e main
[junit4:junit4] 2> 375240 T1034 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@659f993e main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 375240 T1035 C128 P22011 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1371473380517/jetty3/index.20130617075002738 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1371473380517/jetty3/index.20130617075002738;done=true>>]
[junit4:junit4] 2> 375241 T1035 C128 P22011 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1371473380517/jetty3/index.20130617075002738
[junit4:junit4] 2> 375241 T1035 C128 P22011 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ShardSplitTest-1371473380517/jetty3/index.20130617075002738
[junit4:junit4] 2> 375241 T1035 C128 P22011 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 375242 T1035 C128 P22011 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 375242 T1035 C128 P22011 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 375242 T1035 C128 P22011 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 375244 T1035 C128 P22011 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 375255 T981 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 375256 T981 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:22011_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:22011"}
[junit4:junit4] 2> 375262 T987 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 375262 T980 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 375262 T1049 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 375263 T1000 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 375262 T1032 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 375262 T1016 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 375489 T1050 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 375493 T1050 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 375496 T1050 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 375502 T1050 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 375540 T1050 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 375541 T1050 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1371473399703/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1371473380517/jetty4/
[junit4:junit4] 2> 375541 T1050 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6fd12d1f
[junit4:junit4] 2> 375542 T1050 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 375543 T1050 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1371473380517/jetty4
[junit4:junit4] 2> 375543 T1050 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1371473380517/jetty4/index/
[junit4:junit4] 2> 375543 T1050 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1371473380517/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 375544 T1050 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1371473380517/jetty4/index
[junit4:junit4] 2> 375548 T1050 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@74c9cab2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@10b9571d),segFN=segments_1,generation=1}
[junit4:junit4] 2> 375548 T1050 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 375552 T1050 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 375552 T1050 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 375553 T1050 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 375554 T1050 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 375554 T1050 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 375555 T1050 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 375556 T1050 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 375556 T1050 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 375557 T1050 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 375573 T1050 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 375581 T1050 oass.SolrIndexSearcher.<init> Opening Searcher@6c1a1b50 main
[junit4:junit4] 2> 375581 T1050 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1371473380517/jetty4/tlog
[junit4:junit4] 2> 375583 T1050 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 375583 T1050 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 375589 T1053 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6c1a1b50 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 375604 T1050 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 375605 T1050 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:22015 collection:collection1 shard:shard2
[junit4:junit4] 2> 375609 T1050 oasc.ZkController.register We are http://127.0.0.1:22015/collection1/ and leader is http://127.0.0.1:22007/collection1/
[junit4:junit4] 2> 375610 T1050 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:22015
[junit4:junit4] 2> 375610 T1050 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 375610 T1050 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C130 name=collection1 org.apache.solr.core.SolrCore@5b295825 url=http://127.0.0.1:22015/collection1 node=127.0.0.1:22015_ C130_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:22015_, base_url=http://127.0.0.1:22015}
[junit4:junit4] 2> 375611 T1054 C130 P22015 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 375611 T1054 C130 P22015 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 375611 T1050 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 375611 T1054 C130 P22015 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 375612 T1054 C130 P22015 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 375613 T958 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 375614 T958 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 375614 T1054 C130 P22015 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 375614 T958 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 375638 T958 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 375639 T1006 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 375640 T958 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 2> 375640 T958 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 2> 375641 T958 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 376644 T958 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 376769 T981 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 376770 T981 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:22015_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:22015"}
[junit4:junit4] 2> 376820 T987 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 376820 T1000 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 376820 T1032 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 376820 T980 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 376820 T1049 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 376820 T1016 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 377641 T1006 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 377641 T1006 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=5&state=recovering&nodeName=127.0.0.1:22015_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2002
[junit4:junit4] 2> 377646 T958 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 378649 T958 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C130_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:22015_, base_url=http://127.0.0.1:22015}
[junit4:junit4] 2> 379643 T1054 C130 P22015 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:22007/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 379643 T1054 C130 P22015 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:22015 START replicas=[http://127.0.0.1:22007/collection1/] nUpdates=100
[junit4:junit4] 2> 379644 T1054 C130 P22015 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 379644 T1054 C130 P22015 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 379644 T1054 C130 P22015 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 379644 T1054 C130 P22015 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 379645 T1054 C130 P22015 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 379645 T1054 C130 P22015 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:22007/collection1/. core=collection1
[junit4:junit4] 2> 379645 T1054 C130 P22015 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 379652 T958 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> ASYNC NEW_CORE C131 name=collection1 org.apache.solr.core.SolrCore@22e0db0f url=http://127.0.0.1:22007/collection1 node=127.0.0.1:22007_ C131_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:22007_, base_url=http://127.0.0.1:22007, leader=true}
[junit4:junit4] 2> 379653 T1007 C131 P22007 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 379658 T1008 C131 P22007 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 379660 T1008 C131 P22007 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@18e55c11 lockFactory=org.apache.lucene.store.NativeFSLockFactory@773d34fd),segFN=segments_1,generation=1}
[junit4:junit4] 2> 379661 T1008 C131 P22007 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 379662 T1008 C131 P22007 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@18e55c11 lockFactory=org.apache.lucene.store.NativeFSLockFactory@773d34fd),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@18e55c11 lockFactory=org.apache.lucene.store.NativeFSLockFactory@773d34fd),segFN=segments_2,generation=2}
[junit4:junit4] 2> 379662 T1008 C131 P22007 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 379663 T1008 C131 P22007 oass.SolrIndexSearcher.<init> Opening Searcher@489e50aa realtime
[junit4:junit4] 2> 379663 T1008 C131 P22007 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 379664 T1008 C131 P22007 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 379664 T1054 C130 P22015 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 379665 T1054 C130 P22015 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 379667 T1009 C131 P22007 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 379667 T1009 C131 P22007 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 379668 T1054 C130 P22015 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 379668 T1054 C130 P22015 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 379668 T1054 C130 P22015 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 379671 T1009 C131 P22007 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 379672 T1054 C130 P22015 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 379673 T1054 C130 P22015 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1371473380517/jetty4/index.20130617075007182
[junit4:junit4] 2> 379673 T1054 C130 P22015 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@290eee71 lockFactory=org.apache.lucene.store.NativeFSLockFactory@47a92768) fullCopy=false
[junit4:junit4] 2> 379676 T1009 C131 P22007 oasc.SolrCore.execute [collection1] webapp= path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 379677 T1054 C130 P22015 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 379678 T1054 C130 P22015 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 379678 T1054 C130 P22015 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 379680 T1054 C130 P22015 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@74c9cab2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@10b9571d),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@74c9cab2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@10b9571d),segFN=segments_2,generation=2}
[junit4:junit4] 2> 379681 T1054 C130 P22015 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 379681 T1054 C130 P22015 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 379681 T1054 C130 P22015 oass.SolrIndexSearcher.<init> Opening Searcher@3a64fcde main
[junit4:junit4] 2> 379683 T1053 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3a64fcde main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 379683 T1054 C130 P22015 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1371473380517/jetty4/index.20130617075007182 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1371473380517/jetty4/index.20130617075007182;done=true>>]
[junit4:junit4] 2> 379684 T1054 C130 P22015 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1371473380517/jetty4/index.20130617075007182
[junit4:junit4] 2> 379684 T1054 C130 P22015 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ShardSplitTest-1371473380517/jetty4/index.20130617075007182
[junit4:junit4] 2> 379684 T1054 C130 P22015 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 379685 T1054 C130 P22015 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 379685 T1054 C130 P22015 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 379685 T1054 C130 P22015 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 379687 T1054 C130 P22015 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 379829 T981 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 379830 T981 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:22015_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:22015"}
[junit4:junit4] 2> 379846 T987 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 379846 T980 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 379846 T1032 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 379846 T1016 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 379846 T1049 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 379846 T1000 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 380655 T958 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 380657 T958 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> ASYNC NEW_CORE C132 name=collection1 org.apache.solr.core.SolrCore@4af8bc2e url=http://127.0.0.1:58032/collection1 node=127.0.0.1:58032_ C132_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:58032_, base_url=http://127.0.0.1:58032, leader=true}
[junit4:junit4] 2> 380666 T970 C132 P58032 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 380669 T970 C132 P58032 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7ead3503 lockFactory=org.apache.lucene.store.NativeFSLockFactory@254ca1ff),segFN=segments_1,generation=1}
[junit4:junit4] 2> 380670 T970 C132 P58032 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 380671 T970 C132 P58032 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7ead3503 lockFactory=org.apache.lucene.store.NativeFSLockFactory@254ca1ff),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7ead3503 lockFactory=org.apache.lucene.store.NativeFSLockFactory@254ca1ff),segFN=segments_2,generation=2}
[junit4:junit4] 2> 380672 T970 C132 P58032 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 380672 T970 C132 P58032 oass.SolrIndexSearcher.<init> Opening Searcher@22dfca6 main
[junit4:junit4] 2> 380673 T970 C132 P58032 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 380674 T984 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@22dfca6 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 380675 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 9
[junit4:junit4] 2> 380688 T1010 C131 P22007 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 380689 T1010 C131 P22007 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@18e55c11 lockFactory=org.apache.lucene.store.NativeFSLockFactory@773d34fd),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@18e55c11 lockFactory=org.apache.lucene.store.NativeFSLockFactory@773d34fd),segFN=segments_3,generation=3}
[junit4:junit4] 2> 380689 T1010 C131 P22007 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 380690 T1010 C131 P22007 oass.SolrIndexSearcher.<init> Opening Searcher@1a78a34d main
[junit4:junit4] 2> 380690 T1010 C131 P22007 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 380691 T1018 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1a78a34d main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 380692 T1010 C131 P22007 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:22001/collection1/, StdNode: http://127.0.0.1:22011/collection1/, StdNode: http://127.0.0.1:22015/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> ASYNC NEW_CORE C133 name=collection1 org.apache.solr.core.SolrCore@fc39c9f url=http://127.0.0.1:22001/collection1 node=127.0.0.1:22001_ C133_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:22001_, base_url=http://127.0.0.1:22001, leader=true}
[junit4:junit4] 2> 380695 T994 C133 P22001 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 380697 T994 C133 P22001 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@17c532bb lockFactory=org.apache.lucene.store.NativeFSLockFactory@19e0a697),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@17c532bb lockFactory=org.apache.lucene.store.NativeFSLockFactory@19e0a697),segFN=segments_3,generation=3}
[junit4:junit4] 2> 380697 T994 C133 P22001 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 380698 T994 C133 P22001 oass.SolrIndexSearcher.<init> Opening Searcher@64daba74 main
[junit4:junit4] 2> 380698 T994 C133 P22001 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 380699 T1002 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@64daba74 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 380700 T994 C133 P22001 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 5
[junit4:junit4] 2> C130_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:22015_, base_url=http://127.0.0.1:22015}
[junit4:junit4] 2> 380703 T1039 C130 P22015 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> ASYNC NEW_CORE C134 name=collection1 org.apache.solr.core.SolrCore@7d35b264 url=http://127.0.0.1:22011/collection1 node=127.0.0.1:22011_ C134_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:22011_, base_url=http://127.0.0.1:22011}
[junit4:junit4] 2> 380703 T1022 C134 P22011 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 380704 T1039 C130 P22015 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@74c9cab2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@10b9571d),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@74c9cab2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@10b9571d),segFN=segments_3,generation=3}
[junit4:junit4] 2> 380705 T1022 C134 P22011 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4819f090 lockFactory=org.apache.lucene.store.NativeFSLockFactory@390894ef),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4819f090 lockFactory=org.apache.lucene.store.NativeFSLockFactory@390894ef),segFN=segments_3,generation=3}
[junit4:junit4] 2> 380705 T1039 C130 P22015 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 380705 T1022 C134 P22011 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 380706 T1039 C130 P22015 oass.SolrIndexSearcher.<init> Opening Searcher@12840847 main
[junit4:junit4] 2> 380706 T1022 C134 P22011 oass.SolrIndexSearcher.<init> Opening Searcher@446b4a8a main
[junit4:junit4] 2> 380707 T1039 C130 P22015 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 380707 T1022 C134 P22011 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 380708 T1053 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@12840847 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 380708 T1034 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@446b4a8a main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 380708 T1039 C130 P22015 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 5
[junit4:junit4] 2> 380709 T1022 C134 P22011 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> 380709 T1010 C131 P22007 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 21
[junit4:junit4] 2> 380711 T958 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 380714 T995 C133 P22001 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 380717 T1023 C134 P22011 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 380719 T1011 C131 P22007 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 380721 T1040 C130 P22015 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 382732 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1438094102615818240)} 0 8
[junit4:junit4] 2> 382747 T1024 C134 P22011 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=FROMLEADER&_version_=-1438094102620012544&update.from=http://127.0.0.1:22001/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1438094102620012544)} 0 2
[junit4:junit4] 2> 382750 T1039 C130 P22015 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=FROMLEADER&_version_=-1438094102631546880&update.from=http://127.0.0.1:22007/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1438094102631546880)} 0 1
[junit4:junit4] 2> 382751 T1012 C131 P22007 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=TOLEADER&wt=javabin&version=2} {deleteByQuery=*:* (-1438094102631546880)} 0 6
[junit4:junit4] 2> 382752 T996 C133 P22001 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1438094102620012544)} 0 18
[junit4:junit4] 2> 382756 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!0 (1438094102642032640)]} 0 1
[junit4:junit4] 2> 382783 T1039 C130 P22015 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22007/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!0 (1438094102667198464)]} 0 1
[junit4:junit4] 2> 382784 T1012 C131 P22007 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22001/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[a!0 (1438094102667198464)]} 0 5
[junit4:junit4] 2> 382784 T996 C133 P22001 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!0]} 0 25
[junit4:junit4] 2> 382787 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!1 (1438094102675587072)]} 0 0
[junit4:junit4] 2> 382794 T1024 C134 P22011 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22001/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!1 (1438094102678732800)]} 0 1
[junit4:junit4] 2> 382794 T996 C133 P22001 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!1 (1438094102678732800)]} 0 4
[junit4:junit4] 2> 382797 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!2 (1438094102686072832)]} 0 0
[junit4:junit4] 2> 382805 T1024 C134 P22011 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22001/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!2 (1438094102691315712)]} 0 0
[junit4:junit4] 2> 382806 T994 C133 P22001 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22007/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[c!2 (1438094102691315712)]} 0 4
[junit4:junit4] 2> 382807 T1010 C131 P22007 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!2]} 0 7
[junit4:junit4] 2> 382809 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!3 (1438094102698655744)]} 0 0
[junit4:junit4] 2> 382817 T1039 C130 P22015 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22007/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!3 (1438094102703898624)]} 0 0
[junit4:junit4] 2> 382818 T1012 C131 P22007 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22001/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[d!3 (1438094102703898624)]} 0 4
[junit4:junit4] 2> 382819 T996 C133 P22001 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!3]} 0 7
[junit4:junit4] 2> 382821 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!4 (1438094102711238656)]} 0 0
[junit4:junit4] 2> 382827 T1039 C130 P22015 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22007/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!4 (1438094102714384384)]} 0 0
[junit4:junit4] 2> 382828 T1010 C131 P22007 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!4 (1438094102714384384)]} 0 4
[junit4:junit4] 2> 382831 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!5 (1438094102721724416)]} 0 0
[junit4:junit4] 2> 382837 T1039 C130 P22015 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22007/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!5 (1438094102724870144)]} 0 0
[junit4:junit4] 2> 382838 T1010 C131 P22007 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!5 (1438094102724870144)]} 0 4
[junit4:junit4] 2> 382842 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!6 (1438094102732210176)]} 0 1
[junit4:junit4] 2> 382847 T1024 C134 P22011 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22001/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!6 (1438094102735355904)]} 0 0
[junit4:junit4] 2> 382848 T996 C133 P22001 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!6 (1438094102735355904)]} 0 4
[junit4:junit4] 2> 382851 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!7 (1438094102742695936)]} 0 0
[junit4:junit4] 2> 382859 T1024 C134 P22011 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22001/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!7 (1438094102747938816)]} 0 0
[junit4:junit4] 2> 382860 T994 C133 P22001 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22007/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[h!7 (1438094102747938816)]} 0 4
[junit4:junit4] 2> 382861 T1010 C131 P22007 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!7]} 0 7
[junit4:junit4] 2> 382864 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!8 (1438094102756327424)]} 0 0
[junit4:junit4] 2> 382870 T1024 C134 P22011 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22001/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!8 (1438094102759473152)]} 0 0
[junit4:junit4] 2> 382871 T996 C133 P22001 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!8 (1438094102759473152)]} 0 4
[junit4:junit4] 2> 382874 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!9 (1438094102766813184)]} 0 0
[junit4:junit4] 2> 382882 T1024 C134 P22011 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22001/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!9 (1438094102772056064)]} 0 0
[junit4:junit4] 2> 382883 T994 C133 P22001 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22007/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[j!9 (1438094102772056064)]} 0 4
[junit4:junit4] 2> 382884 T1010 C131 P22007 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!9]} 0 7
[junit4:junit4] 2> 382887 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!10 (1438094102780444672)]} 0 0
[junit4:junit4] 2> 382895 T1024 C134 P22011 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22001/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[k!10 (1438094102785687552)]} 0 0
[junit4:junit4] 2> 382896 T994 C133 P22001 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22007/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[k!10 (1438094102785687552)]} 0 4
[junit4:junit4] 2> 382897 T1010 C131 P22007 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!10]} 0 7
[junit4:junit4] 2> 382899 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!11 (1438094102793027584)]} 0 0
[junit4:junit4] 2> 382905 T1039 C130 P22015 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22007/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[l!11 (1438094102796173312)]} 0 0
[junit4:junit4] 2> 382906 T1010 C131 P22007 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!11 (1438094102796173312)]} 0 4
[junit4:junit4] 2> 382909 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!12 (1438094102803513344)]} 0 0
[junit4:junit4] 2> 382915 T1039 C130 P22015 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22007/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[m!12 (1438094102806659072)]} 0 0
[junit4:junit4] 2> 382916 T1010 C131 P22007 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!12 (1438094102806659072)]} 0 4
[junit4:junit4] 2> 382919 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!13 (1438094102813999104)]} 0 0
[junit4:junit4] 2> 382927 T1024 C134 P22011 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22001/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[n!13 (1438094102819241984)]} 0 0
[junit4:junit4] 2> 382928 T994 C133 P22001 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22007/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[n!13 (1438094102819241984)]} 0 4
[junit4:junit4] 2> 382929 T1010 C131 P22007 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!13]} 0 7
[junit4:junit4] 2> 382931 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!14 (1438094102826582016)]} 0 0
[junit4:junit4] 2> 382937 T1039 C130 P22015 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22007/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[o!14 (1438094102829727744)]} 0 0
[junit4:junit4] 2> 382938 T1010 C131 P22007 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!14 (1438094102829727744)]} 0 4
[junit4:junit4] 2> 382941 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!15 (1438094102837067776)]} 0 0
[junit4:junit4] 2> 382949 T1024 C134 P22011 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22001/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[p!15 (1438094102842310656)]} 0 0
[junit4:junit4] 2> 382950 T994 C133 P22001 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22007/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[p!15 (1438094102842310656)]} 0 4
[junit4:junit4] 2> 382951 T1010 C131 P22007 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!15]} 0 7
[junit4:junit4] 2> 382953 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!16 (1438094102849650688)]} 0 0
[junit4:junit4] 2> 382959 T1024 C134 P22011 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22001/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[q!16 (1438094102852796416)]} 0 0
[junit4:junit4] 2> 382960 T996 C133 P22001 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!16 (1438094102852796416)]} 0 4
[junit4:junit4] 2> 382963 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!17 (1438094102860136448)]} 0 0
[junit4:junit4] 2> 382971 T1039 C130 P22015 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22007/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[r!17 (1438094102865379328)]} 0 0
[junit4:junit4] 2> 382972 T1012 C131 P22007 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22001/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[r!17 (1438094102865379328)]} 0 4
[junit4:junit4] 2> 382973 T996 C133 P22001 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!17]} 0 7
[junit4:junit4] 2> 382976 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!18 (1438094102872719360)]} 0 1
[junit4:junit4] 2> 382983 T1024 C134 P22011 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22001/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[s!18 (1438094102877962240)]} 0 0
[junit4:junit4] 2> 382984 T994 C133 P22001 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22007/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[s!18 (1438094102877962240)]} 0 4
[junit4:junit4] 2> 382985 T1010 C131 P22007 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!18]} 0 7
[junit4:junit4] 2> 382987 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!19 (1438094102885302272)]} 0 0
[junit4:junit4] 2> 382995 T1024 C134 P22011 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22001/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[t!19 (1438094102890545152)]} 0 0
[junit4:junit4] 2> 382996 T994 C133 P22001 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22007/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[t!19 (1438094102890545152)]} 0 4
[junit4:junit4] 2> 382997 T1010 C131 P22007 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!19]} 0 7
[junit4:junit4] 2> 382999 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!20 (1438094102897885184)]} 0 0
[junit4:junit4] 2> 383005 T1039 C130 P22015 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22007/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[u!20 (1438094102901030912)]} 0 0
[junit4:junit4] 2> 383006 T1010 C131 P22007 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!20 (1438094102901030912)]} 0 4
[junit4:junit4] 2> 383009 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[v!21 (1438094102908370944)]} 0 0
[junit4:junit4] 2> 383015 T1024 C134 P22011 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22001/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[v!21 (1438094102911516672)]} 0 0
[junit4:junit4] 2> 383016 T996 C133 P22001 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[v!21 (1438094102911516672)]} 0 4
[junit4:junit4] 2> 383019 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[w!22 (1438094102918856704)]} 0 0
[junit4:junit4] 2> 383025 T1024 C134 P22011 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22001/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[w!22 (1438094102922002432)]} 0 0
[junit4:junit4] 2> 383026 T996 C133 P22001 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[w!22 (1438094102922002432)]} 0 4
[junit4:junit4] 2> 383029 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[x!23 (1438094102929342464)]} 0 0
[junit4:junit4] 2> 383037 T1039 C130 P22015 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22007/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[x!23 (1438094102934585344)]} 0 0
[junit4:junit4] 2> 383038 T1012 C131 P22007 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22001/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[x!23 (1438094102934585344)]} 0 4
[junit4:junit4] 2> 383039 T996 C133 P22001 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[x!23]} 0 7
[junit4:junit4] 2> 383041 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[y!24 (1438094102941925376)]} 0 0
[junit4:junit4] 2> 383047 T1039 C130 P22015 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22007/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[y!24 (1438094102945071104)]} 0 0
[junit4:junit4] 2> 383048 T1010 C131 P22007 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[y!24 (1438094102945071104)]} 0 4
[junit4:junit4] 2> 383051 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[z!25 (1438094102952411136)]} 0 0
[junit4:junit4] 2> 383059 T1024 C134 P22011 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22001/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[z!25 (1438094102957654016)]} 0 0
[junit4:junit4] 2> 383060 T994 C133 P22001 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22007/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[z!25 (1438094102957654016)]} 0 4
[junit4:junit4] 2> 383061 T1010 C131 P22007 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[z!25]} 0 7
[junit4:junit4] 2> 383063 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!26 (1438094102964994048)]} 0 0
[junit4:junit4] 2> 383071 T1039 C130 P22015 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22007/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!26 (1438094102970236928)]} 0 0
[junit4:junit4] 2> 383072 T1012 C131 P22007 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22001/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[a!26 (1438094102970236928)]} 0 4
[junit4:junit4] 2> 383073 T996 C133 P22001 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!26]} 0 7
[junit4:junit4] 2> 383076 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!27 (1438094102978625536)]} 0 0
[junit4:junit4] 2> 383084 T1024 C134 P22011 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22001/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!27 (1438094102983868416)]} 0 0
[junit4:junit4] 2> 383085 T994 C133 P22001 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22007/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[b!27 (1438094102983868416)]} 0 4
[junit4:junit4] 2> 383086 T1010 C131 P22007 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!27]} 0 7
[junit4:junit4] 2> 383088 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!28 (1438094102991208448)]} 0 0
[junit4:junit4] 2> 383096 T1024 C134 P22011 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22001/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!28 (1438094102996451328)]} 0 0
[junit4:junit4] 2> 383097 T994 C133 P22001 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22007/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[c!28 (1438094102996451328)]} 0 4
[junit4:junit4] 2> 383098 T1010 C131 P22007 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!28]} 0 7
[junit4:junit4] 2> 383100 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!29 (1438094103003791360)]} 0 0
[junit4:junit4] 2> 383106 T1039 C130 P22015 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22007/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!29 (1438094103006937088)]} 0 0
[junit4:junit4] 2> 383107 T1010 C131 P22007 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!29 (1438094103006937088)]} 0 4
[junit4:junit4] 2> 383110 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!30 (1438094103014277120)]} 0 0
[junit4:junit4] 2> 383116 T1039 C130 P22015 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22007/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!30 (1438094103017422848)]} 0 0
[junit4:junit4] 2> 383117 T1010 C131 P22007 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!30 (1438094103017422848)]} 0 4
[junit4:junit4] 2> 383120 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!31 (1438094103024762880)]} 0 0
[junit4:junit4] 2> 383128 T1039 C130 P22015 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22007/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!31 (1438094103030005760)]} 0 0
[junit4:junit4] 2> 383129 T1012 C131 P22007 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22001/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[f!31 (1438094103030005760)]} 0 4
[junit4:junit4] 2> 383130 T996 C133 P22001 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!31]} 0 7
[junit4:junit4] 2> 383132 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!32 (1438094103037345792)]} 0 0
[junit4:junit4] 2> 383138 T1024 C134 P22011 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22001/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!32 (1438094103040491520)]} 0 0
[junit4:junit4] 2> 383139 T996 C133 P22001 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!32 (1438094103040491520)]} 0 4
[junit4:junit4] 2> 383142 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!33 (1438094103047831552)]} 0 0
[junit4:junit4] 2> 383151 T1024 C134 P22011 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22001/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!33 (1438094103053074432)]} 0 1
[junit4:junit4] 2> 383151 T994 C133 P22001 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22007/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[h!33 (1438094103053074432)]} 0 4
[junit4:junit4] 2> 383152 T1010 C131 P22007 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!33]} 0 7
[junit4:junit4] 2> 383155 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!34 (1438094103061463040)]} 0 0
[junit4:junit4] 2> 383163 T1024 C134 P22011 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22001/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!34 (1438094103066705920)]} 0 0
[junit4:junit4] 2> 383164 T994 C133 P22001 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22007/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[i!34 (1438094103066705920)]} 0 4
[junit4:junit4] 2> 383165 T1010 C131 P22007 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!34]} 0 7
[junit4:junit4] 2> 383168 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!35 (1438094103075094528)]} 0 0
[junit4:junit4] 2> 383176 T1024 C134 P22011 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22001/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!35 (1438094103080337408)]} 0 0
[junit4:junit4] 2> 383177 T994 C133 P22001 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22007/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[j!35 (1438094103080337408)]} 0 4
[junit4:junit4] 2> 383178 T1010 C131 P22007 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!35]} 0 7
[junit4:junit4] 2> 383180 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!36 (1438094103087677440)]} 0 0
[junit4:junit4] 2> 383188 T1024 C134 P22011 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22001/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[k!36 (1438094103092920320)]} 0 0
[junit4:junit4] 2> 383189 T994 C133 P22001 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22007/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[k!36 (1438094103092920320)]} 0 4
[junit4:junit4] 2> 383190 T1010 C131 P22007 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!36]} 0 7
[junit4:junit4] 2> 383193 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!37 (1438094103100260352)]} 0 1
[junit4:junit4] 2> 383198 T1039 C130 P22015 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22007/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[l!37 (1438094103103406080)]} 0 0
[junit4:junit4] 2> 383199 T1010 C131 P22007 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!37 (1438094103103406080)]} 0 4
[junit4:junit4] 2> 383202 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!38 (1438094103110746112)]} 0 0
[junit4:junit4] 2> 383210 T1039 C130 P22015 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22007/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[m!38 (1438094103115988992)]} 0 0
[junit4:junit4] 2> 383211 T1012 C131 P22007 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22001/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[m!38 (1438094103115988992)]} 0 4
[junit4:junit4] 2> 383212 T996 C133 P22001 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!38]} 0 7
[junit4:junit4] 2> 383214 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!39 (1438094103123329024)]} 0 0
[junit4:junit4] 2> 383222 T1024 C134 P22011 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22001/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[n!39 (1438094103128571904)]} 0 0
[junit4:junit4] 2> 383223 T994 C133 P22001 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22007/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[n!39 (1438094103128571904)]} 0 4
[junit4:junit4] 2> 383224 T1010 C131 P22007 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!39]} 0 7
[junit4:junit4] 2> 383227 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!40 (1438094103135911936)]} 0 1
[junit4:junit4] 2> 383236 T1039 C130 P22015 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22007/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[o!40 (1438094103142203392)]} 0 0
[junit4:junit4] 2> 383236 T1012 C131 P22007 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22001/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[o!40 (1438094103142203392)]} 0 4
[junit4:junit4] 2> 383237 T996 C133 P22001 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!40]} 0 7
[junit4:junit4] 2> 383241 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!41 (1438094103150592000)]} 0 1
[junit4:junit4] 2> 383246 T1024 C134 P22011 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22001/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[p!41 (1438094103153737728)]} 0 0
[junit4:junit4] 2> 383247 T996 C133 P22001 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!41 (1438094103153737728)]} 0 4
[junit4:junit4] 2> 383251 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!42 (1438094103161077760)]} 0 1
[junit4:junit4] 2> 383256 T1024 C134 P22011 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22001/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[q!42 (1438094103164223488)]} 0 0
[junit4:junit4] 2> 383257 T996 C133 P22001 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!42 (1438094103164223488)]} 0 4
[junit4:junit4] 2> 383260 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!43 (1438094103171563520)]} 0 0
[junit4:junit4] 2> 383267 T1039 C130 P22015 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22007/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[r!43 (1438094103174709248)]} 0 1
[junit4:junit4] 2> 383267 T1010 C131 P22007 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!43 (1438094103174709248)]} 0 4
[junit4:junit4] 2> 383270 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!44 (1438094103182049280)]} 0 0
[junit4:junit4] 2> 383276 T1024 C134 P22011 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22001/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[s!44 (1438094103185195008)]} 0 0
[junit4:junit4] 2> 383277 T996 C133 P22001 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!44 (1438094103185195008)]} 0 4
[junit4:junit4] 2> 383280 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!45 (1438094103192535040)]} 0 0
[junit4:junit4] 2> 383286 T1024 C134 P22011 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22001/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[t!45 (1438094103195680768)]} 0 0
[junit4:junit4] 2> 383287 T996 C133 P22001 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!45 (1438094103195680768)]} 0 4
[junit4:junit4] 2> 383290 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!46 (1438094103203020800)]} 0 0
[junit4:junit4] 2> 383298 T1039 C130 P22015 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22007/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[u!46 (1438094103208263680)]} 0 0
[junit4:junit4] 2> 383299 T1012 C131 P22007 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22001/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[u!46 (1438094103208263680)]} 0 4
[junit4:junit4] 2> 383300 T996 C133 P22001 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!46]} 0 7
[junit4:junit4] 2> 383302 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[v!47 (1438094103215603712)]} 0 0
[junit4:junit4] 2> 383310 T1024 C134 P22011 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22001/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[v!47 (1438094103220846592)]} 0 0
[junit4:junit4] 2> 383311 T994 C133 P22001 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22007/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[v!47 (1438094103220846592)]} 0 4
[junit4:junit4] 2> 383312 T1010 C131 P22007 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[v!47]} 0 7
[junit4:junit4] 2> 383314 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[w!48 (1438094103228186624)]} 0 0
[junit4:junit4] 2> 383320 T1024 C134 P22011 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22001/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[w!48 (1438094103231332352)]} 0 0
[junit4:junit4] 2> 383321 T996 C133 P22001 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[w!48 (1438094103231332352)]} 0 4
[junit4:junit4] 2> 383324 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[x!49 (1438094103238672384)]} 0 0
[junit4:junit4] 2> 383330 T1039 C130 P22015 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22007/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[x!49 (1438094103241818112)]} 0 0
[junit4:junit4] 2> 383331 T1010 C131 P22007 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[x!49 (1438094103241818112)]} 0 4
[junit4:junit4] 2> 383334 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[y!50 (1438094103249158144)]} 0 0
[junit4:junit4] 2> 383342 T1039 C130 P22015 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22007/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[y!50 (1438094103254401024)]} 0 0
[junit4:junit4] 2> 383343 T1012 C131 P22007 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22001/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[y!50 (1438094103254401024)]} 0 4
[junit4:junit4] 2> 383344 T996 C133 P22001 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[y!50]} 0 7
[junit4:junit4] 2> 383347 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[z!51 (1438094103262789632)]} 0 0
[junit4:junit4] 2> 383355 T1024 C134 P22011 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22001/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[z!51 (1438094103268032512)]} 0 0
[junit4:junit4] 2> 383356 T994 C133 P22001 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22007/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[z!51 (1438094103268032512)]} 0 4
[junit4:junit4] 2> 383357 T1010 C131 P22007 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[z!51]} 0 7
[junit4:junit4] 2> 383359 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!52 (1438094103275372544)]} 0 0
[junit4:junit4] 2> 383367 T1039 C130 P22015 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22007/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!52 (1438094103280615424)]} 0 0
[junit4:junit4] 2> 383368 T1012 C131 P22007 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22001/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[a!52 (1438094103280615424)]} 0 4
[junit4:junit4] 2> 383369 T996 C133 P22001 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!52]} 0 7
[junit4:junit4] 2> 383371 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!53 (1438094103287955456)]} 0 0
[junit4:junit4] 2> 383379 T1024 C134 P22011 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22001/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!53 (1438094103293198336)]} 0 0
[junit4:junit4] 2> 383380 T994 C133 P22001 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22007/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[b!53 (1438094103293198336)]} 0 4
[junit4:junit4] 2> 383381 T1010 C131 P22007 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!53]} 0 7
[junit4:junit4] 2> 383383 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!54 (1438094103300538368)]} 0 0
[junit4:junit4] 2> 383389 T1024 C134 P22011 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22001/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!54 (1438094103303684096)]} 0 0
[junit4:junit4] 2> 383390 T996 C133 P22001 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!54 (1438094103303684096)]} 0 4
[junit4:junit4] 2> 383393 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!55 (1438094103311024128)]} 0 0
[junit4:junit4] 2> 383401 T1039 C130 P22015 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22007/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!55 (1438094103316267008)]} 0 0
[junit4:junit4] 2> 383402 T1012 C131 P22007 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22001/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[d!55 (1438094103316267008)]} 0 4
[junit4:junit4] 2> 383403 T996 C133 P22001 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!55]} 0 7
[junit4:junit4] 2> 383407 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!56 (1438094103324655616)]} 0 1
[junit4:junit4] 2> 383412 T1039 C130 P22015 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22007/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!56 (1438094103327801344)]} 0 0
[junit4:junit4] 2> 383413 T1010 C131 P22007 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!56 (1438094103327801344)]} 0 4
[junit4:junit4] 2> 383416 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!57 (1438094103335141376)]} 0 0
[junit4:junit4] 2> 383424 T1039 C130 P22015 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22007/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!57 (1438094103340384256)]} 0 0
[junit4:junit4] 2> 383425 T1012 C131 P22007 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22001/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[f!57 (1438094103340384256)]} 0 4
[junit4:junit4] 2> 383426 T996 C133 P22001 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!57]} 0 7
[junit4:junit4] 2> 383428 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!58 (1438094103347724288)]} 0 0
[junit4:junit4] 2> 383436 T1024 C134 P22011 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22001/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!58 (1438094103352967168)]} 0 0
[junit4:junit4] 2> 383437 T994 C133 P22001 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22007/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[g!58 (1438094103352967168)]} 0 4
[junit4:junit4] 2> 383438 T1010 C131 P22007 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!58]} 0 7
[junit4:junit4] 2> 383440 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!59 (1438094103360307200)]} 0 0
[junit4:junit4] 2> 383448 T1024 C134 P22011 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22001/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!59 (1438094103365550080)]} 0 0
[junit4:junit4] 2> 383449 T994 C133 P22001 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22007/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[h!59 (1438094103365550080)]} 0 4
[junit4:junit4] 2> 383450 T1010 C131 P22007 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!59]} 0 7
[junit4:junit4] 2> 383453 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!60 (1438094103373938688)]} 0 0
[junit4:junit4] 2> 383461 T1024 C134 P22011 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22001/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!60 (1438094103379181568)]} 0 0
[junit4:junit4] 2> 383462 T994 C133 P22001 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22007/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[i!60 (1438094103379181568)]} 0 4
[junit4:junit4] 2> 383463 T1010 C131 P22007 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!60]} 0 7
[junit4:junit4] 2> 383466 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!61 (1438094103387570176)]} 0 0
[junit4:junit4] 2> 383474 T1024 C134 P22011 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22001/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!61 (1438094103392813056)]} 0 0
[junit4:junit4] 2> 383475 T994 C133 P22001 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:22007/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[j!61 (1438094103392813056)]} 0 4
[junit4:junit4] 2> 383476 T1010 C131 P22007 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!61]} 0 7
[junit4:junit4] 2> 383478 T970 C132 P58032 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params=
[...truncated too long message...]
We have been closed, won't attempt to sync replicas back to leader
[junit4:junit4] 2> 1195937 T1573 oasc.ShardLeaderElectionContext.runLeaderProcess Sync was not a success but no one else is active! I am the leader
[junit4:junit4] 2> 1195937 T1573 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:18230/collection1/
[junit4:junit4] 2> 1195937 T1573 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@19b5e040
[junit4:junit4] 2> 1195938 T1573 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=4,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=642,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0}
[junit4:junit4] 2> 1195939 T1573 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 1195939 T1573 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 1195939 T1573 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 1195943 T1573 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 1195943 T1573 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 1195943 T1573 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371473964297/jetty4/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371473964297/jetty4/index;done=false>>]
[junit4:junit4] 2> 1195944 T1573 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371473964297/jetty4/index
[junit4:junit4] 2> 1195944 T1573 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371473964297/jetty4 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371473964297/jetty4;done=false>>]
[junit4:junit4] 2> 1195944 T1573 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371473964297/jetty4
[junit4:junit4] 2> 1195945 T1573 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 1195945 T1573 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard2/election/89880917724692492-5-n_0000000001
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4] 2> at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:152)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:149)
[junit4:junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:149)
[junit4:junit4] 2> at org.apache.solr.cloud.ElectionContext.cancelElection(ElectionContext.java:63)
[junit4:junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:260)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:156)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:100)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4] 2>
[junit4:junit4] 2> 1195946 T1573 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 1195946 T1573 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1195946 T1573 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 1195946 T1573 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1195947 T1573 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 1195947 T1573 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:235)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:232)
[junit4:junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:232)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:84)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4] 2>
[junit4:junit4] 2> NOTE: test params are: codec=Lucene42: {id=PostingsFormat(name=Memory doPackFST= false), _version_=PostingsFormat(name=Memory doPackFST= true), n_ti=PostingsFormat(name=Memory doPackFST= true)}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=es_MX, timezone=America/Noronha
[junit4:junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_21 (64-bit)/cpus=16,threads=3,free=253171408,total=520093696
[junit4:junit4] 2> NOTE: All tests run in this JVM: [BasicFunctionalityTest, TestArbitraryIndexDir, ClusterStateTest, QueryResultKeyTest, TestCSVResponseWriter, TestFastLRUCache, CoreAdminHandlerTest, TestIndexingPerformance, TestReversedWildcardFilterFactory, TestJoin, ReturnFieldsTest, TestSweetSpotSimilarityFactory, SyncSliceTest, CircularListTest, TestRemoteStreaming, SimpleFacetsTest, TestFieldTypeCollectionResource, HardAutoCommitTest, TestCopyFieldCollectionResource, ResourceLoaderTest, FullSolrCloudDistribCmdsTest, DateFieldTest, ConvertedLegacyTest, PolyFieldTest, TestNumberUtils, ResponseLogComponentTest, PluginInfoTest, ZkControllerTest, DefaultValueUpdateProcessorTest, TestSolrCoreProperties, PrimitiveFieldTypeTest, TestOmitPositions, DocValuesTest, SpellCheckCollatorTest, TestDistributedSearch, TestBM25SimilarityFactory, TestPartialUpdateDeduplication, RequestHandlersTest, DistributedTermsComponentTest, SortByFunctionTest, TestFuzzyAnalyzedSuggestions, ZkNodePropsTest, SolrCoreTest, XsltUpdateRequestHandlerTest, TestStressVersions, TestReloadAndDeleteDocs, CurrencyFieldOpenExchangeTest, TestIBSimilarityFactory, TestSolrQueryParserResource, TestSerializedLuceneMatchVersion, ShowFileRequestHandlerTest, TestFieldTypeResource, TestManagedSchema, TestRandomFaceting, SignatureUpdateProcessorFactoryTest, TestPropInject, TestSolrIndexConfig, TestDocumentBuilder, LegacyHTMLStripCharFilterTest, IndexSchemaTest, MoreLikeThisHandlerTest, SuggesterTest, TestWordDelimiterFilterFactory, LoggingHandlerTest, TestStressLucene, FieldMutatingUpdateProcessorTest, TestRTGBase, CachingDirectoryFactoryTest, TermVectorComponentDistributedTest, TestSolrQueryParser, TestAddFieldRealTimeGet, SolrIndexConfigTest, BasicZkTest, ChaosMonkeyShardSplitTest]
[junit4:junit4] Completed on J0 in 259.82s, 1 test, 1 error <<< FAILURES!
[...truncated 475 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:392: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:372: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build.xml:181: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/common-build.xml:437: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:1246: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:890: There were test failures: 298 suites, 1252 tests, 2 errors, 13 ignored (7 assumptions)
Total time: 52 minutes 28 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-Tests-4.x-Java7 - Build # 1337 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java7/1337/
1 tests failed.
REGRESSION: org.apache.solr.cloud.ChaosMonkeyShardSplitTest.testDistribSearch
Error Message:
Server at http://127.0.0.1:64668/ky/n returned non ok status:500, message:Server Error
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:64668/ky/n returned non ok status:500, message:Server Error
at __randomizedtesting.SeedInfo.seed([20316DBA580EBD96:A1D7E3A22F51DDAA]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:228)
at org.apache.solr.cloud.ChaosMonkeyShardSplitTest.doTest(ChaosMonkeyShardSplitTest.java:136)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9651 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.ChaosMonkeyShardSplitTest
[junit4:junit4] 2> 1145058 T3563 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /ky/n
[junit4:junit4] 2> 1145065 T3563 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solrtest-ChaosMonkeyShardSplitTest-1371428176424
[junit4:junit4] 2> 1145067 T3563 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 1145067 T3564 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 1145168 T3563 oasc.ZkTestServer.run start zk server on port:57760
[junit4:junit4] 2> 1145169 T3563 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1145199 T3570 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@253cb7ec name:ZooKeeperConnection Watcher:127.0.0.1:57760 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1145200 T3563 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1145201 T3563 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 1145213 T3563 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1145215 T3572 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@19ebd491 name:ZooKeeperConnection Watcher:127.0.0.1:57760/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1145216 T3563 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1145216 T3563 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 1145226 T3563 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 1145229 T3563 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 1145231 T3563 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 1145239 T3563 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 1145240 T3563 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 1145253 T3563 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 1145254 T3563 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 1145357 T3563 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 1145358 T3563 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 1145367 T3563 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 1145368 T3563 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 1145371 T3563 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 1145372 T3563 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 1145374 T3563 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 1145375 T3563 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 1145382 T3563 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 1145383 T3563 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 1145386 T3563 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 1145387 T3563 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 1145390 T3563 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 1145390 T3563 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 1145662 T3563 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1145667 T3563 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:46129
[junit4:junit4] 2> 1145668 T3563 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1145668 T3563 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1145669 T3563 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1371428176759
[junit4:junit4] 2> 1145669 T3563 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1371428176759/solr.xml
[junit4:junit4] 2> 1145670 T3563 oasc.CoreContainer.<init> New CoreContainer 60026798
[junit4:junit4] 2> 1145671 T3563 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1371428176759/'
[junit4:junit4] 2> 1145671 T3563 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1371428176759/'
[junit4:junit4] 2> 1145800 T3563 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1145801 T3563 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1145802 T3563 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1145802 T3563 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1145803 T3563 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1145804 T3563 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1145804 T3563 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1145805 T3563 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1145805 T3563 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1145806 T3563 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1145823 T3563 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1145824 T3563 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:57760/solr
[junit4:junit4] 2> 1145824 T3563 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1145825 T3563 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1145828 T3583 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@42ab60d9 name:ZooKeeperConnection Watcher:127.0.0.1:57760 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1145829 T3563 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1145831 T3563 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1145843 T3563 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1145845 T3585 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4c79b8da name:ZooKeeperConnection Watcher:127.0.0.1:57760/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1145846 T3563 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1145847 T3563 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 1145857 T3563 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 1145860 T3563 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 1145867 T3563 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46129_ky%2Fn
[junit4:junit4] 2> 1145869 T3563 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:46129_ky%2Fn
[junit4:junit4] 2> 1145876 T3563 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 1145890 T3563 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 1145897 T3563 oasc.Overseer.start Overseer (id=89877916970582019-127.0.0.1:46129_ky%2Fn-n_0000000000) starting
[junit4:junit4] 2> 1145902 T3563 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 1145915 T3587 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 1145915 T3563 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 1145917 T3563 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 1145924 T3563 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1145927 T3586 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 1145931 T3588 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1145931 T3588 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1147429 T3586 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1147430 T3586 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:46129_ky%2Fn",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:46129/ky/n"}
[junit4:junit4] 2> 1147430 T3586 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 1147430 T3586 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 1147448 T3585 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1147934 T3588 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1371428176759/collection1
[junit4:junit4] 2> 1147934 T3588 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 1147935 T3588 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1147935 T3588 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 1147937 T3588 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1371428176759/collection1/'
[junit4:junit4] 2> 1147938 T3588 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1371428176759/collection1/lib/README' to classloader
[junit4:junit4] 2> 1147939 T3588 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1371428176759/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1147992 T3588 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 1148054 T3588 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1148155 T3588 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1148161 T3588 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1148756 T3588 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1148760 T3588 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1148763 T3588 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1148768 T3588 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1148791 T3588 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1148792 T3588 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1371428176759/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371428176423/control/data/
[junit4:junit4] 2> 1148792 T3588 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@55e74f8b
[junit4:junit4] 2> 1148793 T3588 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1148793 T3588 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371428176423/control/data
[junit4:junit4] 2> 1148794 T3588 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371428176423/control/data/index/
[junit4:junit4] 2> 1148794 T3588 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371428176423/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1148794 T3588 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371428176423/control/data/index
[junit4:junit4] 2> 1148799 T3588 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5d3b6699 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6e1a1976),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1148800 T3588 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1148803 T3588 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1148803 T3588 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1148804 T3588 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1148804 T3588 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1148805 T3588 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1148805 T3588 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1148806 T3588 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1148806 T3588 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1148807 T3588 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1148823 T3588 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1148830 T3588 oass.SolrIndexSearcher.<init> Opening Searcher@3ed8a4ec main
[junit4:junit4] 2> 1148831 T3588 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371428176423/control/data/tlog
[junit4:junit4] 2> 1148832 T3588 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1148832 T3588 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1148836 T3589 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3ed8a4ec main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1148838 T3588 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1148838 T3588 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:46129/ky/n collection:control_collection shard:shard1
[junit4:junit4] 2> 1148839 T3588 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 1148860 T3588 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 1148863 T3588 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 1148863 T3588 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 1148863 T3588 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:46129/ky/n/collection1/
[junit4:junit4] 2> 1148864 T3588 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 1148864 T3588 oasc.SyncStrategy.syncToMe http://127.0.0.1:46129/ky/n/collection1/ has no replicas
[junit4:junit4] 2> 1148864 T3588 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:46129/ky/n/collection1/
[junit4:junit4] 2> 1148864 T3588 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 1148952 T3586 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1148967 T3585 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1148971 T3588 oasc.ZkController.register We are http://127.0.0.1:46129/ky/n/collection1/ and leader is http://127.0.0.1:46129/ky/n/collection1/
[junit4:junit4] 2> 1148971 T3588 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:46129/ky/n
[junit4:junit4] 2> 1148971 T3588 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 1148971 T3588 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1148972 T3588 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1148973 T3588 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1148974 T3563 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 1148975 T3563 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1148976 T3563 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1148993 T3563 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 1148995 T3563 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1148997 T3592 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7007e426 name:ZooKeeperConnection Watcher:127.0.0.1:57760/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1148997 T3563 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1148998 T3563 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1149000 T3563 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 1149270 T3563 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1149274 T3563 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:64668
[junit4:junit4] 2> 1149275 T3563 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1149275 T3563 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1149276 T3563 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1371428180358
[junit4:junit4] 2> 1149276 T3563 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1371428180358/solr.xml
[junit4:junit4] 2> 1149277 T3563 oasc.CoreContainer.<init> New CoreContainer 1540084351
[junit4:junit4] 2> 1149277 T3563 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1371428180358/'
[junit4:junit4] 2> 1149278 T3563 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1371428180358/'
[junit4:junit4] 2> 1149413 T3563 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1149414 T3563 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1149415 T3563 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1149415 T3563 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1149416 T3563 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1149416 T3563 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1149417 T3563 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1149417 T3563 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1149418 T3563 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1149418 T3563 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1149436 T3563 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1149436 T3563 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:57760/solr
[junit4:junit4] 2> 1149437 T3563 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1149438 T3563 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1149520 T3603 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@10972918 name:ZooKeeperConnection Watcher:127.0.0.1:57760 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1149521 T3563 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1149523 T3563 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1149536 T3563 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1149538 T3605 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@409371bd name:ZooKeeperConnection Watcher:127.0.0.1:57760/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1149538 T3563 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1149597 T3563 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1150471 T3586 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1150472 T3586 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:46129_ky%2Fn",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:46129/ky/n"}
[junit4:junit4] 2> 1150494 T3585 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1150494 T3592 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1150494 T3605 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1150600 T3563 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:64668_ky%2Fn
[junit4:junit4] 2> 1150602 T3563 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:64668_ky%2Fn
[junit4:junit4] 2> 1150604 T3605 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1150604 T3585 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1150604 T3592 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1150605 T3585 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1150605 T3592 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1150605 T3605 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1150619 T3606 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1150619 T3606 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1151998 T3586 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1151999 T3586 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:64668_ky%2Fn",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:64668/ky/n"}
[junit4:junit4] 2> 1151999 T3586 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 1151999 T3586 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 1152015 T3585 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1152015 T3592 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1152015 T3605 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1152623 T3606 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1371428180358/collection1
[junit4:junit4] 2> 1152623 T3606 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1152624 T3606 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1152624 T3606 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1152626 T3606 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1371428180358/collection1/'
[junit4:junit4] 2> 1152627 T3606 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1371428180358/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1152628 T3606 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1371428180358/collection1/lib/README' to classloader
[junit4:junit4] 2> 1152681 T3606 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 1152743 T3606 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1152844 T3606 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1152850 T3606 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1153443 T3606 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1153447 T3606 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1153450 T3606 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1153455 T3606 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1153478 T3606 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1153479 T3606 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1371428180358/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371428176423/jetty1/
[junit4:junit4] 2> 1153479 T3606 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@55e74f8b
[junit4:junit4] 2> 1153480 T3606 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1153480 T3606 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371428176423/jetty1
[junit4:junit4] 2> 1153481 T3606 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371428176423/jetty1/index/
[junit4:junit4] 2> 1153481 T3606 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371428176423/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1153481 T3606 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371428176423/jetty1/index
[junit4:junit4] 2> 1153485 T3606 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@73009218 lockFactory=org.apache.lucene.store.NativeFSLockFactory@23b16a07),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1153486 T3606 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1153489 T3606 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1153489 T3606 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1153490 T3606 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1153491 T3606 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1153491 T3606 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1153492 T3606 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1153492 T3606 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1153493 T3606 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1153493 T3606 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1153510 T3606 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1153517 T3606 oass.SolrIndexSearcher.<init> Opening Searcher@36d8a785 main
[junit4:junit4] 2> 1153518 T3606 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371428176423/jetty1/tlog
[junit4:junit4] 2> 1153519 T3606 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1153519 T3606 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1153523 T3607 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@36d8a785 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1153526 T3606 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1153526 T3606 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:64668/ky/n collection:collection1 shard:shard1
[junit4:junit4] 2> 1153527 T3606 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 1153549 T3606 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 1153559 T3606 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 1153559 T3606 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 1153560 T3606 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:64668/ky/n/collection1/
[junit4:junit4] 2> 1153560 T3606 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 1153560 T3606 oasc.SyncStrategy.syncToMe http://127.0.0.1:64668/ky/n/collection1/ has no replicas
[junit4:junit4] 2> 1153561 T3606 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:64668/ky/n/collection1/
[junit4:junit4] 2> 1153561 T3606 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 1155020 T3586 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1155040 T3585 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1155040 T3605 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1155040 T3592 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1155097 T3606 oasc.ZkController.register We are http://127.0.0.1:64668/ky/n/collection1/ and leader is http://127.0.0.1:64668/ky/n/collection1/
[junit4:junit4] 2> 1155097 T3606 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:64668/ky/n
[junit4:junit4] 2> 1155097 T3606 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 1155097 T3606 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1155098 T3606 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1155099 T3606 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1155100 T3563 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 1155101 T3563 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1155102 T3563 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1155380 T3563 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1155384 T3563 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:34213
[junit4:junit4] 2> 1155384 T3563 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1155385 T3563 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1155386 T3563 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1371428186475
[junit4:junit4] 2> 1155386 T3563 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1371428186475/solr.xml
[junit4:junit4] 2> 1155387 T3563 oasc.CoreContainer.<init> New CoreContainer 1429716235
[junit4:junit4] 2> 1155387 T3563 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1371428186475/'
[junit4:junit4] 2> 1155388 T3563 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1371428186475/'
[junit4:junit4] 2> 1155517 T3563 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1155518 T3563 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1155519 T3563 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1155519 T3563 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1155520 T3563 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1155520 T3563 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1155521 T3563 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1155521 T3563 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1155522 T3563 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1155523 T3563 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1155538 T3563 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1155539 T3563 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:57760/solr
[junit4:junit4] 2> 1155539 T3563 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1155540 T3563 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1155543 T3619 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@130dd2f9 name:ZooKeeperConnection Watcher:127.0.0.1:57760 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1155544 T3563 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1155558 T3563 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1155568 T3563 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1155571 T3621 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@572dc3b2 name:ZooKeeperConnection Watcher:127.0.0.1:57760/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1155571 T3563 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1155583 T3563 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1156553 T3586 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1156554 T3586 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:64668_ky%2Fn",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:64668/ky/n"}
[junit4:junit4] 2> 1156569 T3585 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1156569 T3605 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1156569 T3621 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1156569 T3592 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1156586 T3563 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34213_ky%2Fn
[junit4:junit4] 2> 1156588 T3563 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:34213_ky%2Fn
[junit4:junit4] 2> 1156590 T3605 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1156590 T3621 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1156590 T3592 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1156590 T3585 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1156591 T3592 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1156591 T3605 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1156591 T3585 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1156599 T3621 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1156605 T3622 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1156605 T3622 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1158073 T3586 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1158074 T3586 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:34213_ky%2Fn",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:34213/ky/n"}
[junit4:junit4] 2> 1158074 T3586 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 1158074 T3586 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 1158091 T3585 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1158091 T3592 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1158091 T3605 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1158091 T3621 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1158609 T3622 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1371428186475/collection1
[junit4:junit4] 2> 1158609 T3622 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1158610 T3622 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1158610 T3622 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1158612 T3622 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1371428186475/collection1/'
[junit4:junit4] 2> 1158613 T3622 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1371428186475/collection1/lib/README' to classloader
[junit4:junit4] 2> 1158614 T3622 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1371428186475/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1158668 T3622 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 1158729 T3622 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1158830 T3622 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1158836 T3622 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1159411 T3622 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1159415 T3622 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1159418 T3622 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1159423 T3622 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1159468 T3622 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1159468 T3622 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1371428186475/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371428176423/jetty2/
[junit4:junit4] 2> 1159469 T3622 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@55e74f8b
[junit4:junit4] 2> 1159469 T3622 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1159470 T3622 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371428176423/jetty2
[junit4:junit4] 2> 1159471 T3622 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371428176423/jetty2/index/
[junit4:junit4] 2> 1159471 T3622 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371428176423/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1159471 T3622 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371428176423/jetty2/index
[junit4:junit4] 2> 1159475 T3622 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@68907a96 lockFactory=org.apache.lucene.store.NativeFSLockFactory@651118d9),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1159476 T3622 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1159479 T3622 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1159479 T3622 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1159480 T3622 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1159481 T3622 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1159482 T3622 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1159482 T3622 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1159482 T3622 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1159483 T3622 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1159483 T3622 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1159500 T3622 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1159507 T3622 oass.SolrIndexSearcher.<init> Opening Searcher@388e4310 main
[junit4:junit4] 2> 1159508 T3622 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371428176423/jetty2/tlog
[junit4:junit4] 2> 1159509 T3622 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1159509 T3622 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1159514 T3623 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@388e4310 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1159516 T3622 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1159516 T3622 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:34213/ky/n collection:collection1 shard:shard2
[junit4:junit4] 2> 1159517 T3622 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 1159577 T3622 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 1159604 T3622 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 1159604 T3622 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 1159604 T3622 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:34213/ky/n/collection1/
[junit4:junit4] 2> 1159605 T3622 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 1159605 T3622 oasc.SyncStrategy.syncToMe http://127.0.0.1:34213/ky/n/collection1/ has no replicas
[junit4:junit4] 2> 1159605 T3622 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:34213/ky/n/collection1/
[junit4:junit4] 2> 1159606 T3622 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 1161106 T3586 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1161126 T3585 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1161126 T3592 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1161126 T3605 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1161126 T3621 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1161175 T3622 oasc.ZkController.register We are http://127.0.0.1:34213/ky/n/collection1/ and leader is http://127.0.0.1:34213/ky/n/collection1/
[junit4:junit4] 2> 1161175 T3622 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:34213/ky/n
[junit4:junit4] 2> 1161175 T3622 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 1161176 T3622 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1161176 T3622 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1161177 T3622 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1161179 T3563 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 1161179 T3563 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1161180 T3563 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1161457 T3563 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1161461 T3563 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:25027
[junit4:junit4] 2> 1161462 T3563 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1161462 T3563 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1161463 T3563 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1371428192555
[junit4:junit4] 2> 1161463 T3563 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1371428192555/solr.xml
[junit4:junit4] 2> 1161464 T3563 oasc.CoreContainer.<init> New CoreContainer 1540043809
[junit4:junit4] 2> 1161465 T3563 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1371428192555/'
[junit4:junit4] 2> 1161465 T3563 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1371428192555/'
[junit4:junit4] 2> 1161594 T3563 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1161595 T3563 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1161596 T3563 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1161597 T3563 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1161597 T3563 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1161598 T3563 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1161598 T3563 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1161599 T3563 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1161599 T3563 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1161600 T3563 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1161617 T3563 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1161618 T3563 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:57760/solr
[junit4:junit4] 2> 1161618 T3563 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1161619 T3563 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1161622 T3635 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2fc673e8 name:ZooKeeperConnection Watcher:127.0.0.1:57760 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1161623 T3563 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1161638 T3563 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1161649 T3563 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1161651 T3637 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@22e8f92f name:ZooKeeperConnection Watcher:127.0.0.1:57760/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1161652 T3563 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1161663 T3563 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1162630 T3586 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1162631 T3586 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:34213_ky%2Fn",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:34213/ky/n"}
[junit4:junit4] 2> 1162647 T3585 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1162647 T3621 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1162647 T3637 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1162647 T3592 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1162647 T3605 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1162666 T3563 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:25027_ky%2Fn
[junit4:junit4] 2> 1162668 T3563 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:25027_ky%2Fn
[junit4:junit4] 2> 1162670 T3605 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1162670 T3621 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1162670 T3592 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1162670 T3637 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1162670 T3585 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1162671 T3605 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1162671 T3585 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1162671 T3637 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1162671 T3592 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1162679 T3621 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1162685 T3638 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1162685 T3638 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1164150 T3586 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1164151 T3586 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:25027_ky%2Fn",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:25027/ky/n"}
[junit4:junit4] 2> 1164151 T3586 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 1164151 T3586 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 1164166 T3605 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1164166 T3621 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1164166 T3592 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1164166 T3585 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1164166 T3637 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1164689 T3638 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1371428192555/collection1
[junit4:junit4] 2> 1164689 T3638 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1164690 T3638 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1164690 T3638 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1164692 T3638 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1371428192555/collection1/'
[junit4:junit4] 2> 1164693 T3638 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1371428192555/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1164694 T3638 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1371428192555/collection1/lib/README' to classloader
[junit4:junit4] 2> 1164747 T3638 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 1164809 T3638 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1164910 T3638 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1164915 T3638 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1165486 T3638 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1165491 T3638 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1165493 T3638 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1165498 T3638 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1165520 T3638 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1165520 T3638 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1371428192555/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371428176423/jetty3/
[junit4:junit4] 2> 1165520 T3638 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@55e74f8b
[junit4:junit4] 2> 1165521 T3638 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1165522 T3638 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371428176423/jetty3
[junit4:junit4] 2> 1165522 T3638 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371428176423/jetty3/index/
[junit4:junit4] 2> 1165522 T3638 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371428176423/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1165523 T3638 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371428176423/jetty3/index
[junit4:junit4] 2> 1165527 T3638 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1eb42d4f lockFactory=org.apache.lucene.store.NativeFSLockFactory@2fd7ad01),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1165527 T3638 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1165530 T3638 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1165531 T3638 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1165531 T3638 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1165532 T3638 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1165533 T3638 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1165533 T3638 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1165533 T3638 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1165534 T3638 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1165535 T3638 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1165550 T3638 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1165557 T3638 oass.SolrIndexSearcher.<init> Opening Searcher@fe9c93a main
[junit4:junit4] 2> 1165557 T3638 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371428176423/jetty3/tlog
[junit4:junit4] 2> 1165558 T3638 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1165559 T3638 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1165563 T3639 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@fe9c93a main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1165565 T3638 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1165566 T3638 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:25027/ky/n collection:collection1 shard:shard1
[junit4:junit4] 2> 1165568 T3638 oasc.ZkController.register We are http://127.0.0.1:25027/ky/n/collection1/ and leader is http://127.0.0.1:64668/ky/n/collection1/
[junit4:junit4] 2> 1165569 T3638 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:25027/ky/n
[junit4:junit4] 2> 1165569 T3638 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 1165569 T3638 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C871 name=collection1 org.apache.solr.core.SolrCore@7f2262aa url=http://127.0.0.1:25027/ky/n/collection1 node=127.0.0.1:25027_ky%2Fn C871_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:25027_ky%2Fn, base_url=http://127.0.0.1:25027/ky/n}
[junit4:junit4] 2> 1165570 T3640 C871 P25027 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 1165570 T3638 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1165570 T3640 C871 P25027 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 1165570 T3640 C871 P25027 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 1165571 T3640 C871 P25027 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1165571 T3563 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 1165572 T3563 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1165572 T3640 C871 P25027 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1165572 T3563 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1165593 T3595 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 1165670 T3586 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1165671 T3586 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:25027_ky%2Fn",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:25027/ky/n"}
[junit4:junit4] 2> 1165691 T3585 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1165691 T3592 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1165691 T3637 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1165691 T3621 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1165691 T3605 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1165864 T3563 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1165867 T3563 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:43304
[junit4:junit4] 2> 1165868 T3563 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1165868 T3563 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1165869 T3563 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1371428196949
[junit4:junit4] 2> 1165870 T3563 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1371428196949/solr.xml
[junit4:junit4] 2> 1165870 T3563 oasc.CoreContainer.<init> New CoreContainer 1649972019
[junit4:junit4] 2> 1165871 T3563 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1371428196949/'
[junit4:junit4] 2> 1165871 T3563 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1371428196949/'
[junit4:junit4] 2> 1166001 T3563 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1166002 T3563 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1166002 T3563 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1166003 T3563 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1166003 T3563 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1166004 T3563 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1166004 T3563 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1166005 T3563 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1166005 T3563 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1166006 T3563 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1166023 T3563 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1166024 T3563 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:57760/solr
[junit4:junit4] 2> 1166024 T3563 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1166025 T3563 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1166028 T3652 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@60f0c544 name:ZooKeeperConnection Watcher:127.0.0.1:57760 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1166029 T3563 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1166046 T3563 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1166057 T3563 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1166059 T3654 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@211ac8d7 name:ZooKeeperConnection Watcher:127.0.0.1:57760/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1166059 T3563 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1166071 T3563 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1166594 T3595 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 1166594 T3595 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=4&state=recovering&nodeName=127.0.0.1:25027_ky%252Fn&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1001
[junit4:junit4] 2> 1167074 T3563 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43304_ky%2Fn
[junit4:junit4] 2> 1167077 T3563 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:43304_ky%2Fn
[junit4:junit4] 2> 1167079 T3605 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1167079 T3621 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1167079 T3592 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1167079 T3654 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1167079 T3585 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1167079 T3637 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1167080 T3585 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1167080 T3605 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1167080 T3592 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1167080 T3637 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1167091 T3621 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1167096 T3655 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1167096 T3655 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1167195 T3586 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1167195 T3586 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:43304_ky%2Fn",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:43304/ky/n"}
[junit4:junit4] 2> 1167196 T3586 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 1167196 T3586 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 1167208 T3605 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1167208 T3621 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1167208 T3654 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1167208 T3585 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1167208 T3592 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1167208 T3637 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1168099 T3655 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1371428196949/collection1
[junit4:junit4] 2> 1168099 T3655 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1168100 T3655 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1168100 T3655 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1168102 T3655 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1371428196949/collection1/'
[junit4:junit4] 2> 1168103 T3655 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1371428196949/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1168104 T3655 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1371428196949/collection1/lib/README' to classloader
[junit4:junit4] 2> 1168181 T3655 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 1168243 T3655 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1168344 T3655 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1168350 T3655 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> ASYNC NEW_CORE C872 name=collection1 org.apache.solr.core.SolrCore@7f2262aa url=http://127.0.0.1:25027/ky/n/collection1 node=127.0.0.1:25027_ky%2Fn C872_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:25027_ky%2Fn, base_url=http://127.0.0.1:25027/ky/n}
[junit4:junit4] 2> 1168596 T3640 C872 P25027 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:64668/ky/n/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 1168596 T3640 C872 P25027 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:25027/ky/n START replicas=[http://127.0.0.1:64668/ky/n/collection1/] nUpdates=100
[junit4:junit4] 2> 1168597 T3640 C872 P25027 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 1168597 T3640 C872 P25027 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 1168597 T3640 C872 P25027 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 1168597 T3640 C872 P25027 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 1168598 T3640 C872 P25027 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 1168598 T3640 C872 P25027 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:64668/ky/n/collection1/. core=collection1
[junit4:junit4] 2> 1168598 T3640 C872 P25027 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C873 name=collection1 org.apache.solr.core.SolrCore@6e1daf64 url=http://127.0.0.1:64668/ky/n/collection1 node=127.0.0.1:64668_ky%2Fn C873_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:64668_ky%2Fn, base_url=http://127.0.0.1:64668/ky/n, leader=true}
[junit4:junit4] 2> 1168606 T3596 C873 P64668 oasc.SolrCore.execute [collection1] webapp=/ky/n path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 1168610 T3597 C873 P64668 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1168613 T3597 C873 P64668 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@73009218 lockFactory=org.apache.lucene.store.NativeFSLockFactory@23b16a07),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1168613 T3597 C873 P64668 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1168614 T3597 C873 P64668 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@73009218 lockFactory=org.apache.lucene.store.NativeFSLockFactory@23b16a07),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@73009218 lockFactory=org.apache.lucene.store.NativeFSLockFactory@23b16a07),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1168614 T3597 C873 P64668 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1168615 T3597 C873 P64668 oass.SolrIndexSearcher.<init> Opening Searcher@4948ec57 realtime
[junit4:junit4] 2> 1168615 T3597 C873 P64668 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1168616 T3597 C873 P64668 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 1168617 T3640 C872 P25027 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1168617 T3640 C872 P25027 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 1168621 T3598 C873 P64668 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1168621 T3598 C873 P64668 oasc.SolrCore.execute [collection1] webapp=/ky/n path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=2
[junit4:junit4] 2> 1168622 T3640 C872 P25027 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 1168622 T3640 C872 P25027 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 1168622 T3640 C872 P25027 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 1168624 T3598 C873 P64668 oasc.SolrCore.execute [collection1] webapp=/ky/n path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 1168626 T3640 C872 P25027 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 1168626 T3640 C872 P25027 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371428176423/jetty3/index.20130616201639984
[junit4:junit4] 2> 1168627 T3640 C872 P25027 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@73c5451d lockFactory=org.apache.lucene.store.NativeFSLockFactory@4bdc25c9) fullCopy=false
[junit4:junit4] 2> 1168629 T3598 C873 P64668 oasc.SolrCore.execute [collection1] webapp=/ky/n path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 1168630 T3640 C872 P25027 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 1168631 T3640 C872 P25027 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 1168632 T3640 C872 P25027 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 1168634 T3640 C872 P25027 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1eb42d4f lockFactory=org.apache.lucene.store.NativeFSLockFactory@2fd7ad01),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1eb42d4f lockFactory=org.apache.lucene.store.NativeFSLockFactory@2fd7ad01),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1168634 T3640 C872 P25027 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1168635 T3640 C872 P25027 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 1168635 T3640 C872 P25027 oass.SolrIndexSearcher.<init> Opening Searcher@2a1b4428 main
[junit4:junit4] 2> 1168636 T3639 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2a1b4428 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1168637 T3640 C872 P25027 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371428176423/jetty3/index.20130616201639984 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371428176423/jetty3/index.20130616201639984;done=true>>]
[junit4:junit4] 2> 1168637 T3640 C872 P25027 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371428176423/jetty3/index.20130616201639984
[junit4:junit4] 2> 1168637 T3640 C872 P25027 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371428176423/jetty3/index.20130616201639984
[junit4:junit4] 2> 1168638 T3640 C872 P25027 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 1168638 T3640 C872 P25027 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 1168638 T3640 C872 P25027 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1168638 T3640 C872 P25027 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1168640 T3640 C872 P25027 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 1168713 T3586 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1168714 T3586 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:25027_ky%2Fn",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:25027/ky/n"}
[junit4:junit4] 2> 1168727 T3637 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1168727 T3592 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1168727 T3621 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1168727 T3654 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1168727 T3605 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1168727 T3585 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1168923 T3655 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1168928 T3655 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1168930 T3655 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1168935 T3655 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1168956 T3655 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1168957 T3655 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1371428196949/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371428176423/jetty4/
[junit4:junit4] 2> 1168957 T3655 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@55e74f8b
[junit4:junit4] 2> 1168957 T3655 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1168958 T3655 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371428176423/jetty4
[junit4:junit4] 2> 1168959 T3655 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371428176423/jetty4/index/
[junit4:junit4] 2> 1168959 T3655 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371428176423/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1168959 T3655 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371428176423/jetty4/index
[junit4:junit4] 2> 1168963 T3655 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@40d0b18c lockFactory=org.apache.lucene.store.NativeFSLockFactory@443e16b9),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1168963 T3655 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1168967 T3655 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1168967 T3655 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1168968 T3655 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1168969 T3655 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1168969 T3655 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1168970 T3655 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1168970 T3655 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1168971 T3655 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1168972 T3655 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1168988 T3655 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1168995 T3655 oass.SolrIndexSearcher.<init> Opening Searcher@2a86f836 main
[junit4:junit4] 2> 1168996 T3655 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371428176423/jetty4/tlog
[junit4:junit4] 2> 1168997 T3655 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1168997 T3655 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1169002 T3658 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2a86f836 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1169004 T3655 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1169004 T3655 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:43304/ky/n collection:collection1 shard:shard2
[junit4:junit4] 2> 1169007 T3655 oasc.ZkController.register We are http://127.0.0.1:43304/ky/n/collection1/ and leader is http://127.0.0.1:34213/ky/n/collection1/
[junit4:junit4] 2> 1169007 T3655 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:43304/ky/n
[junit4:junit4] 2> 1169007 T3655 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 1169008 T3655 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C874 name=collection1 org.apache.solr.core.SolrCore@50161b26 url=http://127.0.0.1:43304/ky/n/collection1 node=127.0.0.1:43304_ky%2Fn C874_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:43304_ky%2Fn, base_url=http://127.0.0.1:43304/ky/n}
[junit4:junit4] 2> 1169008 T3659 C874 P43304 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 1169008 T3655 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1169009 T3659 C874 P43304 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 1169009 T3659 C874 P43304 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 1169009 T3659 C874 P43304 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1169010 T3563 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 1169010 T3563 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1169010 T3659 C874 P43304 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1169011 T3563 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1169029 T3563 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1169030 T3611 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 1169030 T3563 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 2> 1169031 T3563 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 2> 1169031 T3563 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1170033 T3563 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1170231 T3586 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1170232 T3586 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:43304_ky%2Fn",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:43304/ky/n"}
[junit4:junit4] 2> 1170257 T3637 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1170257 T3605 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1170257 T3585 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1170257 T3621 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1170257 T3592 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1170257 T3654 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1171032 T3611 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 1171032 T3611 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=5&state=recovering&nodeName=127.0.0.1:43304_ky%252Fn&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2002
[junit4:junit4] 2> 1171035 T3563 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1172037 T3563 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C874_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:43304_ky%2Fn, base_url=http://127.0.0.1:43304/ky/n}
[junit4:junit4] 2> 1173034 T3659 C874 P43304 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:34213/ky/n/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 1173034 T3659 C874 P43304 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:43304/ky/n START replicas=[http://127.0.0.1:34213/ky/n/collection1/] nUpdates=100
[junit4:junit4] 2> 1173035 T3659 C874 P43304 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 1173035 T3659 C874 P43304 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 1173035 T3659 C874 P43304 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 1173035 T3659 C874 P43304 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 1173036 T3659 C874 P43304 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 1173036 T3659 C874 P43304 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:34213/ky/n/collection1/. core=collection1
[junit4:junit4] 2> 1173036 T3659 C874 P43304 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1173039 T3563 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> ASYNC NEW_CORE C875 name=collection1 org.apache.solr.core.SolrCore@2abefaf url=http://127.0.0.1:34213/ky/n/collection1 node=127.0.0.1:34213_ky%2Fn C875_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:34213_ky%2Fn, base_url=http://127.0.0.1:34213/ky/n, leader=true}
[junit4:junit4] 2> 1173043 T3612 C875 P34213 oasc.SolrCore.execute [collection1] webapp=/ky/n path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 1173047 T3613 C875 P34213 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1173050 T3613 C875 P34213 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@68907a96 lockFactory=org.apache.lucene.store.NativeFSLockFactory@651118d9),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1173050 T3613 C875 P34213 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1173051 T3613 C875 P34213 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@68907a96 lockFactory=org.apache.lucene.store.NativeFSLockFactory@651118d9),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@68907a96 lockFactory=org.apache.lucene.store.NativeFSLockFactory@651118d9),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1173051 T3613 C875 P34213 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1173052 T3613 C875 P34213 oass.SolrIndexSearcher.<init> Opening Searcher@5f734767 realtime
[junit4:junit4] 2> 1173052 T3613 C875 P34213 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1173053 T3613 C875 P34213 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> 1173054 T3659 C874 P43304 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1173054 T3659 C874 P43304 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 1173057 T3614 C875 P34213 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1173057 T3614 C875 P34213 oasc.SolrCore.execute [collection1] webapp=/ky/n path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=2
[junit4:junit4] 2> 1173058 T3659 C874 P43304 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 1173058 T3659 C874 P43304 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 1173058 T3659 C874 P43304 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 1173061 T3614 C875 P34213 oasc.SolrCore.execute [collection1] webapp=/ky/n path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 1173062 T3659 C874 P43304 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 1173063 T3659 C874 P43304 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371428176423/jetty4/index.20130616201644420
[junit4:junit4] 2> 1173063 T3659 C874 P43304 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@1a263436 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7bd2b6dc) fullCopy=false
[junit4:junit4] 2> 1173066 T3614 C875 P34213 oasc.SolrCore.execute [collection1] webapp=/ky/n path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 1173067 T3659 C874 P43304 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 1173068 T3659 C874 P43304 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 1173068 T3659 C874 P43304 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 1173070 T3659 C874 P43304 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@40d0b18c lockFactory=org.apache.lucene.store.NativeFSLockFactory@443e16b9),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@40d0b18c lockFactory=org.apache.lucene.store.NativeFSLockFactory@443e16b9),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1173070 T3659 C874 P43304 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1173071 T3659 C874 P43304 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 1173071 T3659 C874 P43304 oass.SolrIndexSearcher.<init> Opening Searcher@74e800c8 main
[junit4:junit4] 2> 1173072 T3658 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@74e800c8 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1173073 T3659 C874 P43304 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371428176423/jetty4/index.20130616201644420 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371428176423/jetty4/index.20130616201644420;done=true>>]
[junit4:junit4] 2> 1173073 T3659 C874 P43304 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371428176423/jetty4/index.20130616201644420
[junit4:junit4] 2> 1173073 T3659 C874 P43304 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371428176423/jetty4/index.20130616201644420
[junit4:junit4] 2> 1173074 T3659 C874 P43304 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 1173074 T3659 C874 P43304 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 1173074 T3659 C874 P43304 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1173074 T3659 C874 P43304 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1173076 T3659 C874 P43304 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 1173263 T3586 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1173264 T3586 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:43304_ky%2Fn",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:43304/ky/n"}
[junit4:junit4] 2> 1173278 T3585 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1173278 T3637 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1173278 T3605 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1173278 T3621 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1173278 T3592 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1173278 T3654 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1174041 T3563 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1174042 T3563 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> ASYNC NEW_CORE C876 name=collection1 org.apache.solr.core.SolrCore@34d775d5 url=http://127.0.0.1:46129/ky/n/collection1 node=127.0.0.1:46129_ky%2Fn C876_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:46129_ky%2Fn, base_url=http://127.0.0.1:46129/ky/n, leader=true}
[junit4:junit4] 2> 1174051 T3575 C876 P46129 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1174054 T3575 C876 P46129 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5d3b6699 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6e1a1976),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1174055 T3575 C876 P46129 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1174055 T3575 C876 P46129 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5d3b6699 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6e1a1976),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5d3b6699 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6e1a1976),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1174056 T3575 C876 P46129 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1174056 T3575 C876 P46129 oass.SolrIndexSearcher.<init> Opening Searcher@2f30da11 main
[junit4:junit4] 2> 1174057 T3575 C876 P46129 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1174058 T3589 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2f30da11 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1174059 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 8
[junit4:junit4] 2> 1174069 T3599 C873 P64668 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1174071 T3599 C873 P64668 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@73009218 lockFactory=org.apache.lucene.store.NativeFSLockFactory@23b16a07),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@73009218 lockFactory=org.apache.lucene.store.NativeFSLockFactory@23b16a07),segFN=segments_3,generation=3}
[junit4:junit4] 2> 1174072 T3599 C873 P64668 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 1174072 T3599 C873 P64668 oass.SolrIndexSearcher.<init> Opening Searcher@71613976 main
[junit4:junit4] 2> 1174073 T3599 C873 P64668 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1174074 T3607 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@71613976 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1174074 T3599 C873 P64668 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:25027/ky/n/collection1/, StdNode: http://127.0.0.1:34213/ky/n/collection1/, StdNode: http://127.0.0.1:43304/ky/n/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 1174078 T3615 C875 P34213 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1174079 T3615 C875 P34213 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@68907a96 lockFactory=org.apache.lucene.store.NativeFSLockFactory@651118d9),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@68907a96 lockFactory=org.apache.lucene.store.NativeFSLockFactory@651118d9),segFN=segments_3,generation=3}
[junit4:junit4] 2> 1174079 T3615 C875 P34213 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 1174080 T3615 C875 P34213 oass.SolrIndexSearcher.<init> Opening Searcher@2b2eb568 main
[junit4:junit4] 2> 1174080 T3615 C875 P34213 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1174081 T3623 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2b2eb568 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1174082 T3615 C875 P34213 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 5
[junit4:junit4] 2> C872_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:25027_ky%2Fn, base_url=http://127.0.0.1:25027/ky/n}
[junit4:junit4] 2> 1174085 T3627 C872 P25027 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> C874_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:43304_ky%2Fn, base_url=http://127.0.0.1:43304/ky/n}
[junit4:junit4] 2> 1174086 T3644 C874 P43304 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1174086 T3627 C872 P25027 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1eb42d4f lockFactory=org.apache.lucene.store.NativeFSLockFactory@2fd7ad01),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1eb42d4f lockFactory=org.apache.lucene.store.NativeFSLockFactory@2fd7ad01),segFN=segments_3,generation=3}
[junit4:junit4] 2> 1174087 T3644 C874 P43304 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@40d0b18c lockFactory=org.apache.lucene.store.NativeFSLockFactory@443e16b9),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@40d0b18c lockFactory=org.apache.lucene.store.NativeFSLockFactory@443e16b9),segFN=segments_3,generation=3}
[junit4:junit4] 2> 1174087 T3627 C872 P25027 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 1174088 T3644 C874 P43304 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 1174089 T3627 C872 P25027 oass.SolrIndexSearcher.<init> Opening Searcher@6ef0f6b3 main
[junit4:junit4] 2> 1174089 T3644 C874 P43304 oass.SolrIndexSearcher.<init> Opening Searcher@16155641 main
[junit4:junit4] 2> 1174090 T3627 C872 P25027 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1174091 T3639 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6ef0f6b3 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1174090 T3644 C874 P43304 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1174091 T3627 C872 P25027 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> 1174091 T3658 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@16155641 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1174092 T3644 C874 P43304 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 1174093 T3599 C873 P64668 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 24
[junit4:junit4] 2> 1174094 T3563 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1174097 T3600 C873 P64668 oasc.SolrCore.execute [collection1] webapp=/ky/n path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 1174099 T3628 C872 P25027 oasc.SolrCore.execute [collection1] webapp=/ky/n path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 1174101 T3616 C875 P34213 oasc.SolrCore.execute [collection1] webapp=/ky/n path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 1174103 T3645 C874 P43304 oasc.SolrCore.execute [collection1] webapp=/ky/n path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 1176109 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1438046704071868416)} 0 2
[junit4:junit4] 2> 1176118 T3646 C874 P43304 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={update.distrib=FROMLEADER&_version_=-1438046704076062720&update.from=http://127.0.0.1:34213/ky/n/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1438046704076062720)} 0 2
[junit4:junit4] 2> 1176121 T3627 C872 P25027 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={update.distrib=FROMLEADER&_version_=-1438046704080257024&update.from=http://127.0.0.1:64668/ky/n/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1438046704080257024)} 0 1
[junit4:junit4] 2> 1176122 T3601 C873 P64668 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={update.distrib=TOLEADER&wt=javabin&version=2} {deleteByQuery=*:* (-1438046704080257024)} 0 6
[junit4:junit4] 2> 1176123 T3617 C875 P34213 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1438046704076062720)} 0 12
[junit4:junit4] 2> 1176127 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[0 (1438046704090742784)]} 0 1
[junit4:junit4] 2> 1176136 T3627 C872 P25027 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:64668/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1438046704097034240)]} 0 1
[junit4:junit4] 2> 1176136 T3601 C873 P64668 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:34213/ky/n/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[0 (1438046704097034240)]} 0 4
[junit4:junit4] 2> 1176137 T3617 C875 P34213 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[0]} 0 7
[junit4:junit4] 2> 1176140 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[1 (1438046704105422848)]} 0 0
[junit4:junit4] 2> 1176146 T3627 C872 P25027 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:64668/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1438046704108568576)]} 0 0
[junit4:junit4] 2> 1176147 T3599 C873 P64668 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[1 (1438046704108568576)]} 0 4
[junit4:junit4] 2> 1176150 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[2 (1438046704115908608)]} 0 0
[junit4:junit4] 2> 1176159 T3646 C874 P43304 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:34213/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[2 (1438046704121151488)]} 0 1
[junit4:junit4] 2> 1176159 T3615 C875 P34213 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:64668/ky/n/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[2 (1438046704121151488)]} 0 4
[junit4:junit4] 2> 1176160 T3599 C873 P64668 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[2]} 0 7
[junit4:junit4] 2> 1176163 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[3 (1438046704129540096)]} 0 0
[junit4:junit4] 2> 1176169 T3646 C874 P43304 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:34213/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[3 (1438046704132685824)]} 0 0
[junit4:junit4] 2> 1176170 T3617 C875 P34213 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[3 (1438046704132685824)]} 0 4
[junit4:junit4] 2> 1176173 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[4 (1438046704140025856)]} 0 0
[junit4:junit4] 2> 1176181 T3627 C872 P25027 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:64668/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[4 (1438046704145268736)]} 0 0
[junit4:junit4] 2> 1176182 T3601 C873 P64668 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:34213/ky/n/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[4 (1438046704145268736)]} 0 4
[junit4:junit4] 2> 1176183 T3617 C875 P34213 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[4]} 0 7
[junit4:junit4] 2> 1176186 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[5 (1438046704153657344)]} 0 0
[junit4:junit4] 2> 1176196 T3646 C874 P43304 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:34213/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[5 (1438046704159948800)]} 0 1
[junit4:junit4] 2> 1176196 T3615 C875 P34213 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:64668/ky/n/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[5 (1438046704159948800)]} 0 4
[junit4:junit4] 2> 1176197 T3599 C873 P64668 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[5]} 0 8
[junit4:junit4] 2> 1176200 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[6 (1438046704168337408)]} 0 0
[junit4:junit4] 2> 1176210 T3646 C874 P43304 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:34213/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[6 (1438046704174628864)]} 0 1
[junit4:junit4] 2> 1176211 T3615 C875 P34213 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:64668/ky/n/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[6 (1438046704174628864)]} 0 5
[junit4:junit4] 2> 1176211 T3599 C873 P64668 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[6]} 0 8
[junit4:junit4] 2> 1176214 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[7 (1438046704183017472)]} 0 0
[junit4:junit4] 2> 1176220 T3646 C874 P43304 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:34213/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[7 (1438046704186163200)]} 0 0
[junit4:junit4] 2> 1176221 T3617 C875 P34213 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[7 (1438046704186163200)]} 0 4
[junit4:junit4] 2> 1176224 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[8 (1438046704193503232)]} 0 0
[junit4:junit4] 2> 1176230 T3627 C872 P25027 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:64668/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[8 (1438046704196648960)]} 0 0
[junit4:junit4] 2> 1176231 T3599 C873 P64668 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[8 (1438046704196648960)]} 0 4
[junit4:junit4] 2> 1176234 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[9 (1438046704203988992)]} 0 0
[junit4:junit4] 2> 1176242 T3646 C874 P43304 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:34213/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[9 (1438046704209231872)]} 0 0
[junit4:junit4] 2> 1176243 T3615 C875 P34213 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:64668/ky/n/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[9 (1438046704209231872)]} 0 4
[junit4:junit4] 2> 1176244 T3599 C873 P64668 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[9]} 0 7
[junit4:junit4] 2> 1176246 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[10 (1438046704216571904)]} 0 0
[junit4:junit4] 2> 1176252 T3627 C872 P25027 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:64668/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10 (1438046704219717632)]} 0 0
[junit4:junit4] 2> 1176253 T3599 C873 P64668 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[10 (1438046704219717632)]} 0 4
[junit4:junit4] 2> 1176256 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[11 (1438046704227057664)]} 0 0
[junit4:junit4] 2> 1176262 T3627 C872 P25027 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:64668/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[11 (1438046704230203392)]} 0 0
[junit4:junit4] 2> 1176263 T3599 C873 P64668 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[11 (1438046704230203392)]} 0 4
[junit4:junit4] 2> 1176266 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[12 (1438046704237543424)]} 0 0
[junit4:junit4] 2> 1176272 T3627 C872 P25027 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:64668/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[12 (1438046704240689152)]} 0 0
[junit4:junit4] 2> 1176273 T3599 C873 P64668 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[12 (1438046704240689152)]} 0 4
[junit4:junit4] 2> 1176276 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[13 (1438046704248029184)]} 0 0
[junit4:junit4] 2> 1176282 T3627 C872 P25027 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:64668/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[13 (1438046704251174912)]} 0 0
[junit4:junit4] 2> 1176283 T3599 C873 P64668 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[13 (1438046704251174912)]} 0 4
[junit4:junit4] 2> 1176286 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[14 (1438046704258514944)]} 0 0
[junit4:junit4] 2> 1176294 T3627 C872 P25027 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:64668/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[14 (1438046704263757824)]} 0 0
[junit4:junit4] 2> 1176295 T3601 C873 P64668 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:34213/ky/n/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[14 (1438046704263757824)]} 0 4
[junit4:junit4] 2> 1176296 T3617 C875 P34213 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[14]} 0 7
[junit4:junit4] 2> 1176298 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[15 (1438046704271097856)]} 0 0
[junit4:junit4] 2> 1176304 T3627 C872 P25027 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:64668/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[15 (1438046704274243584)]} 0 0
[junit4:junit4] 2> 1176305 T3599 C873 P64668 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[15 (1438046704274243584)]} 0 4
[junit4:junit4] 2> 1176308 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[16 (1438046704281583616)]} 0 0
[junit4:junit4] 2> 1176314 T3627 C872 P25027 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:64668/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[16 (1438046704284729344)]} 0 0
[junit4:junit4] 2> 1176315 T3599 C873 P64668 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[16 (1438046704284729344)]} 0 4
[junit4:junit4] 2> 1176318 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[17 (1438046704292069376)]} 0 0
[junit4:junit4] 2> 1176324 T3646 C874 P43304 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:34213/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[17 (1438046704295215104)]} 0 0
[junit4:junit4] 2> 1176325 T3617 C875 P34213 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[17 (1438046704295215104)]} 0 4
[junit4:junit4] 2> 1176328 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[18 (1438046704302555136)]} 0 0
[junit4:junit4] 2> 1176336 T3646 C874 P43304 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:34213/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[18 (1438046704307798016)]} 0 0
[junit4:junit4] 2> 1176337 T3615 C875 P34213 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:64668/ky/n/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[18 (1438046704307798016)]} 0 4
[junit4:junit4] 2> 1176338 T3599 C873 P64668 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[18]} 0 7
[junit4:junit4] 2> 1176341 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[19 (1438046704315138048)]} 0 1
[junit4:junit4] 2> 1176349 T3646 C874 P43304 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:34213/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[19 (1438046704321429504)]} 0 0
[junit4:junit4] 2> 1176350 T3615 C875 P34213 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:64668/ky/n/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[19 (1438046704321429504)]} 0 4
[junit4:junit4] 2> 1176351 T3599 C873 P64668 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[19]} 0 7
[junit4:junit4] 2> 1176354 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[20 (1438046704328769536)]} 0 1
[junit4:junit4] 2> 1176359 T3627 C872 P25027 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:64668/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[20 (1438046704331915264)]} 0 0
[junit4:junit4] 2> 1176360 T3599 C873 P64668 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[20 (1438046704331915264)]} 0 4
[junit4:junit4] 2> 1176363 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[21 (1438046704339255296)]} 0 0
[junit4:junit4] 2> 1176369 T3646 C874 P43304 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:34213/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[21 (1438046704342401024)]} 0 0
[junit4:junit4] 2> 1176370 T3617 C875 P34213 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[21 (1438046704342401024)]} 0 4
[junit4:junit4] 2> 1176373 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[22 (1438046704349741056)]} 0 0
[junit4:junit4] 2> 1176381 T3627 C872 P25027 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:64668/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[22 (1438046704354983936)]} 0 0
[junit4:junit4] 2> 1176382 T3601 C873 P64668 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:34213/ky/n/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[22 (1438046704354983936)]} 0 4
[junit4:junit4] 2> 1176383 T3617 C875 P34213 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[22]} 0 7
[junit4:junit4] 2> 1176385 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[23 (1438046704362323968)]} 0 0
[junit4:junit4] 2> 1176391 T3646 C874 P43304 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:34213/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[23 (1438046704365469696)]} 0 0
[junit4:junit4] 2> 1176392 T3617 C875 P34213 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[23 (1438046704365469696)]} 0 4
[junit4:junit4] 2> 1176395 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[24 (1438046704372809728)]} 0 0
[junit4:junit4] 2> 1176403 T3627 C872 P25027 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:64668/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[24 (1438046704378052608)]} 0 0
[junit4:junit4] 2> 1176404 T3601 C873 P64668 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:34213/ky/n/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[24 (1438046704378052608)]} 0 4
[junit4:junit4] 2> 1176405 T3617 C875 P34213 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[24]} 0 7
[junit4:junit4] 2> 1176407 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[25 (1438046704385392640)]} 0 0
[junit4:junit4] 2> 1176415 T3646 C874 P43304 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:34213/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[25 (1438046704390635520)]} 0 0
[junit4:junit4] 2> 1176416 T3615 C875 P34213 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:64668/ky/n/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[25 (1438046704390635520)]} 0 4
[junit4:junit4] 2> 1176417 T3599 C873 P64668 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[25]} 0 7
[junit4:junit4] 2> 1176419 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[26 (1438046704397975552)]} 0 0
[junit4:junit4] 2> 1176425 T3646 C874 P43304 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:34213/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[26 (1438046704401121280)]} 0 0
[junit4:junit4] 2> 1176426 T3617 C875 P34213 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[26 (1438046704401121280)]} 0 4
[junit4:junit4] 2> 1176429 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[27 (1438046704408461312)]} 0 0
[junit4:junit4] 2> 1176435 T3627 C872 P25027 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:64668/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[27 (1438046704411607040)]} 0 0
[junit4:junit4] 2> 1176436 T3599 C873 P64668 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[27 (1438046704411607040)]} 0 4
[junit4:junit4] 2> 1176439 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[28 (1438046704418947072)]} 0 0
[junit4:junit4] 2> 1176445 T3627 C872 P25027 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:64668/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[28 (1438046704422092800)]} 0 0
[junit4:junit4] 2> 1176446 T3599 C873 P64668 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[28 (1438046704422092800)]} 0 4
[junit4:junit4] 2> 1176450 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[29 (1438046704429432832)]} 0 1
[junit4:junit4] 2> 1176456 T3646 C874 P43304 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:34213/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[29 (1438046704432578560)]} 0 1
[junit4:junit4] 2> 1176456 T3617 C875 P34213 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[29 (1438046704432578560)]} 0 4
[junit4:junit4] 2> 1176459 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[30 (1438046704439918592)]} 0 0
[junit4:junit4] 2> 1176467 T3646 C874 P43304 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:34213/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[30 (1438046704445161472)]} 0 0
[junit4:junit4] 2> 1176468 T3615 C875 P34213 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:64668/ky/n/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[30 (1438046704445161472)]} 0 4
[junit4:junit4] 2> 1176469 T3599 C873 P64668 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[30]} 0 7
[junit4:junit4] 2> 1176472 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[31 (1438046704453550080)]} 0 0
[junit4:junit4] 2> 1176478 T3646 C874 P43304 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:34213/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[31 (1438046704456695808)]} 0 0
[junit4:junit4] 2> 1176479 T3617 C875 P34213 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[31 (1438046704456695808)]} 0 4
[junit4:junit4] 2> 1176482 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[32 (1438046704464035840)]} 0 0
[junit4:junit4] 2> 1176490 T3627 C872 P25027 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:64668/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[32 (1438046704469278720)]} 0 0
[junit4:junit4] 2> 1176491 T3601 C873 P64668 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:34213/ky/n/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[32 (1438046704469278720)]} 0 4
[junit4:junit4] 2> 1176492 T3617 C875 P34213 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[32]} 0 7
[junit4:junit4] 2> 1176494 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[33 (1438046704476618752)]} 0 0
[junit4:junit4] 2> 1176502 T3646 C874 P43304 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:34213/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[33 (1438046704481861632)]} 0 0
[junit4:junit4] 2> 1176503 T3615 C875 P34213 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:64668/ky/n/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[33 (1438046704481861632)]} 0 4
[junit4:junit4] 2> 1176504 T3599 C873 P64668 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[33]} 0 7
[junit4:junit4] 2> 1176506 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[34 (1438046704489201664)]} 0 0
[junit4:junit4] 2> 1176512 T3627 C872 P25027 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:64668/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[34 (1438046704492347392)]} 0 0
[junit4:junit4] 2> 1176513 T3599 C873 P64668 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[34 (1438046704492347392)]} 0 4
[junit4:junit4] 2> 1176517 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[35 (1438046704500736000)]} 0 0
[junit4:junit4] 2> 1176523 T3627 C872 P25027 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:64668/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[35 (1438046704503881728)]} 0 0
[junit4:junit4] 2> 1176524 T3599 C873 P64668 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[35 (1438046704503881728)]} 0 4
[junit4:junit4] 2> 1176527 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[36 (1438046704511221760)]} 0 0
[junit4:junit4] 2> 1176535 T3627 C872 P25027 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:64668/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[36 (1438046704516464640)]} 0 0
[junit4:junit4] 2> 1176536 T3601 C873 P64668 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:34213/ky/n/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[36 (1438046704516464640)]} 0 4
[junit4:junit4] 2> 1176537 T3617 C875 P34213 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[36]} 0 7
[junit4:junit4] 2> 1176540 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[37 (1438046704524853248)]} 0 0
[junit4:junit4] 2> 1176546 T3646 C874 P43304 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:34213/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[37 (1438046704527998976)]} 0 0
[junit4:junit4] 2> 1176547 T3617 C875 P34213 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[37 (1438046704527998976)]} 0 4
[junit4:junit4] 2> 1176550 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[38 (1438046704535339008)]} 0 0
[junit4:junit4] 2> 1176558 T3627 C872 P25027 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:64668/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[38 (1438046704540581888)]} 0 0
[junit4:junit4] 2> 1176559 T3601 C873 P64668 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:34213/ky/n/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[38 (1438046704540581888)]} 0 4
[junit4:junit4] 2> 1176560 T3617 C875 P34213 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[38]} 0 7
[junit4:junit4] 2> 1176562 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[39 (1438046704547921920)]} 0 0
[junit4:junit4] 2> 1176570 T3646 C874 P43304 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:34213/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[39 (1438046704553164800)]} 0 0
[junit4:junit4] 2> 1176571 T3615 C875 P34213 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:64668/ky/n/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[39 (1438046704553164800)]} 0 4
[junit4:junit4] 2> 1176572 T3599 C873 P64668 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[39]} 0 7
[junit4:junit4] 2> 1176575 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[40 (1438046704561553408)]} 0 0
[junit4:junit4] 2> 1176584 T3627 C872 P25027 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:64668/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[40 (1438046704566796288)]} 0 0
[junit4:junit4] 2> 1176585 T3601 C873 P64668 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:34213/ky/n/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[40 (1438046704566796288)]} 0 5
[junit4:junit4] 2> 1176586 T3617 C875 P34213 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[40]} 0 8
[junit4:junit4] 2> 1176588 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[41 (1438046704575184896)]} 0 0
[junit4:junit4] 2> 1176596 T3627 C872 P25027 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:64668/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[41 (1438046704580427776)]} 0 0
[junit4:junit4] 2> 1176597 T3601 C873 P64668 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:34213/ky/n/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[41 (1438046704580427776)]} 0 4
[junit4:junit4] 2> 1176598 T3617 C875 P34213 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[41]} 0 7
[junit4:junit4] 2> 1176600 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[42 (1438046704587767808)]} 0 0
[junit4:junit4] 2> 1176608 T3627 C872 P25027 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:64668/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[42 (1438046704593010688)]} 0 0
[junit4:junit4] 2> 1176609 T3601 C873 P64668 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:34213/ky/n/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[42 (1438046704593010688)]} 0 4
[junit4:junit4] 2> 1176610 T3617 C875 P34213 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[42]} 0 7
[junit4:junit4] 2> 1176612 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[43 (1438046704600350720)]} 0 0
[junit4:junit4] 2> 1176620 T3627 C872 P25027 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:64668/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[43 (1438046704605593600)]} 0 0
[junit4:junit4] 2> 1176621 T3601 C873 P64668 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:34213/ky/n/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[43 (1438046704605593600)]} 0 4
[junit4:junit4] 2> 1176622 T3617 C875 P34213 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[43]} 0 7
[junit4:junit4] 2> 1176624 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[44 (1438046704612933632)]} 0 0
[junit4:junit4] 2> 1176632 T3627 C872 P25027 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:64668/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[44 (1438046704618176512)]} 0 0
[junit4:junit4] 2> 1176633 T3601 C873 P64668 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:34213/ky/n/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[44 (1438046704618176512)]} 0 4
[junit4:junit4] 2> 1176634 T3617 C875 P34213 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[44]} 0 7
[junit4:junit4] 2> 1176636 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[45 (1438046704625516544)]} 0 0
[junit4:junit4] 2> 1176642 T3646 C874 P43304 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:34213/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[45 (1438046704628662272)]} 0 0
[junit4:junit4] 2> 1176643 T3617 C875 P34213 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[45 (1438046704628662272)]} 0 4
[junit4:junit4] 2> 1176646 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[46 (1438046704636002304)]} 0 0
[junit4:junit4] 2> 1176652 T3627 C872 P25027 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:64668/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[46 (1438046704639148032)]} 0 0
[junit4:junit4] 2> 1176653 T3599 C873 P64668 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[46 (1438046704639148032)]} 0 4
[junit4:junit4] 2> 1176656 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[47 (1438046704646488064)]} 0 0
[junit4:junit4] 2> 1176664 T3627 C872 P25027 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:64668/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[47 (1438046704651730944)]} 0 0
[junit4:junit4] 2> 1176665 T3601 C873 P64668 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:34213/ky/n/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[47 (1438046704651730944)]} 0 4
[junit4:junit4] 2> 1176666 T3617 C875 P34213 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[47]} 0 7
[junit4:junit4] 2> 1176668 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[48 (1438046704659070976)]} 0 0
[junit4:junit4] 2> 1176676 T3627 C872 P25027 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:64668/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[48 (1438046704664313856)]} 0 0
[junit4:junit4] 2> 1176677 T3601 C873 P64668 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:34213/ky/n/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[48 (1438046704664313856)]} 0 4
[junit4:junit4] 2> 1176678 T3617 C875 P34213 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[48]} 0 7
[junit4:junit4] 2> 1176680 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[49 (1438046704671653888)]} 0 0
[junit4:junit4] 2> 1176687 T3627 C872 P25027 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:64668/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[49 (1438046704674799616)]} 0 1
[junit4:junit4] 2> 1176687 T3599 C873 P64668 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[49 (1438046704674799616)]} 0 4
[junit4:junit4] 2> 1176690 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[50 (1438046704682139648)]} 0 0
[junit4:junit4] 2> 1176696 T3627 C872 P25027 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:64668/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[50 (1438046704685285376)]} 0 0
[junit4:junit4] 2> 1176697 T3599 C873 P64668 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[50 (1438046704685285376)]} 0 4
[junit4:junit4] 2> 1176700 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[51 (1438046704692625408)]} 0 0
[junit4:junit4] 2> 1176708 T3627 C872 P25027 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:64668/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[51 (1438046704697868288)]} 0 0
[junit4:junit4] 2> 1176709 T3601 C873 P64668 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:34213/ky/n/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[51 (1438046704697868288)]} 0 4
[junit4:junit4] 2> 1176710 T3617 C875 P34213 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[51]} 0 7
[junit4:junit4] 2> 1176712 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[52 (1438046704705208320)]} 0 0
[junit4:junit4] 2> 1176720 T3627 C872 P25027 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:64668/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[52 (1438046704710451200)]} 0 0
[junit4:junit4] 2> 1176721 T3601 C873 P64668 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:34213/ky/n/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[52 (1438046704710451200)]} 0 4
[junit4:junit4] 2> 1176722 T3617 C875 P34213 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[52]} 0 7
[junit4:junit4] 2> 1176724 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[53 (1438046704717791232)]} 0 0
[junit4:junit4] 2> 1176730 T3646 C874 P43304 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:34213/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[53 (1438046704720936960)]} 0 0
[junit4:junit4] 2> 1176731 T3617 C875 P34213 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[53 (1438046704720936960)]} 0 4
[junit4:junit4] 2> 1176734 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[54 (1438046704728276992)]} 0 0
[junit4:junit4] 2> 1176740 T3627 C872 P25027 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:64668/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[54 (1438046704731422720)]} 0 0
[junit4:junit4] 2> 1176741 T3599 C873 P64668 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[54 (1438046704731422720)]} 0 4
[junit4:junit4] 2> 1176744 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[55 (1438046704738762752)]} 0 0
[junit4:junit4] 2> 1176752 T3627 C872 P25027 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:64668/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[55 (1438046704744005632)]} 0 0
[junit4:junit4] 2> 1176753 T3601 C873 P64668 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:34213/ky/n/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[55 (1438046704744005632)]} 0 4
[junit4:junit4] 2> 1176754 T3617 C875 P34213 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[55]} 0 7
[junit4:junit4] 2> 1176756 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[56 (1438046704751345664)]} 0 0
[junit4:junit4] 2> 1176764 T3646 C874 P43304 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:34213/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[56 (1438046704756588544)]} 0 0
[junit4:junit4] 2> 1176765 T3615 C875 P34213 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:64668/ky/n/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[56 (1438046704756588544)]} 0 4
[junit4:junit4] 2> 1176766 T3599 C873 P64668 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[56]} 0 7
[junit4:junit4] 2> 1176768 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[57 (1438046704763928576)]} 0 0
[junit4:junit4] 2> 1176774 T3646 C874 P43304 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:34213/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[57 (1438046704767074304)]} 0 0
[junit4:junit4] 2> 1176775 T3617 C875 P34213 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[57 (1438046704767074304)]} 0 4
[junit4:junit4] 2> 1176778 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[58 (1438046704774414336)]} 0 0
[junit4:junit4] 2> 1176784 T3646 C874 P43304 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:34213/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[58 (1438046704777560064)]} 0 0
[junit4:junit4] 2> 1176785 T3617 C875 P34213 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[58 (1438046704777560064)]} 0 4
[junit4:junit4] 2> 1176788 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[59 (1438046704784900096)]} 0 0
[junit4:junit4] 2> 1176794 T3627 C872 P25027 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:64668/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[59 (1438046704788045824)]} 0 0
[junit4:junit4] 2> 1176795 T3599 C873 P64668 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[59 (1438046704788045824)]} 0 4
[junit4:junit4] 2> 1176798 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[60 (1438046704795385856)]} 0 0
[junit4:junit4] 2> 1176806 T3646 C874 P43304 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:34213/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[60 (1438046704800628736)]} 0 0
[junit4:junit4] 2> 1176807 T3615 C875 P34213 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:64668/ky/n/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[60 (1438046704800628736)]} 0 4
[junit4:junit4] 2> 1176808 T3599 C873 P64668 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[60]} 0 7
[junit4:junit4] 2> 1176810 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[61 (1438046704807968768)]} 0 0
[junit4:junit4] 2> 1176818 T3627 C872 P25027 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:64668/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[61 (1438046704813211648)]} 0 0
[junit4:junit4] 2> 1176819 T3601 C873 P64668 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:34213/ky/n/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[61 (1438046704813211648)]} 0 4
[junit4:junit4] 2> 1176820 T3617 C875 P34213 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[61]} 0 7
[junit4:junit4] 2> 1176822 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[62 (1438046704820551680)]} 0 0
[junit4:junit4] 2> 1176828 T3646 C874 P43304 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:34213/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[62 (1438046704823697408)]} 0 0
[junit4:junit4] 2> 1176829 T3617 C875 P34213 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[62 (1438046704823697408)]} 0 4
[junit4:junit4] 2> 1176832 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[63 (1438046704831037440)]} 0 0
[junit4:junit4] 2> 1176838 T3627 C872 P25027 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:64668/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[63 (1438046704834183168)]} 0 0
[junit4:junit4] 2> 1176839 T3599 C873 P64668 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[63 (1438046704834183168)]} 0 4
[junit4:junit4] 2> 1176842 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[64 (1438046704841523200)]} 0 0
[junit4:junit4] 2> 1176848 T3627 C872 P25027 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={distrib.from=http://127.0.0.1:64668/ky/n/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[64 (1438046704844668928)]} 0 0
[junit4:junit4] 2> 1176849 T3599 C873 P64668 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[64 (1438046704844668928)]} 0 4
[junit4:junit4] 2> 1176852 T3575 C876 P46129 oasup.LogUpdateProcessor.finish [collection1] webapp=/ky/n path=/update params={wt=javabin&version=2} {add=[65 (1438046704852008960)]} 0 0
[junit4:junit4] 2> 1176858 T3627 C872 P25027 oasup.LogUpdateProcessor.finish [collection1] we
[...truncated too long message...]
en closed, won't attempt to sync replicas back to leader
[junit4:junit4] 2> 1398203 T3654 oasc.ShardLeaderElectionContext.runLeaderProcess Sync was not a success but no one else is active! I am the leader
[junit4:junit4] 2> 1398203 T3654 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:43304/ky/n/collection1/
[junit4:junit4] 2> 1398203 T3654 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@50161b26
[junit4:junit4] 2> 1398204 T3654 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=4,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=605,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0}
[junit4:junit4] 2> 1398205 T3654 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 1398205 T3654 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 1398205 T3654 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 1398208 T3654 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 1398209 T3654 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 1398209 T3654 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371428176423/jetty4/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371428176423/jetty4/index;done=false>>]
[junit4:junit4] 2> 1398209 T3654 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371428176423/jetty4/index
[junit4:junit4] 2> 1398210 T3654 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371428176423/jetty4 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371428176423/jetty4;done=false>>]
[junit4:junit4] 2> 1398210 T3654 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1371428176423/jetty4
[junit4:junit4] 2> 1398210 T3654 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 1398210 T3654 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard2/election/89877916970582028-5-n_0000000001
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4] 2> at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:152)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:149)
[junit4:junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:149)
[junit4:junit4] 2> at org.apache.solr.cloud.ElectionContext.cancelElection(ElectionContext.java:63)
[junit4:junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:260)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:156)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:100)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4] 2>
[junit4:junit4] 2> 1398211 T3654 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 1398211 T3654 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1398212 T3654 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 1398212 T3654 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1398212 T3654 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 1398212 T3654 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:235)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:232)
[junit4:junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:232)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:84)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4] 2>
[junit4:junit4] 2> NOTE: test params are: codec=FastCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST, chunkSize=169), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST, chunkSize=169)), sim=RandomSimilarityProvider(queryNorm=false,coord=no): {}, locale=sk, timezone=America/Toronto
[junit4:junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_21 (64-bit)/cpus=16,threads=3,free=204629296,total=529530880
[junit4:junit4] 2> NOTE: All tests run in this JVM: [TestCopyFieldCollectionResource, TestSolrCoreProperties, MoreLikeThisHandlerTest, SchemaVersionSpecificBehaviorTest, RAMDirectoryFactoryTest, BasicDistributedZk2Test, TestCloudManagedSchemaAddField, SolrRequestParserTest, QueryParsingTest, NumericFieldsTest, OpenExchangeRatesOrgProviderTest, LukeRequestHandlerTest, ZkSolrClientTest, TestSolr4Spatial, TestExtendedDismaxParser, PeerSyncTest, TestSurroundQueryParser, OverseerTest, SpellCheckCollatorTest, QueryEqualityTest, SolrIndexSplitterTest, TestWriterPerf, SpatialFilterTest, TestZkChroot, PathHierarchyTokenizerFactoryTest, ClusterStateUpdateTest, TestFuzzyAnalyzedSuggestions, TestBinaryResponseWriter, TestValueSourceCache, TestElisionMultitermQuery, TestReplicationHandler, TestFiltering, StandardRequestHandlerTest, TestQueryUtils, BinaryUpdateRequestHandlerTest, TimeZoneUtilsTest, TestDFRSimilarityFactory, RequiredFieldsTest, UUIDFieldTest, PreAnalyzedUpdateProcessorTest, PolyFieldTest, TestBinaryField, TestDynamicFieldResource, TestClassNameShortening, TestSort, ShardRoutingTest, TestHashPartitioner, AliasIntegrationTest, BasicDistributedZkTest, CollectionsAPIDistributedZkTest, TestMergePolicyConfig, FastVectorHighlighterTest, HardAutoCommitTest, EchoParamsTest, TestStressReorder, TestSchemaSimilarityResource, XsltUpdateRequestHandlerTest, PrimUtilsTest, SearchHandlerTest, TestSolrQueryParserResource, TestSolrDeletionPolicy1, ResponseLogComponentTest, CachingDirectoryFactoryTest, TestSolrQueryParserDefaultOperatorResource, SystemInfoHandlerTest, TestLuceneMatchVersion, TestSolrJ, ConvertedLegacyTest, DistanceFunctionTest, TestIndexingPerformance, TestSolrIndexConfig, ChaosMonkeyNothingIsSafeTest, ChaosMonkeyShardSplitTest]
[junit4:junit4] Completed on J0 in 253.60s, 1 test, 1 error <<< FAILURES!
[...truncated 462 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:392: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:372: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build.xml:181: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/common-build.xml:437: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:1246: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:890: There were test failures: 297 suites, 1246 tests, 1 error, 14 ignored (8 assumptions)
Total time: 53 minutes 27 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-Tests-4.x-Java7 - Build # 1336 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java7/1336/
1 tests failed.
REGRESSION: org.apache.solr.cloud.ShardSplitTest.testDistribSearch
Error Message:
Server at http://127.0.0.1:11615 returned non ok status:500, message:Server Error
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:11615 returned non ok status:500, message:Server Error
at __randomizedtesting.SeedInfo.seed([B406194E930C3749:35E09756E4535775]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:228)
at org.apache.solr.cloud.ShardSplitTest.doTest(ShardSplitTest.java:150)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9650 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.ShardSplitTest
[junit4:junit4] 2> 1195781 T2541 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4] 2> 1195788 T2541 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solrtest-ShardSplitTest-1371378996800
[junit4:junit4] 2> 1195789 T2541 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 1195790 T2542 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 1195891 T2541 oasc.ZkTestServer.run start zk server on port:11606
[junit4:junit4] 2> 1195892 T2541 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1195895 T2548 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2410ea13 name:ZooKeeperConnection Watcher:127.0.0.1:11606 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1195896 T2541 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1195896 T2541 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 1195908 T2541 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1195910 T2550 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5c701950 name:ZooKeeperConnection Watcher:127.0.0.1:11606/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1195910 T2541 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1195911 T2541 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 1195921 T2541 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 1195924 T2541 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 1195926 T2541 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 1195935 T2541 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 1195936 T2541 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 1195948 T2541 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 1195949 T2541 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 1196053 T2541 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 1196054 T2541 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 1196063 T2541 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 1196063 T2541 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 1196067 T2541 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 1196067 T2541 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 1196071 T2541 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 1196071 T2541 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 1196074 T2541 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 1196075 T2541 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 1196078 T2541 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 1196079 T2541 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 1196082 T2541 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 1196083 T2541 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 1196357 T2541 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1196363 T2541 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:11609
[junit4:junit4] 2> 1196364 T2541 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1196364 T2541 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1196365 T2541 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1371378997104
[junit4:junit4] 2> 1196365 T2541 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1371378997104/solr.xml
[junit4:junit4] 2> 1196366 T2541 oasc.CoreContainer.<init> New CoreContainer 801767869
[junit4:junit4] 2> 1196367 T2541 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1371378997104/'
[junit4:junit4] 2> 1196367 T2541 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1371378997104/'
[junit4:junit4] 2> 1196529 T2541 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1196531 T2541 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1196532 T2541 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1196532 T2541 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1196533 T2541 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1196534 T2541 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1196535 T2541 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1196535 T2541 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1196536 T2541 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1196537 T2541 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1196555 T2541 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1196556 T2541 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:11606/solr
[junit4:junit4] 2> 1196557 T2541 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1196558 T2541 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1196594 T2561 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6f6c6db name:ZooKeeperConnection Watcher:127.0.0.1:11606 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1196595 T2541 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1196634 T2541 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1196647 T2541 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1196677 T2563 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@723d5b98 name:ZooKeeperConnection Watcher:127.0.0.1:11606/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1196677 T2541 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1196719 T2541 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 1196816 T2541 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 1196839 T2541 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 1196869 T2541 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:11609_
[junit4:junit4] 2> 1196871 T2541 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:11609_
[junit4:junit4] 2> 1196874 T2541 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 1196880 T2541 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 1196882 T2541 oasc.Overseer.start Overseer (id=89874693934743555-127.0.0.1:11609_-n_0000000000) starting
[junit4:junit4] 2> 1196886 T2541 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 1196890 T2565 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 1196891 T2541 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 1196894 T2541 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 1196896 T2541 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1196899 T2564 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 1196903 T2566 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1196903 T2566 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1198404 T2564 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1198405 T2564 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:11609_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:11609"}
[junit4:junit4] 2> 1198405 T2564 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 1198405 T2564 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 1198419 T2563 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1198907 T2566 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1371378997104/collection1
[junit4:junit4] 2> 1198907 T2566 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 1198908 T2566 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1198908 T2566 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 1198910 T2566 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1371378997104/collection1/'
[junit4:junit4] 2> 1198912 T2566 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-controljetty-1371378997104/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1198912 T2566 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-controljetty-1371378997104/collection1/lib/README' to classloader
[junit4:junit4] 2> 1198975 T2566 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 1199045 T2566 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1199147 T2566 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1199154 T2566 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1199754 T2566 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1199758 T2566 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1199759 T2566 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1199764 T2566 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1199781 T2566 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1199781 T2566 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1371378997104/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1371378996799/control/data/
[junit4:junit4] 2> 1199781 T2566 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@948ecbd
[junit4:junit4] 2> 1199782 T2566 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1199783 T2566 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1371378996799/control/data
[junit4:junit4] 2> 1199783 T2566 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1371378996799/control/data/index/
[junit4:junit4] 2> 1199783 T2566 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1371378996799/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1199783 T2566 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1371378996799/control/data/index
[junit4:junit4] 2> 1199787 T2566 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@29a5ced5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@e3e8cf8),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1199787 T2566 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1199790 T2566 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1199790 T2566 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1199791 T2566 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1199791 T2566 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1199792 T2566 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1199792 T2566 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1199792 T2566 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1199792 T2566 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1199793 T2566 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1199807 T2566 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1199813 T2566 oass.SolrIndexSearcher.<init> Opening Searcher@5751439e main
[junit4:junit4] 2> 1199813 T2566 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1371378996799/control/data/tlog
[junit4:junit4] 2> 1199814 T2566 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1199815 T2566 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1199817 T2567 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5751439e main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1199818 T2566 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1199818 T2566 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:11609 collection:control_collection shard:shard1
[junit4:junit4] 2> 1199819 T2566 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 1199841 T2566 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 1199843 T2566 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 1199843 T2566 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 1199844 T2566 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:11609/collection1/
[junit4:junit4] 2> 1199844 T2566 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 1199844 T2566 oasc.SyncStrategy.syncToMe http://127.0.0.1:11609/collection1/ has no replicas
[junit4:junit4] 2> 1199844 T2566 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:11609/collection1/
[junit4:junit4] 2> 1199844 T2566 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 1199923 T2564 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1199930 T2563 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1199951 T2566 oasc.ZkController.register We are http://127.0.0.1:11609/collection1/ and leader is http://127.0.0.1:11609/collection1/
[junit4:junit4] 2> 1199951 T2566 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:11609
[junit4:junit4] 2> 1199951 T2566 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 1199951 T2566 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1199951 T2566 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1199953 T2566 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1199954 T2541 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 1199955 T2541 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1199955 T2541 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1199967 T2541 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 1199968 T2541 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1199969 T2570 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3c26e019 name:ZooKeeperConnection Watcher:127.0.0.1:11606/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1199970 T2541 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1199971 T2541 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1199973 T2541 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 1200146 T2541 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1200149 T2541 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:11615
[junit4:junit4] 2> 1200149 T2541 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1200150 T2541 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1200150 T2541 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1371379000984
[junit4:junit4] 2> 1200150 T2541 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1371379000984/solr.xml
[junit4:junit4] 2> 1200151 T2541 oasc.CoreContainer.<init> New CoreContainer 733933396
[junit4:junit4] 2> 1200151 T2541 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1371379000984/'
[junit4:junit4] 2> 1200152 T2541 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1371379000984/'
[junit4:junit4] 2> 1200238 T2541 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1200238 T2541 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1200239 T2541 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1200239 T2541 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1200240 T2541 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1200240 T2541 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1200240 T2541 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1200241 T2541 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1200241 T2541 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1200242 T2541 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1200253 T2541 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1200254 T2541 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:11606/solr
[junit4:junit4] 2> 1200254 T2541 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1200255 T2541 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1200258 T2581 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2b412e74 name:ZooKeeperConnection Watcher:127.0.0.1:11606 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1200258 T2541 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1200277 T2541 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1200285 T2541 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1200287 T2583 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@222f3400 name:ZooKeeperConnection Watcher:127.0.0.1:11606/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1200287 T2541 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1200299 T2541 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1201302 T2541 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:11615_
[junit4:junit4] 2> 1201304 T2541 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:11615_
[junit4:junit4] 2> 1201308 T2563 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1201308 T2570 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1201308 T2583 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1201309 T2563 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1201325 T2584 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1201325 T2584 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1201435 T2564 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1201436 T2564 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:11609__collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:11609_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:11609"}
[junit4:junit4] 2> 1201440 T2564 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:11615_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:11615"}
[junit4:junit4] 2> 1201440 T2564 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 1201440 T2564 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 1201452 T2570 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1201452 T2563 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1201452 T2583 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1202329 T2584 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1371379000984/collection1
[junit4:junit4] 2> 1202329 T2584 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1202330 T2584 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1202330 T2584 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1202353 T2584 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1371379000984/collection1/'
[junit4:junit4] 2> 1202355 T2584 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty1-1371379000984/collection1/lib/README' to classloader
[junit4:junit4] 2> 1202356 T2584 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty1-1371379000984/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1202408 T2584 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 1202469 T2584 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1202571 T2584 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1202578 T2584 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1203134 T2584 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1203138 T2584 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1203140 T2584 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1203146 T2584 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1203169 T2584 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1203169 T2584 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1371379000984/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1371378996799/jetty1/
[junit4:junit4] 2> 1203170 T2584 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@948ecbd
[junit4:junit4] 2> 1203170 T2584 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1203171 T2584 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1371378996799/jetty1
[junit4:junit4] 2> 1203171 T2584 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1371378996799/jetty1/index/
[junit4:junit4] 2> 1203172 T2584 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1371378996799/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1203173 T2584 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1371378996799/jetty1/index
[junit4:junit4] 2> 1203177 T2584 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@56468a4d lockFactory=org.apache.lucene.store.NativeFSLockFactory@4f2ac5a),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1203177 T2584 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1203180 T2584 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1203181 T2584 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1203182 T2584 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1203182 T2584 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1203183 T2584 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1203183 T2584 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1203184 T2584 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1203185 T2584 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1203185 T2584 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1203201 T2584 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1203208 T2584 oass.SolrIndexSearcher.<init> Opening Searcher@110fa697 main
[junit4:junit4] 2> 1203209 T2584 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1371378996799/jetty1/tlog
[junit4:junit4] 2> 1203210 T2584 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1203210 T2584 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1203214 T2585 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@110fa697 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1203216 T2584 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1203217 T2584 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:11615 collection:collection1 shard:shard1
[junit4:junit4] 2> 1203217 T2584 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 1203252 T2584 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 1203263 T2584 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 1203263 T2584 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 1203264 T2584 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:11615/collection1/
[junit4:junit4] 2> 1203264 T2584 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 1203264 T2584 oasc.SyncStrategy.syncToMe http://127.0.0.1:11615/collection1/ has no replicas
[junit4:junit4] 2> 1203265 T2584 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:11615/collection1/
[junit4:junit4] 2> 1203265 T2584 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 1204467 T2564 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1204488 T2570 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1204488 T2563 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1204488 T2583 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1204499 T2584 oasc.ZkController.register We are http://127.0.0.1:11615/collection1/ and leader is http://127.0.0.1:11615/collection1/
[junit4:junit4] 2> 1204499 T2584 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:11615
[junit4:junit4] 2> 1204499 T2584 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 1204499 T2584 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1204500 T2584 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1204502 T2584 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1204503 T2541 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 1204504 T2541 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1204505 T2541 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1204790 T2541 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1204793 T2541 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:11621
[junit4:junit4] 2> 1204794 T2541 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1204795 T2541 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1204795 T2541 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1371379005532
[junit4:junit4] 2> 1204796 T2541 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1371379005532/solr.xml
[junit4:junit4] 2> 1204796 T2541 oasc.CoreContainer.<init> New CoreContainer 893477828
[junit4:junit4] 2> 1204797 T2541 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1371379005532/'
[junit4:junit4] 2> 1204798 T2541 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1371379005532/'
[junit4:junit4] 2> 1204927 T2541 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1204928 T2541 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1204929 T2541 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1204929 T2541 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1204930 T2541 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1204930 T2541 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1204931 T2541 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1204932 T2541 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1204932 T2541 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1204933 T2541 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1204949 T2541 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1204949 T2541 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:11606/solr
[junit4:junit4] 2> 1204950 T2541 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1204951 T2541 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1204954 T2597 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@335f5fae name:ZooKeeperConnection Watcher:127.0.0.1:11606 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1204955 T2541 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1204970 T2541 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1204981 T2541 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1204983 T2599 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@380e96b7 name:ZooKeeperConnection Watcher:127.0.0.1:11606/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1204983 T2541 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1204993 T2541 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1205994 T2564 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1205995 T2564 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:11615__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:11615_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:11615"}
[junit4:junit4] 2> 1205996 T2541 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:11621_
[junit4:junit4] 2> 1205998 T2541 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:11621_
[junit4:junit4] 2> 1206010 T2563 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1206011 T2583 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1206011 T2599 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1206011 T2570 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1206012 T2599 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1206012 T2570 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1206021 T2583 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1206021 T2583 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1206021 T2570 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1206022 T2563 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1206022 T2563 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1206026 T2600 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1206026 T2600 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1207523 T2564 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1207525 T2564 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:11621_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:11621"}
[junit4:junit4] 2> 1207525 T2564 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 1207525 T2564 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 1207543 T2570 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1207543 T2563 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1207543 T2583 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1207543 T2599 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1208030 T2600 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1371379005532/collection1
[junit4:junit4] 2> 1208030 T2600 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1208032 T2600 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1208033 T2600 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1208035 T2600 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1371379005532/collection1/'
[junit4:junit4] 2> 1208038 T2600 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty2-1371379005532/collection1/lib/README' to classloader
[junit4:junit4] 2> 1208039 T2600 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty2-1371379005532/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1208105 T2600 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 1208204 T2600 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1208306 T2600 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1208314 T2600 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1208932 T2600 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1208936 T2600 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1208938 T2600 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1208943 T2600 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1208966 T2600 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1208967 T2600 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1371379005532/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1371378996799/jetty2/
[junit4:junit4] 2> 1208967 T2600 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@948ecbd
[junit4:junit4] 2> 1208968 T2600 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1208969 T2600 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1371378996799/jetty2
[junit4:junit4] 2> 1208969 T2600 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1371378996799/jetty2/index/
[junit4:junit4] 2> 1208969 T2600 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1371378996799/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1208970 T2600 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1371378996799/jetty2/index
[junit4:junit4] 2> 1208974 T2600 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@77ab4625 lockFactory=org.apache.lucene.store.NativeFSLockFactory@622e7e70),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1208974 T2600 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1208978 T2600 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1208978 T2600 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1208979 T2600 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1208979 T2600 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1208980 T2600 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1208980 T2600 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1208981 T2600 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1208981 T2600 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1208982 T2600 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1208997 T2600 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1209004 T2600 oass.SolrIndexSearcher.<init> Opening Searcher@33b94c16 main
[junit4:junit4] 2> 1209004 T2600 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1371378996799/jetty2/tlog
[junit4:junit4] 2> 1209006 T2600 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1209006 T2600 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1209010 T2601 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@33b94c16 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1209012 T2600 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1209013 T2600 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:11621 collection:collection1 shard:shard2
[junit4:junit4] 2> 1209014 T2600 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 1209029 T2600 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 1209032 T2600 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 1209032 T2600 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 1209032 T2600 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:11621/collection1/
[junit4:junit4] 2> 1209032 T2600 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 1209033 T2600 oasc.SyncStrategy.syncToMe http://127.0.0.1:11621/collection1/ has no replicas
[junit4:junit4] 2> 1209033 T2600 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:11621/collection1/
[junit4:junit4] 2> 1209034 T2600 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 1209049 T2564 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1209056 T2599 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1209056 T2563 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1209056 T2583 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1209056 T2570 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1209090 T2600 oasc.ZkController.register We are http://127.0.0.1:11621/collection1/ and leader is http://127.0.0.1:11621/collection1/
[junit4:junit4] 2> 1209090 T2600 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:11621
[junit4:junit4] 2> 1209090 T2600 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 1209091 T2600 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1209091 T2600 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1209093 T2600 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1209094 T2541 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 1209095 T2541 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1209095 T2541 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1209355 T2541 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1209359 T2541 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:11630
[junit4:junit4] 2> 1209359 T2541 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1209360 T2541 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1209360 T2541 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1371379010123
[junit4:junit4] 2> 1209361 T2541 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1371379010123/solr.xml
[junit4:junit4] 2> 1209362 T2541 oasc.CoreContainer.<init> New CoreContainer 330550660
[junit4:junit4] 2> 1209362 T2541 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1371379010123/'
[junit4:junit4] 2> 1209363 T2541 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1371379010123/'
[junit4:junit4] 2> 1209485 T2541 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1209486 T2541 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1209487 T2541 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1209487 T2541 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1209488 T2541 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1209488 T2541 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1209489 T2541 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1209489 T2541 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1209490 T2541 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1209490 T2541 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1209507 T2541 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1209507 T2541 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:11606/solr
[junit4:junit4] 2> 1209508 T2541 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1209509 T2541 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1209512 T2613 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@35ce9fc1 name:ZooKeeperConnection Watcher:127.0.0.1:11606 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1209513 T2541 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1209528 T2541 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1209541 T2541 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1209543 T2615 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a7b0afc name:ZooKeeperConnection Watcher:127.0.0.1:11606/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1209543 T2541 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1209554 T2541 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1210557 T2541 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:11630_
[junit4:junit4] 2> 1210559 T2541 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:11630_
[junit4:junit4] 2> 1210563 T2563 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1210563 T2564 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1210563 T2583 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1210563 T2570 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1210563 T2615 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1210563 T2599 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1210564 T2564 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:11621__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:11621_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:11621"}
[junit4:junit4] 2> 1210564 T2570 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1210564 T2599 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1210565 T2583 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1210568 T2570 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1210568 T2615 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1210568 T2583 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1210568 T2599 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1210571 T2616 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1210571 T2616 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1210572 T2563 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1210573 T2563 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1212073 T2564 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1212074 T2564 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:11630_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:11630"}
[junit4:junit4] 2> 1212075 T2564 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 1212075 T2564 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 1212113 T2615 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1212113 T2599 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1212113 T2583 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1212113 T2570 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1212113 T2563 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1212575 T2616 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1371379010123/collection1
[junit4:junit4] 2> 1212575 T2616 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1212576 T2616 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1212576 T2616 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1212578 T2616 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1371379010123/collection1/'
[junit4:junit4] 2> 1212580 T2616 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty3-1371379010123/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1212580 T2616 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty3-1371379010123/collection1/lib/README' to classloader
[junit4:junit4] 2> 1212636 T2616 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 1212698 T2616 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1212801 T2616 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1212808 T2616 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1213423 T2616 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1213427 T2616 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1213430 T2616 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1213435 T2616 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1213458 T2616 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1213458 T2616 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1371379010123/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1371378996799/jetty3/
[junit4:junit4] 2> 1213459 T2616 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@948ecbd
[junit4:junit4] 2> 1213459 T2616 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1213460 T2616 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1371378996799/jetty3
[junit4:junit4] 2> 1213461 T2616 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1371378996799/jetty3/index/
[junit4:junit4] 2> 1213461 T2616 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1371378996799/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1213462 T2616 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1371378996799/jetty3/index
[junit4:junit4] 2> 1213466 T2616 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6e2809da lockFactory=org.apache.lucene.store.NativeFSLockFactory@64a0eb2c),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1213466 T2616 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1213470 T2616 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1213470 T2616 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1213471 T2616 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1213472 T2616 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1213472 T2616 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1213473 T2616 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1213473 T2616 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1213474 T2616 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1213474 T2616 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1213490 T2616 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1213498 T2616 oass.SolrIndexSearcher.<init> Opening Searcher@5e3b59ab main
[junit4:junit4] 2> 1213498 T2616 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1371378996799/jetty3/tlog
[junit4:junit4] 2> 1213499 T2616 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1213500 T2616 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1213504 T2617 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5e3b59ab main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1213506 T2616 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1213506 T2616 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:11630 collection:collection1 shard:shard1
[junit4:junit4] 2> 1213509 T2616 oasc.ZkController.register We are http://127.0.0.1:11630/collection1/ and leader is http://127.0.0.1:11615/collection1/
[junit4:junit4] 2> 1213509 T2616 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:11630
[junit4:junit4] 2> 1213510 T2616 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 1213510 T2616 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C2312 name=collection1 org.apache.solr.core.SolrCore@6ad6cf03 url=http://127.0.0.1:11630/collection1 node=127.0.0.1:11630_ C2312_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:11630_, base_url=http://127.0.0.1:11630}
[junit4:junit4] 2> 1213511 T2618 C2312 P11630 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 1213511 T2616 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1213511 T2618 C2312 P11630 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 1213512 T2618 C2312 P11630 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 1213512 T2618 C2312 P11630 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1213512 T2541 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 1213513 T2541 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1213513 T2618 C2312 P11630 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1213514 T2541 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1213530 T2573 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:11630__collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 1213617 T2564 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1213618 T2564 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:11630__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:11630_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:11630"}
[junit4:junit4] 2> 1213645 T2599 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1213645 T2583 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1213645 T2563 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1213645 T2615 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1213645 T2570 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1213793 T2541 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1213796 T2541 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:11641
[junit4:junit4] 2> 1213796 T2541 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1213797 T2541 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1213798 T2541 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1371379014540
[junit4:junit4] 2> 1213798 T2541 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1371379014540/solr.xml
[junit4:junit4] 2> 1213799 T2541 oasc.CoreContainer.<init> New CoreContainer 321851471
[junit4:junit4] 2> 1213800 T2541 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1371379014540/'
[junit4:junit4] 2> 1213800 T2541 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1371379014540/'
[junit4:junit4] 2> 1213929 T2541 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1213930 T2541 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1213931 T2541 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1213931 T2541 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1213932 T2541 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1213932 T2541 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1213933 T2541 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1213934 T2541 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1213934 T2541 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1213935 T2541 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1213952 T2541 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1213953 T2541 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:11606/solr
[junit4:junit4] 2> 1213954 T2541 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1213955 T2541 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1213957 T2630 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4007a55d name:ZooKeeperConnection Watcher:127.0.0.1:11606 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1213958 T2541 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1213960 T2541 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1213972 T2541 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1213974 T2632 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4199cabb name:ZooKeeperConnection Watcher:127.0.0.1:11606/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1213974 T2541 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1213986 T2541 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1214533 T2573 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:11630__collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 1214533 T2573 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:11630__collection1&state=recovering&nodeName=127.0.0.1:11630_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1003
[junit4:junit4] 2> 1214989 T2541 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:11641_
[junit4:junit4] 2> 1215001 T2541 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:11641_
[junit4:junit4] 2> 1215004 T2563 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1215004 T2583 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1215005 T2632 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1215005 T2599 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1215005 T2570 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1215005 T2615 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1215006 T2563 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1215006 T2615 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1215006 T2570 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1215006 T2599 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1215021 T2583 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1215027 T2633 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1215027 T2633 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1215154 T2564 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1215155 T2564 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:11641_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:11641"}
[junit4:junit4] 2> 1215155 T2564 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 1215156 T2564 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 1215169 T2599 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1215169 T2583 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1215169 T2632 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1215169 T2615 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1215169 T2570 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1215169 T2563 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1216029 T2633 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1371379014540/collection1
[junit4:junit4] 2> 1216029 T2633 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1216030 T2633 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1216030 T2633 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1216032 T2633 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1371379014540/collection1/'
[junit4:junit4] 2> 1216034 T2633 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty4-1371379014540/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1216034 T2633 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty4-1371379014540/collection1/lib/README' to classloader
[junit4:junit4] 2> 1216093 T2633 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 1216160 T2633 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1216262 T2633 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1216269 T2633 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> ASYNC NEW_CORE C2313 name=collection1 org.apache.solr.core.SolrCore@6ad6cf03 url=http://127.0.0.1:11630/collection1 node=127.0.0.1:11630_ C2313_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:11630_, base_url=http://127.0.0.1:11630}
[junit4:junit4] 2> 1216535 T2618 C2313 P11630 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:11615/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 1216536 T2618 C2313 P11630 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:11630 START replicas=[http://127.0.0.1:11615/collection1/] nUpdates=100
[junit4:junit4] 2> 1216536 T2618 C2313 P11630 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 1216537 T2618 C2313 P11630 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 1216538 T2618 C2313 P11630 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 1216538 T2618 C2313 P11630 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 1216539 T2618 C2313 P11630 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 1216539 T2618 C2313 P11630 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:11615/collection1/. core=collection1
[junit4:junit4] 2> 1216539 T2618 C2313 P11630 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C2314 name=collection1 org.apache.solr.core.SolrCore@32bc41b8 url=http://127.0.0.1:11615/collection1 node=127.0.0.1:11615_ C2314_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:11615_, base_url=http://127.0.0.1:11615, leader=true}
[junit4:junit4] 2> 1216547 T2574 C2314 P11615 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 1216554 T2575 C2314 P11615 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1216558 T2575 C2314 P11615 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@56468a4d lockFactory=org.apache.lucene.store.NativeFSLockFactory@4f2ac5a),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1216559 T2575 C2314 P11615 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1216560 T2575 C2314 P11615 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@56468a4d lockFactory=org.apache.lucene.store.NativeFSLockFactory@4f2ac5a),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@56468a4d lockFactory=org.apache.lucene.store.NativeFSLockFactory@4f2ac5a),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1216560 T2575 C2314 P11615 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1216561 T2575 C2314 P11615 oass.SolrIndexSearcher.<init> Opening Searcher@6b8d855c realtime
[junit4:junit4] 2> 1216561 T2575 C2314 P11615 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1216562 T2575 C2314 P11615 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 8
[junit4:junit4] 2> 1216563 T2618 C2313 P11630 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1216563 T2618 C2313 P11630 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 1216565 T2576 C2314 P11615 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1216565 T2576 C2314 P11615 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 1216566 T2618 C2313 P11630 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 1216566 T2618 C2313 P11630 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 1216567 T2618 C2313 P11630 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 1216569 T2576 C2314 P11615 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 1216570 T2618 C2313 P11630 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 1216571 T2618 C2313 P11630 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1371378996799/jetty3/index.20130616063657582
[junit4:junit4] 2> 1216572 T2618 C2313 P11630 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@73cdb6e lockFactory=org.apache.lucene.store.NativeFSLockFactory@271def98) fullCopy=false
[junit4:junit4] 2> 1216574 T2576 C2314 P11615 oasc.SolrCore.execute [collection1] webapp= path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 1216575 T2618 C2313 P11630 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 1216577 T2618 C2313 P11630 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 1216577 T2618 C2313 P11630 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 1216579 T2618 C2313 P11630 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6e2809da lockFactory=org.apache.lucene.store.NativeFSLockFactory@64a0eb2c),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6e2809da lockFactory=org.apache.lucene.store.NativeFSLockFactory@64a0eb2c),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1216580 T2618 C2313 P11630 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1216580 T2618 C2313 P11630 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 1216581 T2618 C2313 P11630 oass.SolrIndexSearcher.<init> Opening Searcher@6f17c3cb main
[junit4:junit4] 2> 1216582 T2617 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6f17c3cb main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1216583 T2618 C2313 P11630 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1371378996799/jetty3/index.20130616063657582 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1371378996799/jetty3/index.20130616063657582;done=true>>]
[junit4:junit4] 2> 1216583 T2618 C2313 P11630 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1371378996799/jetty3/index.20130616063657582
[junit4:junit4] 2> 1216583 T2618 C2313 P11630 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ShardSplitTest-1371378996799/jetty3/index.20130616063657582
[junit4:junit4] 2> 1216584 T2618 C2313 P11630 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 1216584 T2618 C2313 P11630 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 1216584 T2618 C2313 P11630 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1216584 T2618 C2313 P11630 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1216586 T2618 C2313 P11630 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 1216678 T2564 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1216679 T2564 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:11630__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:11630_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:11630"}
[junit4:junit4] 2> 1216806 T2615 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1216806 T2632 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1216806 T2570 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1216806 T2583 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1216806 T2563 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1216806 T2599 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1216890 T2633 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1216894 T2633 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1216896 T2633 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1216902 T2633 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1216925 T2633 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1216925 T2633 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1371379014540/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1371378996799/jetty4/
[junit4:junit4] 2> 1216926 T2633 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@948ecbd
[junit4:junit4] 2> 1216926 T2633 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1216927 T2633 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1371378996799/jetty4
[junit4:junit4] 2> 1216927 T2633 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1371378996799/jetty4/index/
[junit4:junit4] 2> 1216928 T2633 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1371378996799/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1216928 T2633 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1371378996799/jetty4/index
[junit4:junit4] 2> 1216932 T2633 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7c178244 lockFactory=org.apache.lucene.store.NativeFSLockFactory@77d2ce85),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1216933 T2633 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1216936 T2633 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1216936 T2633 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1216937 T2633 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1216938 T2633 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1216939 T2633 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1216939 T2633 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1216940 T2633 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1216941 T2633 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1216941 T2633 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1216957 T2633 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1216965 T2633 oass.SolrIndexSearcher.<init> Opening Searcher@2f4a216b main
[junit4:junit4] 2> 1216965 T2633 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1371378996799/jetty4/tlog
[junit4:junit4] 2> 1216967 T2633 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1216967 T2633 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1216971 T2636 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2f4a216b main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1216974 T2633 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1216974 T2633 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:11641 collection:collection1 shard:shard2
[junit4:junit4] 2> 1216977 T2633 oasc.ZkController.register We are http://127.0.0.1:11641/collection1/ and leader is http://127.0.0.1:11621/collection1/
[junit4:junit4] 2> 1216978 T2633 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:11641
[junit4:junit4] 2> 1216978 T2633 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 1216978 T2633 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C2315 name=collection1 org.apache.solr.core.SolrCore@cbf97ea url=http://127.0.0.1:11641/collection1 node=127.0.0.1:11641_ C2315_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:11641_, base_url=http://127.0.0.1:11641}
[junit4:junit4] 2> 1216979 T2637 C2315 P11641 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 1216979 T2633 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1216979 T2637 C2315 P11641 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 1216980 T2637 C2315 P11641 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 1216980 T2637 C2315 P11641 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1216980 T2541 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 1216981 T2541 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1216981 T2637 C2315 P11641 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1216982 T2541 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1217002 T2541 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1217003 T2589 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:11641__collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 1217003 T2541 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 2> 1217004 T2541 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 2> 1217005 T2541 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1218007 T2541 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1218338 T2564 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1218339 T2564 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:11641__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:11641_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:11641"}
[junit4:junit4] 2> 1218351 T2563 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1218351 T2570 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1218351 T2583 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1218351 T2632 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1218351 T2599 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1218351 T2615 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1219005 T2589 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:11641__collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 1219005 T2589 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:11641__collection1&state=recovering&nodeName=127.0.0.1:11641_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2002
[junit4:junit4] 2> 1219010 T2541 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1220012 T2541 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C2315_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:11641_, base_url=http://127.0.0.1:11641}
[junit4:junit4] 2> 1221007 T2637 C2315 P11641 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:11621/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 1221007 T2637 C2315 P11641 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:11641 START replicas=[http://127.0.0.1:11621/collection1/] nUpdates=100
[junit4:junit4] 2> 1221008 T2637 C2315 P11641 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 1221008 T2637 C2315 P11641 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 1221008 T2637 C2315 P11641 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 1221008 T2637 C2315 P11641 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 1221009 T2637 C2315 P11641 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 1221010 T2637 C2315 P11641 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:11621/collection1/. core=collection1
[junit4:junit4] 2> 1221010 T2637 C2315 P11641 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1221014 T2541 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> ASYNC NEW_CORE C2316 name=collection1 org.apache.solr.core.SolrCore@315ee2b5 url=http://127.0.0.1:11621/collection1 node=127.0.0.1:11621_ C2316_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:11621_, base_url=http://127.0.0.1:11621, leader=true}
[junit4:junit4] 2> 1221018 T2590 C2316 P11621 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 1221022 T2591 C2316 P11621 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1221025 T2591 C2316 P11621 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@77ab4625 lockFactory=org.apache.lucene.store.NativeFSLockFactory@622e7e70),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1221025 T2591 C2316 P11621 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1221026 T2591 C2316 P11621 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@77ab4625 lockFactory=org.apache.lucene.store.NativeFSLockFactory@622e7e70),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@77ab4625 lockFactory=org.apache.lucene.store.NativeFSLockFactory@622e7e70),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1221027 T2591 C2316 P11621 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1221027 T2591 C2316 P11621 oass.SolrIndexSearcher.<init> Opening Searcher@7d9abe10 realtime
[junit4:junit4] 2> 1221028 T2591 C2316 P11621 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1221028 T2591 C2316 P11621 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> 1221029 T2637 C2315 P11641 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1221029 T2637 C2315 P11641 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 1221031 T2592 C2316 P11621 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1221032 T2592 C2316 P11621 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 1221033 T2637 C2315 P11641 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 1221033 T2637 C2315 P11641 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 1221033 T2637 C2315 P11641 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 1221035 T2592 C2316 P11621 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 1221036 T2637 C2315 P11641 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 1221037 T2637 C2315 P11641 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1371378996799/jetty4/index.20130616063702047
[junit4:junit4] 2> 1221037 T2637 C2315 P11641 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@49cbdc39 lockFactory=org.apache.lucene.store.NativeFSLockFactory@a45c298) fullCopy=false
[junit4:junit4] 2> 1221040 T2592 C2316 P11621 oasc.SolrCore.execute [collection1] webapp= path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 1221041 T2637 C2315 P11641 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 1221042 T2637 C2315 P11641 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 1221042 T2637 C2315 P11641 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 1221044 T2637 C2315 P11641 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7c178244 lockFactory=org.apache.lucene.store.NativeFSLockFactory@77d2ce85),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7c178244 lockFactory=org.apache.lucene.store.NativeFSLockFactory@77d2ce85),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1221045 T2637 C2315 P11641 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1221045 T2637 C2315 P11641 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 1221045 T2637 C2315 P11641 oass.SolrIndexSearcher.<init> Opening Searcher@77509c2c main
[junit4:junit4] 2> 1221046 T2636 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@77509c2c main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1221047 T2637 C2315 P11641 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1371378996799/jetty4/index.20130616063702047 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1371378996799/jetty4/index.20130616063702047;done=true>>]
[junit4:junit4] 2> 1221047 T2637 C2315 P11641 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1371378996799/jetty4/index.20130616063702047
[junit4:junit4] 2> 1221047 T2637 C2315 P11641 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ShardSplitTest-1371378996799/jetty4/index.20130616063702047
[junit4:junit4] 2> 1221048 T2637 C2315 P11641 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 1221048 T2637 C2315 P11641 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 1221048 T2637 C2315 P11641 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1221048 T2637 C2315 P11641 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1221050 T2637 C2315 P11641 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 1221363 T2564 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1221365 T2564 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:11641__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:11641_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:11641"}
[junit4:junit4] 2> 1221376 T2599 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1221376 T2583 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1221376 T2632 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1221376 T2570 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1221376 T2563 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1221376 T2615 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1222017 T2541 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1222019 T2541 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> ASYNC NEW_CORE C2317 name=collection1 org.apache.solr.core.SolrCore@55442889 url=http://127.0.0.1:11609/collection1 node=127.0.0.1:11609_ C2317_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:11609_, base_url=http://127.0.0.1:11609, leader=true}
[junit4:junit4] 2> 1222027 T2553 C2317 P11609 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1222030 T2553 C2317 P11609 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@29a5ced5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@e3e8cf8),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1222031 T2553 C2317 P11609 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1222032 T2553 C2317 P11609 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@29a5ced5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@e3e8cf8),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@29a5ced5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@e3e8cf8),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1222032 T2553 C2317 P11609 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1222033 T2553 C2317 P11609 oass.SolrIndexSearcher.<init> Opening Searcher@3da78977 main
[junit4:junit4] 2> 1222034 T2553 C2317 P11609 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1222034 T2567 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3da78977 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1222035 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 8
[junit4:junit4] 2> 1222048 T2593 C2316 P11621 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1222049 T2593 C2316 P11621 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@77ab4625 lockFactory=org.apache.lucene.store.NativeFSLockFactory@622e7e70),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@77ab4625 lockFactory=org.apache.lucene.store.NativeFSLockFactory@622e7e70),segFN=segments_3,generation=3}
[junit4:junit4] 2> 1222049 T2593 C2316 P11621 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 1222050 T2593 C2316 P11621 oass.SolrIndexSearcher.<init> Opening Searcher@4466f752 main
[junit4:junit4] 2> 1222050 T2593 C2316 P11621 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1222051 T2601 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4466f752 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1222051 T2593 C2316 P11621 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:11615/collection1/, StdNode: http://127.0.0.1:11630/collection1/, StdNode: http://127.0.0.1:11641/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 1222054 T2577 C2314 P11615 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1222055 T2577 C2314 P11615 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@56468a4d lockFactory=org.apache.lucene.store.NativeFSLockFactory@4f2ac5a),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@56468a4d lockFactory=org.apache.lucene.store.NativeFSLockFactory@4f2ac5a),segFN=segments_3,generation=3}
[junit4:junit4] 2> 1222055 T2577 C2314 P11615 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 1222056 T2577 C2314 P11615 oass.SolrIndexSearcher.<init> Opening Searcher@4c7fc0fd main
[junit4:junit4] 2> 1222057 T2577 C2314 P11615 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1222057 T2585 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4c7fc0fd main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1222058 T2577 C2314 P11615 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 4
[junit4:junit4] 2> C2315_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:11641_, base_url=http://127.0.0.1:11641}
[junit4:junit4] 2> 1222061 T2622 C2315 P11641 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> C2313_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:11630_, base_url=http://127.0.0.1:11630}
[junit4:junit4] 2> 1222062 T2605 C2313 P11630 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1222062 T2622 C2315 P11641 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7c178244 lockFactory=org.apache.lucene.store.NativeFSLockFactory@77d2ce85),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7c178244 lockFactory=org.apache.lucene.store.NativeFSLockFactory@77d2ce85),segFN=segments_3,generation=3}
[junit4:junit4] 2> 1222064 T2605 C2313 P11630 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6e2809da lockFactory=org.apache.lucene.store.NativeFSLockFactory@64a0eb2c),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6e2809da lockFactory=org.apache.lucene.store.NativeFSLockFactory@64a0eb2c),segFN=segments_3,generation=3}
[junit4:junit4] 2> 1222064 T2622 C2315 P11641 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 1222064 T2605 C2313 P11630 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 1222065 T2622 C2315 P11641 oass.SolrIndexSearcher.<init> Opening Searcher@4a69e0bd main
[junit4:junit4] 2> 1222066 T2605 C2313 P11630 oass.SolrIndexSearcher.<init> Opening Searcher@593d6195 main
[junit4:junit4] 2> 1222066 T2622 C2315 P11641 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1222067 T2636 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4a69e0bd main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1222067 T2617 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@593d6195 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1222068 T2622 C2315 P11641 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 1222067 T2605 C2313 P11630 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1222068 T2605 C2313 P11630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> 1222069 T2593 C2316 P11621 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 21
[junit4:junit4] 2> 1222070 T2541 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1222073 T2578 C2314 P11615 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 1222075 T2606 C2313 P11630 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 1222077 T2594 C2316 P11621 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 1222078 T2623 C2315 P11641 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 1224084 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1437995132615917568)} 0 2
[junit4:junit4] 2> 1224093 T2622 C2315 P11641 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=FROMLEADER&_version_=-1437995132621160448&update.from=http://127.0.0.1:11621/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1437995132621160448)} 0 2
[junit4:junit4] 2> 1224095 T2607 C2313 P11630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=FROMLEADER&_version_=-1437995132624306176&update.from=http://127.0.0.1:11615/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1437995132624306176)} 0 1
[junit4:junit4] 2> 1224096 T2577 C2314 P11615 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=TOLEADER&wt=javabin&version=2} {deleteByQuery=*:* (-1437995132624306176)} 0 6
[junit4:junit4] 2> 1224097 T2593 C2316 P11621 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1437995132621160448)} 0 10
[junit4:junit4] 2> 1224101 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!0 (1437995132634791936)]} 0 1
[junit4:junit4] 2> 1224106 T2622 C2315 P11641 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11621/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!0 (1437995132637937664)]} 0 0
[junit4:junit4] 2> 1224107 T2593 C2316 P11621 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!0 (1437995132637937664)]} 0 4
[junit4:junit4] 2> 1224110 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!1 (1437995132645277696)]} 0 0
[junit4:junit4] 2> 1224118 T2607 C2313 P11630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11615/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!1 (1437995132650520576)]} 0 0
[junit4:junit4] 2> 1224119 T2577 C2314 P11615 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11621/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[b!1 (1437995132650520576)]} 0 4
[junit4:junit4] 2> 1224120 T2593 C2316 P11621 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!1]} 0 7
[junit4:junit4] 2> 1224122 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!2 (1437995132657860608)]} 0 0
[junit4:junit4] 2> 1224126 T2607 C2313 P11630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11615/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!2 (1437995132659957760)]} 0 0
[junit4:junit4] 2> 1224127 T2579 C2314 P11615 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!2 (1437995132659957760)]} 0 3
[junit4:junit4] 2> 1224130 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!3 (1437995132666249216)]} 0 0
[junit4:junit4] 2> 1224136 T2622 C2315 P11641 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11621/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!3 (1437995132670443520)]} 0 0
[junit4:junit4] 2> 1224137 T2593 C2316 P11621 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!3 (1437995132670443520)]} 0 3
[junit4:junit4] 2> 1224139 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!4 (1437995132675686400)]} 0 0
[junit4:junit4] 2> 1224144 T2622 C2315 P11641 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11621/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!4 (1437995132678832128)]} 0 0
[junit4:junit4] 2> 1224145 T2593 C2316 P11621 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!4 (1437995132678832128)]} 0 3
[junit4:junit4] 2> 1224148 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!5 (1437995132685123584)]} 0 0
[junit4:junit4] 2> 1224155 T2622 C2315 P11641 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11621/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!5 (1437995132690366464)]} 0 0
[junit4:junit4] 2> 1224156 T2595 C2316 P11621 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11615/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[f!5 (1437995132690366464)]} 0 3
[junit4:junit4] 2> 1224156 T2579 C2314 P11615 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!5]} 0 4
[junit4:junit4] 2> 1224161 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!6 (1437995132697706496)]} 0 1
[junit4:junit4] 2> 1224170 T2607 C2313 P11630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11615/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!6 (1437995132705046528)]} 0 0
[junit4:junit4] 2> 1224171 T2577 C2314 P11615 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11621/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[g!6 (1437995132705046528)]} 0 4
[junit4:junit4] 2> 1224171 T2593 C2316 P11621 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!6]} 0 6
[junit4:junit4] 2> 1224174 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!7 (1437995132712386560)]} 0 0
[junit4:junit4] 2> 1224180 T2607 C2313 P11630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11615/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!7 (1437995132715532288)]} 0 0
[junit4:junit4] 2> 1224181 T2579 C2314 P11615 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!7 (1437995132715532288)]} 0 4
[junit4:junit4] 2> 1224183 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!8 (1437995132721823744)]} 0 0
[junit4:junit4] 2> 1224188 T2607 C2313 P11630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11615/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!8 (1437995132724969472)]} 0 0
[junit4:junit4] 2> 1224189 T2579 C2314 P11615 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!8 (1437995132724969472)]} 0 3
[junit4:junit4] 2> 1224191 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!9 (1437995132730212352)]} 0 0
[junit4:junit4] 2> 1224196 T2607 C2313 P11630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11615/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!9 (1437995132733358080)]} 0 0
[junit4:junit4] 2> 1224197 T2579 C2314 P11615 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!9 (1437995132733358080)]} 0 3
[junit4:junit4] 2> 1224199 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!10 (1437995132738600960)]} 0 0
[junit4:junit4] 2> 1224204 T2607 C2313 P11630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11615/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[k!10 (1437995132741746688)]} 0 0
[junit4:junit4] 2> 1224205 T2579 C2314 P11615 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!10 (1437995132741746688)]} 0 3
[junit4:junit4] 2> 1224207 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!11 (1437995132746989568)]} 0 0
[junit4:junit4] 2> 1224212 T2622 C2315 P11641 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11621/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[l!11 (1437995132750135296)]} 0 0
[junit4:junit4] 2> 1224213 T2593 C2316 P11621 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!11 (1437995132750135296)]} 0 3
[junit4:junit4] 2> 1224217 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!12 (1437995132757475328)]} 0 0
[junit4:junit4] 2> 1224224 T2622 C2315 P11641 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11621/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[m!12 (1437995132762718208)]} 0 0
[junit4:junit4] 2> 1224225 T2595 C2316 P11621 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11615/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[m!12 (1437995132762718208)]} 0 3
[junit4:junit4] 2> 1224226 T2579 C2314 P11615 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!12]} 0 6
[junit4:junit4] 2> 1224228 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!13 (1437995132769009664)]} 0 0
[junit4:junit4] 2> 1224235 T2607 C2313 P11630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11615/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[n!13 (1437995132774252544)]} 0 0
[junit4:junit4] 2> 1224236 T2577 C2314 P11615 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11621/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[n!13 (1437995132774252544)]} 0 3
[junit4:junit4] 2> 1224237 T2593 C2316 P11621 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!13]} 0 6
[junit4:junit4] 2> 1224239 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!14 (1437995132780544000)]} 0 0
[junit4:junit4] 2> 1224248 T2622 C2315 P11641 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11621/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[o!14 (1437995132787884032)]} 0 0
[junit4:junit4] 2> 1224249 T2595 C2316 P11621 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11615/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[o!14 (1437995132787884032)]} 0 3
[junit4:junit4] 2> 1224249 T2579 C2314 P11615 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!14]} 0 6
[junit4:junit4] 2> 1224253 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!15 (1437995132795224064)]} 0 0
[junit4:junit4] 2> 1224258 T2607 C2313 P11630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11615/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[p!15 (1437995132798369792)]} 0 0
[junit4:junit4] 2> 1224259 T2579 C2314 P11615 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!15 (1437995132798369792)]} 0 3
[junit4:junit4] 2> 1224262 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!16 (1437995132804661248)]} 0 0
[junit4:junit4] 2> 1224267 T2607 C2313 P11630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11615/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[q!16 (1437995132807806976)]} 0 0
[junit4:junit4] 2> 1224268 T2579 C2314 P11615 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!16 (1437995132807806976)]} 0 3
[junit4:junit4] 2> 1224270 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!17 (1437995132813049856)]} 0 0
[junit4:junit4] 2> 1224277 T2622 C2315 P11641 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11621/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[r!17 (1437995132818292736)]} 0 0
[junit4:junit4] 2> 1224278 T2595 C2316 P11621 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11615/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[r!17 (1437995132818292736)]} 0 3
[junit4:junit4] 2> 1224278 T2579 C2314 P11615 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!17]} 0 5
[junit4:junit4] 2> 1224282 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!18 (1437995132825632768)]} 0 0
[junit4:junit4] 2> 1224288 T2607 C2313 P11630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11615/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[s!18 (1437995132828778496)]} 0 0
[junit4:junit4] 2> 1224289 T2579 C2314 P11615 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!18 (1437995132828778496)]} 0 4
[junit4:junit4] 2> 1224292 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!19 (1437995132836118528)]} 0 0
[junit4:junit4] 2> 1224299 T2607 C2313 P11630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11615/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[t!19 (1437995132841361408)]} 0 0
[junit4:junit4] 2> 1224300 T2577 C2314 P11615 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11621/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[t!19 (1437995132841361408)]} 0 3
[junit4:junit4] 2> 1224300 T2593 C2316 P11621 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!19]} 0 5
[junit4:junit4] 2> 1224303 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!20 (1437995132847652864)]} 0 0
[junit4:junit4] 2> 1224309 T2622 C2315 P11641 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11621/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[u!20 (1437995132850798592)]} 0 0
[junit4:junit4] 2> 1224310 T2593 C2316 P11621 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!20 (1437995132850798592)]} 0 4
[junit4:junit4] 2> 1224312 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[v!21 (1437995132857090048)]} 0 0
[junit4:junit4] 2> 1224319 T2607 C2313 P11630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11615/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[v!21 (1437995132862332928)]} 0 0
[junit4:junit4] 2> 1224320 T2577 C2314 P11615 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11621/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[v!21 (1437995132862332928)]} 0 3
[junit4:junit4] 2> 1224320 T2593 C2316 P11621 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[v!21]} 0 5
[junit4:junit4] 2> 1224323 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[w!22 (1437995132868624384)]} 0 0
[junit4:junit4] 2> 1224328 T2607 C2313 P11630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11615/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[w!22 (1437995132871770112)]} 0 0
[junit4:junit4] 2> 1224329 T2579 C2314 P11615 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[w!22 (1437995132871770112)]} 0 3
[junit4:junit4] 2> 1224332 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[x!23 (1437995132878061568)]} 0 0
[junit4:junit4] 2> 1224339 T2622 C2315 P11641 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11621/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[x!23 (1437995132883304448)]} 0 0
[junit4:junit4] 2> 1224340 T2595 C2316 P11621 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11615/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[x!23 (1437995132883304448)]} 0 3
[junit4:junit4] 2> 1224340 T2579 C2314 P11615 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[x!23]} 0 5
[junit4:junit4] 2> 1224344 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[y!24 (1437995132890644480)]} 0 0
[junit4:junit4] 2> 1224349 T2622 C2315 P11641 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11621/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[y!24 (1437995132893790208)]} 0 0
[junit4:junit4] 2> 1224350 T2593 C2316 P11621 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[y!24 (1437995132893790208)]} 0 3
[junit4:junit4] 2> 1224354 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[z!25 (1437995132899033088)]} 0 2
[junit4:junit4] 2> 1224358 T2607 C2313 P11630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11615/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[z!25 (1437995132903227392)]} 0 0
[junit4:junit4] 2> 1224359 T2579 C2314 P11615 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[z!25 (1437995132903227392)]} 0 3
[junit4:junit4] 2> 1224361 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!26 (1437995132908470272)]} 0 0
[junit4:junit4] 2> 1224368 T2622 C2315 P11641 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11621/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!26 (1437995132912664576)]} 0 0
[junit4:junit4] 2> 1224369 T2593 C2316 P11621 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!26 (1437995132912664576)]} 0 4
[junit4:junit4] 2> 1224371 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!27 (1437995132918956032)]} 0 0
[junit4:junit4] 2> 1224377 T2607 C2313 P11630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11615/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!27 (1437995132922101760)]} 0 0
[junit4:junit4] 2> 1224378 T2579 C2314 P11615 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!27 (1437995132922101760)]} 0 4
[junit4:junit4] 2> 1224380 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!28 (1437995132928393216)]} 0 0
[junit4:junit4] 2> 1224388 T2607 C2313 P11630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11615/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!28 (1437995132933636096)]} 0 0
[junit4:junit4] 2> 1224389 T2577 C2314 P11615 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11621/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[c!28 (1437995132933636096)]} 0 4
[junit4:junit4] 2> 1224389 T2593 C2316 P11621 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!28]} 0 6
[junit4:junit4] 2> 1224392 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!29 (1437995132940976128)]} 0 0
[junit4:junit4] 2> 1224399 T2622 C2315 P11641 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11621/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!29 (1437995132946219008)]} 0 0
[junit4:junit4] 2> 1224400 T2595 C2316 P11621 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11615/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[d!29 (1437995132946219008)]} 0 3
[junit4:junit4] 2> 1224401 T2579 C2314 P11615 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!29]} 0 5
[junit4:junit4] 2> 1224403 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!30 (1437995132952510464)]} 0 0
[junit4:junit4] 2> 1224408 T2622 C2315 P11641 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11621/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!30 (1437995132955656192)]} 0 0
[junit4:junit4] 2> 1224409 T2593 C2316 P11621 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!30 (1437995132955656192)]} 0 3
[junit4:junit4] 2> 1224411 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!31 (1437995132960899072)]} 0 0
[junit4:junit4] 2> 1224418 T2622 C2315 P11641 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11621/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!31 (1437995132966141952)]} 0 0
[junit4:junit4] 2> 1224419 T2595 C2316 P11621 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11615/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[f!31 (1437995132966141952)]} 0 3
[junit4:junit4] 2> 1224420 T2579 C2314 P11615 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!31]} 0 6
[junit4:junit4] 2> 1224422 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!32 (1437995132972433408)]} 0 0
[junit4:junit4] 2> 1224429 T2607 C2313 P11630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11615/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!32 (1437995132977676288)]} 0 0
[junit4:junit4] 2> 1224430 T2577 C2314 P11615 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11621/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[g!32 (1437995132977676288)]} 0 3
[junit4:junit4] 2> 1224431 T2593 C2316 P11621 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!32]} 0 6
[junit4:junit4] 2> 1224433 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!33 (1437995132983967744)]} 0 0
[junit4:junit4] 2> 1224438 T2607 C2313 P11630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11615/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!33 (1437995132987113472)]} 0 0
[junit4:junit4] 2> 1224439 T2579 C2314 P11615 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!33 (1437995132987113472)]} 0 3
[junit4:junit4] 2> 1224441 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!34 (1437995132992356352)]} 0 0
[junit4:junit4] 2> 1224446 T2607 C2313 P11630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11615/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!34 (1437995132995502080)]} 0 0
[junit4:junit4] 2> 1224447 T2579 C2314 P11615 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!34 (1437995132995502080)]} 0 3
[junit4:junit4] 2> 1224449 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!35 (1437995133000744960)]} 0 0
[junit4:junit4] 2> 1224457 T2607 C2313 P11630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11615/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!35 (1437995133005987840)]} 0 0
[junit4:junit4] 2> 1224458 T2577 C2314 P11615 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11621/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[j!35 (1437995133005987840)]} 0 4
[junit4:junit4] 2> 1224458 T2593 C2316 P11621 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!35]} 0 6
[junit4:junit4] 2> 1224461 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!36 (1437995133013327872)]} 0 0
[junit4:junit4] 2> 1224468 T2607 C2313 P11630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11615/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[k!36 (1437995133018570752)]} 0 0
[junit4:junit4] 2> 1224469 T2577 C2314 P11615 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11621/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[k!36 (1437995133018570752)]} 0 3
[junit4:junit4] 2> 1224470 T2593 C2316 P11621 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!36]} 0 6
[junit4:junit4] 2> 1224472 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!37 (1437995133024862208)]} 0 0
[junit4:junit4] 2> 1224477 T2622 C2315 P11641 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11621/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[l!37 (1437995133028007936)]} 0 0
[junit4:junit4] 2> 1224478 T2593 C2316 P11621 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!37 (1437995133028007936)]} 0 3
[junit4:junit4] 2> 1224480 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!38 (1437995133033250816)]} 0 0
[junit4:junit4] 2> 1224485 T2622 C2315 P11641 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11621/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[m!38 (1437995133036396544)]} 0 0
[junit4:junit4] 2> 1224486 T2593 C2316 P11621 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!38 (1437995133036396544)]} 0 3
[junit4:junit4] 2> 1224489 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!39 (1437995133042688000)]} 0 0
[junit4:junit4] 2> 1224496 T2607 C2313 P11630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11615/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[n!39 (1437995133046882304)]} 0 0
[junit4:junit4] 2> 1224497 T2579 C2314 P11615 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!39 (1437995133046882304)]} 0 4
[junit4:junit4] 2> 1224500 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!40 (1437995133054222336)]} 0 0
[junit4:junit4] 2> 1224507 T2622 C2315 P11641 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11621/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[o!40 (1437995133059465216)]} 0 0
[junit4:junit4] 2> 1224508 T2595 C2316 P11621 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11615/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[o!40 (1437995133059465216)]} 0 3
[junit4:junit4] 2> 1224508 T2579 C2314 P11615 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!40]} 0 5
[junit4:junit4] 2> 1224511 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!41 (1437995133065756672)]} 0 0
[junit4:junit4] 2> 1224516 T2607 C2313 P11630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11615/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[p!41 (1437995133068902400)]} 0 0
[junit4:junit4] 2> 1224517 T2579 C2314 P11615 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!41 (1437995133068902400)]} 0 3
[junit4:junit4] 2> 1224519 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!42 (1437995133074145280)]} 0 0
[junit4:junit4] 2> 1224528 T2607 C2313 P11630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11615/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[q!42 (1437995133078339584)]} 0 1
[junit4:junit4] 2> 1224529 T2579 C2314 P11615 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!42 (1437995133078339584)]} 0 6
[junit4:junit4] 2> 1224532 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!43 (1437995133087776768)]} 0 0
[junit4:junit4] 2> 1224539 T2622 C2315 P11641 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11621/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[r!43 (1437995133093019648)]} 0 0
[junit4:junit4] 2> 1224540 T2595 C2316 P11621 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11615/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[r!43 (1437995133093019648)]} 0 3
[junit4:junit4] 2> 1224540 T2579 C2314 P11615 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!43]} 0 5
[junit4:junit4] 2> 1224543 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!44 (1437995133099311104)]} 0 0
[junit4:junit4] 2> 1224548 T2607 C2313 P11630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11615/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[s!44 (1437995133102456832)]} 0 0
[junit4:junit4] 2> 1224549 T2579 C2314 P11615 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!44 (1437995133102456832)]} 0 3
[junit4:junit4] 2> 1224552 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!45 (1437995133108748288)]} 0 0
[junit4:junit4] 2> 1224561 T2607 C2313 P11630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11615/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[t!45 (1437995133115039744)]} 0 0
[junit4:junit4] 2> 1224562 T2577 C2314 P11615 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11621/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[t!45 (1437995133115039744)]} 0 4
[junit4:junit4] 2> 1224563 T2593 C2316 P11621 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!45]} 0 8
[junit4:junit4] 2> 1224565 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!46 (1437995133122379776)]} 0 0
[junit4:junit4] 2> 1224570 T2622 C2315 P11641 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11621/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[u!46 (1437995133125525504)]} 0 0
[junit4:junit4] 2> 1224571 T2593 C2316 P11621 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!46 (1437995133125525504)]} 0 3
[junit4:junit4] 2> 1224573 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[v!47 (1437995133130768384)]} 0 0
[junit4:junit4] 2> 1224579 T2607 C2313 P11630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11615/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[v!47 (1437995133133914112)]} 0 0
[junit4:junit4] 2> 1224580 T2579 C2314 P11615 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[v!47 (1437995133133914112)]} 0 4
[junit4:junit4] 2> 1224582 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[w!48 (1437995133140205568)]} 0 0
[junit4:junit4] 2> 1224589 T2607 C2313 P11630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11615/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[w!48 (1437995133145448448)]} 0 0
[junit4:junit4] 2> 1224590 T2577 C2314 P11615 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11621/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[w!48 (1437995133145448448)]} 0 3
[junit4:junit4] 2> 1224590 T2593 C2316 P11621 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[w!48]} 0 5
[junit4:junit4] 2> 1224593 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[x!49 (1437995133151739904)]} 0 0
[junit4:junit4] 2> 1224598 T2622 C2315 P11641 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11621/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[x!49 (1437995133154885632)]} 0 0
[junit4:junit4] 2> 1224599 T2593 C2316 P11621 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[x!49 (1437995133154885632)]} 0 3
[junit4:junit4] 2> 1224604 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[y!50 (1437995133161177088)]} 0 1
[junit4:junit4] 2> 1224609 T2622 C2315 P11641 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11621/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[y!50 (1437995133165371392)]} 0 0
[junit4:junit4] 2> 1224610 T2593 C2316 P11621 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[y!50 (1437995133165371392)]} 0 4
[junit4:junit4] 2> 1224612 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[z!51 (1437995133171662848)]} 0 0
[junit4:junit4] 2> 1224621 T2607 C2313 P11630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11615/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[z!51 (1437995133177954304)]} 0 0
[junit4:junit4] 2> 1224622 T2577 C2314 P11615 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11621/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[z!51 (1437995133177954304)]} 0 4
[junit4:junit4] 2> 1224622 T2593 C2316 P11621 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[z!51]} 0 6
[junit4:junit4] 2> 1224626 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!52 (1437995133186342912)]} 0 0
[junit4:junit4] 2> 1224633 T2622 C2315 P11641 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11621/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!52 (1437995133191585792)]} 0 0
[junit4:junit4] 2> 1224634 T2595 C2316 P11621 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11615/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[a!52 (1437995133191585792)]} 0 3
[junit4:junit4] 2> 1224635 T2579 C2314 P11615 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!52]} 0 6
[junit4:junit4] 2> 1224638 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!53 (1437995133198925824)]} 0 0
[junit4:junit4] 2> 1224644 T2607 C2313 P11630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11615/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!53 (1437995133203120128)]} 0 0
[junit4:junit4] 2> 1224645 T2579 C2314 P11615 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!53 (1437995133203120128)]} 0 3
[junit4:junit4] 2> 1224647 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!54 (1437995133208363008)]} 0 0
[junit4:junit4] 2> 1224652 T2607 C2313 P11630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11615/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!54 (1437995133211508736)]} 0 0
[junit4:junit4] 2> 1224653 T2579 C2314 P11615 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!54 (1437995133211508736)]} 0 3
[junit4:junit4] 2> 1224656 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!55 (1437995133217800192)]} 0 0
[junit4:junit4] 2> 1224663 T2622 C2315 P11641 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11621/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!55 (1437995133223043072)]} 0 0
[junit4:junit4] 2> 1224664 T2595 C2316 P11621 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11615/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[d!55 (1437995133223043072)]} 0 3
[junit4:junit4] 2> 1224664 T2579 C2314 P11615 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!55]} 0 5
[junit4:junit4] 2> 1224667 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!56 (1437995133229334528)]} 0 0
[junit4:junit4] 2> 1224678 T2622 C2315 P11641 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11621/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!56 (1437995133234577408)]} 0 2
[junit4:junit4] 2> 1224678 T2595 C2316 P11621 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11615/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[e!56 (1437995133234577408)]} 0 6
[junit4:junit4] 2> 1224679 T2579 C2314 P11615 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!56]} 0 9
[junit4:junit4] 2> 1224681 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!57 (1437995133244014592)]} 0 0
[junit4:junit4] 2> 1224686 T2622 C2315 P11641 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11621/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!57 (1437995133247160320)]} 0 0
[junit4:junit4] 2> 1224687 T2593 C2316 P11621 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!57 (1437995133247160320)]} 0 3
[junit4:junit4] 2> 1224689 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!58 (1437995133252403200)]} 0 0
[junit4:junit4] 2> 1224696 T2607 C2313 P11630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11615/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!58 (1437995133257646080)]} 0 0
[junit4:junit4] 2> 1224697 T2577 C2314 P11615 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11621/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[g!58 (1437995133257646080)]} 0 3
[junit4:junit4] 2> 1224697 T2593 C2316 P11621 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!58]} 0 5
[junit4:junit4] 2> 1224700 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!59 (1437995133263937536)]} 0 0
[junit4:junit4] 2> 1224705 T2607 C2313 P11630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11615/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!59 (1437995133267083264)]} 0 0
[junit4:junit4] 2> 1224706 T2579 C2314 P11615 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!59 (1437995133267083264)]} 0 3
[junit4:junit4] 2> 1224708 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!60 (1437995133272326144)]} 0 0
[junit4:junit4] 2> 1224713 T2607 C2313 P11630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11615/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!60 (1437995133275471872)]} 0 0
[junit4:junit4] 2> 1224714 T2579 C2314 P11615 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!60 (1437995133275471872)]} 0 3
[junit4:junit4] 2> 1224716 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!61 (1437995133280714752)]} 0 0
[junit4:junit4] 2> 1224721 T2607 C2313 P11630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11615/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!61 (1437995133283860480)]} 0 0
[junit4:junit4] 2> 1224722 T2579 C2314 P11615 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!61 (1437995133283860480)]} 0 3
[junit4:junit4] 2> 1224724 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!62 (1437995133289103360)]} 0 0
[junit4:junit4] 2> 1224733 T2607 C2313 P11630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11615/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[k!62 (1437995133295394816)]} 0 0
[junit4:junit4] 2> 1224734 T2577 C2314 P11615 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11621/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[k!62 (1437995133295394816)]} 0 4
[junit4:junit4] 2> 1224734 T2593 C2316 P11621 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!62]} 0 6
[junit4:junit4] 2> 1224737 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!63 (1437995133302734848)]} 0 0
[junit4:junit4] 2> 1224742 T2622 C2315 P11641 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11621/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[l!63 (1437995133305880576)]} 0 0
[junit4:junit4] 2> 1224743 T2593 C2316 P11621 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!63 (1437995133305880576)]} 0 3
[junit4:junit4] 2> 1224746 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!64 (1437995133312172032)]} 0 0
[junit4:junit4] 2> 1224751 T2622 C2315 P11641 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11621/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[m!64 (1437995133315317760)]} 0 0
[junit4:junit4] 2> 1224752 T2593 C2316 P11621 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!64 (1437995133315317760)]} 0 3
[junit4:junit4] 2> 1224754 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!65 (1437995133320560640)]} 0 0
[junit4:junit4] 2> 1224761 T2607 C2313 P11630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11615/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[n!65 (1437995133325803520)]} 0 0
[junit4:junit4] 2> 1224762 T2577 C2314 P11615 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11621/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[n!65 (1437995133325803520)]} 0 3
[junit4:junit4] 2> 1224763 T2593 C2316 P11621 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!65]} 0 5
[junit4:junit4] 2> 1224766 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!66 (1437995133333143552)]} 0 0
[junit4:junit4] 2> 1224771 T2622 C2315 P11641 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11621/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[o!66 (1437995133336289280)]} 0 0
[junit4:junit4] 2> 1224772 T2593 C2316 P11621 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!66 (1437995133336289280)]} 0 3
[junit4:junit4] 2> 1224774 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!67 (1437995133341532160)]} 0 0
[junit4:junit4] 2> 1224779 T2607 C2313 P11630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11615/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[p!67 (1437995133344677888)]} 0 0
[junit4:junit4] 2> 1224780 T2579 C2314 P11615 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!67 (1437995133344677888)]} 0 3
[junit4:junit4] 2> 1224782 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!68 (1437995133349920768)]} 0 0
[junit4:junit4] 2> 1224787 T2607 C2313 P11630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11615/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[q!68 (1437995133353066496)]} 0 0
[junit4:junit4] 2> 1224788 T2579 C2314 P11615 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!68 (1437995133353066496)]} 0 3
[junit4:junit4] 2> 1224790 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!69 (1437995133358309376)]} 0 0
[junit4:junit4] 2> 1224797 T2622 C2315 P11641 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11621/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[r!69 (1437995133363552256)]} 0 0
[junit4:junit4] 2> 1224798 T2595 C2316 P11621 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11615/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[r!69 (1437995133363552256)]} 0 3
[junit4:junit4] 2> 1224798 T2579 C2314 P11615 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!69]} 0 5
[junit4:junit4] 2> 1224801 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!70 (1437995133369843712)]} 0 0
[junit4:junit4] 2> 1224808 T2607 C2313 P11630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11615/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[s!70 (1437995133375086592)]} 0 0
[junit4:junit4] 2> 1224809 T2577 C2314 P11615 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11621/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[s!70 (1437995133375086592)]} 0 3
[junit4:junit4] 2> 1224809 T2593 C2316 P11621 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!70]} 0 5
[junit4:junit4] 2> 1224812 T2553 C2317 P11609 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!71 (1437995133381378048)]} 0 0
[junit4:junit4] 2> 1224819 T2607 C2313 P11630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11615/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[t!71 (1437995133386620928)]} 0 0
[junit4:junit4] 2> 1224820 T2577 C2314 P11615 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11621/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[t!71 (1437995133386620928)]} 0 3
[junit4:junit4] 2> 1224820 T2593 C2316 P11621 oasu
[...truncated too long message...]
662,adds=662,deletesById=332,deletesByQuery=0,errors=0,cumulative_adds=721,cumulative_deletesById=332,cumulative_deletesByQuery=1,cumulative_errors=0}
[junit4:junit4] 2> 1392695 T2615 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 1392696 T2615 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 1392696 T2615 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 1392705 T2615 C2349 P11630 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6e2809da lockFactory=org.apache.lucene.store.NativeFSLockFactory@64a0eb2c),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6e2809da lockFactory=org.apache.lucene.store.NativeFSLockFactory@64a0eb2c),segFN=segments_5,generation=5}
[junit4:junit4] 2> 1392705 T2615 C2349 P11630 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 5
[junit4:junit4] 2> 1392709 T2615 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 1392710 T2615 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 1392710 T2615 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1371378996799/jetty3 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1371378996799/jetty3;done=false>>]
[junit4:junit4] 2> 1392710 T2615 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1371378996799/jetty3
[junit4:junit4] 2> 1392710 T2615 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1371378996799/jetty3/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1371378996799/jetty3/index;done=false>>]
[junit4:junit4] 2> 1392711 T2615 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1371378996799/jetty3/index
[junit4:junit4] 2> 1392711 T2615 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 1392711 T2615 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election/89874693934743562-127.0.0.1:11630__collection1-n_0000000001
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4] 2> at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:152)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:149)
[junit4:junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:149)
[junit4:junit4] 2> at org.apache.solr.cloud.ElectionContext.cancelElection(ElectionContext.java:63)
[junit4:junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:260)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:156)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:100)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4] 2>
[junit4:junit4] 2> 1392712 T2615 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 1392712 T2615 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1392713 T2615 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 1392713 T2615 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1392713 T2615 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 1392713 T2615 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:235)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:232)
[junit4:junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:232)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:84)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4] 2>
[junit4:junit4] 2> NOTE: test params are: codec=FastDecompressionCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST_DECOMPRESSION, chunkSize=492), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST_DECOMPRESSION, chunkSize=492)), sim=RandomSimilarityProvider(queryNorm=false,coord=no): {}, locale=ga_IE, timezone=America/Kralendijk
[junit4:junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_21 (64-bit)/cpus=16,threads=2,free=237004576,total=483393536
[junit4:junit4] 2> NOTE: All tests run in this JVM: [TestPropInjectDefaults, TestRTGBase, ConvertedLegacyTest, URLClassifyProcessorTest, BasicFunctionalityTest, TestDynamicFieldCollectionResource, TestCoreDiscovery, ShardRoutingTest, MultiTermTest, UpdateRequestProcessorFactoryTest, ShowFileRequestHandlerTest, TestManagedSchemaFieldResource, TestPostingsSolrHighlighter, CurrencyFieldXmlFileTest, PluginInfoTest, LukeRequestHandlerTest, TestMergePolicyConfig, StatelessScriptUpdateProcessorFactoryTest, TestLRUCache, SolrInfoMBeanTest, DirectUpdateHandlerTest, DirectSolrConnectionTest, PolyFieldTest, OpenCloseCoreStressTest, TestFaceting, TestFastLRUCache, TestDistributedSearch, DistanceFunctionTest, TestSolrQueryParserDefaultOperatorResource, TestSerializedLuceneMatchVersion, SpatialFilterTest, TestSolrQueryParser, TestStressVersions, DocValuesMultiTest, TestRandomFaceting, PathHierarchyTokenizerFactoryTest, TestManagedSchema, XsltUpdateRequestHandlerTest, PreAnalyzedUpdateProcessorTest, SortByFunctionTest, TestRandomDVFaceting, DistributedQueryElevationComponentTest, TestSchemaSimilarityResource, StandardRequestHandlerTest, AliasIntegrationTest, TestElisionMultitermQuery, TestPhraseSuggestions, TestAnalyzedSuggestions, TestQueryTypes, BinaryUpdateRequestHandlerTest, TestArbitraryIndexDir, UnloadDistributedZkTest, DocValuesTest, CopyFieldTest, ChaosMonkeyShardSplitTest, ZkCLITest, OverseerCollectionProcessorTest, IndexSchemaRuntimeFieldTest, TestBinaryField, CoreContainerCoreInitFailuresTest, RecoveryZkTest, SolrIndexConfigTest, TestFieldResource, ZkNodePropsTest, TestUniqueKeyFieldResource, IndexReaderFactoryTest, TestSweetSpotSimilarityFactory, NumericFieldsTest, BadCopyFieldTest, ClusterStateUpdateTest, SliceStateTest, TestPerFieldSimilarity, ShardSplitTest]
[junit4:junit4] Completed on J1 in 197.43s, 1 test, 1 error <<< FAILURES!
[...truncated 461 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:392: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:372: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build.xml:181: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/common-build.xml:437: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:1246: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:890: There were test failures: 297 suites, 1246 tests, 1 error, 13 ignored (7 assumptions)
Total time: 55 minutes 44 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-Tests-4.x-Java7 - Build # 1335 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java7/1335/
1 tests failed.
REGRESSION: org.apache.solr.cloud.SyncSliceTest.testDistribSearch
Error Message:
shard1 is not consistent. Got 305 from http://127.0.0.1:18162/z_eq/bb/collection1lastClient and got 5 from http://127.0.0.1:56844/z_eq/bb/collection1
Stack Trace:
java.lang.AssertionError: shard1 is not consistent. Got 305 from http://127.0.0.1:18162/z_eq/bb/collection1lastClient and got 5 from http://127.0.0.1:56844/z_eq/bb/collection1
at __randomizedtesting.SeedInfo.seed([1584830D3B8D6775:94620D154CD20749]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:963)
at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:238)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9281 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.SyncSliceTest
[junit4:junit4] 2> log4j:WARN No such property [conversionPattern] in org.apache.solr.util.SolrLogLayout.
[junit4:junit4] 2> 2232 T11 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /z_eq/bb
[junit4:junit4] 2> 2338 T11 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solrtest-SyncSliceTest-1371331876301
[junit4:junit4] 2> 2347 T11 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 2355 T12 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 2556 T11 oasc.ZkTestServer.run start zk server on port:63824
[junit4:junit4] 2> 2917 T11 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3085 T18 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@51f102bd name:ZooKeeperConnection Watcher:127.0.0.1:63824 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3086 T11 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3096 T11 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 3231 T11 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3235 T20 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@90affbc name:ZooKeeperConnection Watcher:127.0.0.1:63824/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3236 T11 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3267 T11 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 3276 T11 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 3332 T11 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 3375 T11 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 3384 T11 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 3429 T11 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 3515 T11 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 3517 T11 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 3629 T11 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 3631 T11 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 3639 T11 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 3641 T11 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 3649 T11 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 3651 T11 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 3659 T11 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 3661 T11 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 3669 T11 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 3670 T11 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 3679 T11 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 3680 T11 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 3688 T11 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 3690 T11 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 4993 T11 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 5470 T11 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:32576
[junit4:junit4] 2> 5572 T11 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 5711 T11 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 5712 T11 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1371331877661
[junit4:junit4] 2> 5741 T11 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1371331877661/solr.xml
[junit4:junit4] 2> 5761 T11 oasc.CoreContainer.<init> New CoreContainer 1924331862
[junit4:junit4] 2> 5762 T11 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1371331877661/'
[junit4:junit4] 2> 5763 T11 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1371331877661/'
[junit4:junit4] 2> 7133 T11 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 7134 T11 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 7135 T11 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 7136 T11 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 7136 T11 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 7137 T11 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 7138 T11 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 7138 T11 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 7139 T11 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 7243 T11 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 8108 T11 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 8115 T11 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:63824/solr
[junit4:junit4] 2> 8166 T11 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 8168 T11 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 8234 T33 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@46d48285 name:ZooKeeperConnection Watcher:127.0.0.1:63824 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 8235 T11 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 8249 T11 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 8268 T11 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 8273 T35 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2ec34670 name:ZooKeeperConnection Watcher:127.0.0.1:63824/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 8274 T11 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 8343 T11 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 8379 T11 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 8443 T11 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 8447 T11 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:32576_z_eq%2Fbb
[junit4:junit4] 2> 8454 T11 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:32576_z_eq%2Fbb
[junit4:junit4] 2> 8502 T11 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 8592 T11 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 8621 T11 oasc.Overseer.start Overseer (id=89871605866233859-127.0.0.1:32576_z_eq%2Fbb-n_0000000000) starting
[junit4:junit4] 2> 8649 T11 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 8666 T37 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 8667 T11 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 8672 T11 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 8676 T11 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 8701 T36 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 8813 T38 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 8814 T38 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 10214 T36 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 10217 T36 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:32576_z_eq%2Fbb",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:32576/z_eq/bb"}
[junit4:junit4] 2> 10218 T36 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 10281 T36 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 10318 T35 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 10824 T38 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1371331877661/collection1
[junit4:junit4] 2> 10825 T38 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 10827 T38 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 10828 T38 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 10832 T38 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1371331877661/collection1/'
[junit4:junit4] 2> 10835 T38 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1371331877661/collection1/lib/README' to classloader
[junit4:junit4] 2> 10836 T38 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1371331877661/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 11060 T38 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 11381 T38 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 11532 T38 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 11656 T38 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 14101 T38 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 14171 T38 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 14175 T38 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 15227 T38 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 15251 T38 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 15258 T38 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 15264 T38 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 15265 T38 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 15265 T38 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 15267 T38 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 15268 T38 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 15412 T38 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 15479 T38 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1371331877661/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1371331876300/control/data/
[junit4:junit4] 2> 15489 T38 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6069cf0d
[junit4:junit4] 2> 15899 T38 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 16055 T38 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/control/data
[junit4:junit4] 2> 16057 T38 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1371331876300/control/data/index/
[junit4:junit4] 2> 16058 T38 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1371331876300/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 16084 T38 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/control/data/index
[junit4:junit4] 2> 16674 T38 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@38dcf88e; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 16681 T38 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 18021 T38 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 18022 T38 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 18158 T38 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 18212 T38 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 18238 T38 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 18238 T38 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 18243 T38 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 18281 T38 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 18287 T38 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 18455 T38 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 18583 T38 oass.SolrIndexSearcher.<init> Opening Searcher@71811179 main
[junit4:junit4] 2> 18688 T38 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 18688 T38 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 18897 T39 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@71811179 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 18898 T38 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 18898 T38 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:32576/z_eq/bb collection:control_collection shard:shard1
[junit4:junit4] 2> 18915 T38 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4] 2> 18932 T38 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 18959 T38 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 18971 T38 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 18971 T38 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 18976 T38 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:32576/z_eq/bb/collection1/
[junit4:junit4] 2> 18977 T38 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 18977 T38 oasc.SyncStrategy.syncToMe http://127.0.0.1:32576/z_eq/bb/collection1/ has no replicas
[junit4:junit4] 2> 18978 T38 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:32576/z_eq/bb/collection1/
[junit4:junit4] 2> 18978 T38 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 19341 T36 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 19362 T35 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 19406 T38 oasc.ZkController.register We are http://127.0.0.1:32576/z_eq/bb/collection1/ and leader is http://127.0.0.1:32576/z_eq/bb/collection1/
[junit4:junit4] 2> 19411 T38 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:32576/z_eq/bb
[junit4:junit4] 2> 19412 T38 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 19412 T38 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 19413 T38 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 19418 T38 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 19431 T11 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 19432 T11 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 19525 T11 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 19552 T11 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 19558 T11 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 19577 T42 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6f6d5f64 name:ZooKeeperConnection Watcher:127.0.0.1:63824/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 19578 T11 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 19580 T11 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 19586 T11 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 19781 T11 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 19784 T11 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:46163
[junit4:junit4] 2> 19785 T11 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 19786 T11 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 19786 T11 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1371331893547
[junit4:junit4] 2> 19787 T11 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1371331893547/solr.xml
[junit4:junit4] 2> 19787 T11 oasc.CoreContainer.<init> New CoreContainer 816449872
[junit4:junit4] 2> 19788 T11 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1371331893547/'
[junit4:junit4] 2> 19789 T11 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1371331893547/'
[junit4:junit4] 2> 19914 T11 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 19915 T11 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 19916 T11 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 19916 T11 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 19917 T11 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 19918 T11 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 19918 T11 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 19919 T11 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 19919 T11 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 19920 T11 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 19935 T11 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 19936 T11 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:63824/solr
[junit4:junit4] 2> 19937 T11 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 19939 T11 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 19942 T53 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5397ab7d name:ZooKeeperConnection Watcher:127.0.0.1:63824 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 19943 T11 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 19946 T11 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 19957 T11 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 19960 T55 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5b392847 name:ZooKeeperConnection Watcher:127.0.0.1:63824/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 19960 T11 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 19972 T11 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 20878 T36 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 20893 T36 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:32576_z_eq%2Fbb_collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:32576_z_eq%2Fbb",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:32576/z_eq/bb"}
[junit4:junit4] 2> 20903 T35 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 20904 T55 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 20903 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 20979 T11 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46163_z_eq%2Fbb
[junit4:junit4] 2> 20981 T11 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:46163_z_eq%2Fbb
[junit4:junit4] 2> 20986 T55 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 20987 T35 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 20987 T42 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 20987 T35 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 20988 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 20991 T55 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 21009 T56 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 21010 T56 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 22417 T36 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 22419 T36 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:46163_z_eq%2Fbb",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:46163/z_eq/bb"}
[junit4:junit4] 2> 22419 T36 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 1
[junit4:junit4] 2> 22420 T36 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 22434 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 22434 T35 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 22434 T55 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 23016 T56 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1371331893547/collection1
[junit4:junit4] 2> 23017 T56 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 23018 T56 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 23019 T56 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 23021 T56 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1371331893547/collection1/'
[junit4:junit4] 2> 23024 T56 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty1-1371331893547/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 23025 T56 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty1-1371331893547/collection1/lib/README' to classloader
[junit4:junit4] 2> 23118 T56 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 23223 T56 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 23327 T56 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 23405 T56 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 24270 T56 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 24295 T56 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 24301 T56 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 24350 T56 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 24360 T56 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 24369 T56 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 24371 T56 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 24372 T56 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 24372 T56 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 24375 T56 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 24375 T56 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 24376 T56 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 24377 T56 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1371331893547/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty1/
[junit4:junit4] 2> 24378 T56 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6069cf0d
[junit4:junit4] 2> 24380 T56 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 24382 T56 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty1
[junit4:junit4] 2> 24384 T56 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty1/index/
[junit4:junit4] 2> 24385 T56 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 24387 T56 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty1/index
[junit4:junit4] 2> 24423 T56 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@27c73122; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 24424 T56 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 24430 T56 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 24431 T56 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 24432 T56 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 24436 T56 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 24439 T56 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 24440 T56 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 24441 T56 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 24444 T56 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 24445 T56 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 24473 T56 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 24488 T56 oass.SolrIndexSearcher.<init> Opening Searcher@2de37bfe main
[junit4:junit4] 2> 24490 T56 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 24491 T56 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 24520 T57 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2de37bfe main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 24530 T56 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 24531 T56 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:46163/z_eq/bb collection:collection1 shard:shard1
[junit4:junit4] 2> 24532 T56 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 24553 T56 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 24565 T56 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 24566 T56 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 24567 T56 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:46163/z_eq/bb/collection1/
[junit4:junit4] 2> 24567 T56 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 24568 T56 oasc.SyncStrategy.syncToMe http://127.0.0.1:46163/z_eq/bb/collection1/ has no replicas
[junit4:junit4] 2> 24569 T56 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:46163/z_eq/bb/collection1/
[junit4:junit4] 2> 24569 T56 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 25446 T36 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 25468 T35 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 25468 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 25468 T55 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 25506 T56 oasc.ZkController.register We are http://127.0.0.1:46163/z_eq/bb/collection1/ and leader is http://127.0.0.1:46163/z_eq/bb/collection1/
[junit4:junit4] 2> 25506 T56 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:46163/z_eq/bb
[junit4:junit4] 2> 25507 T56 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 25507 T56 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 25508 T56 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 25511 T56 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 25514 T11 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 25514 T11 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 25516 T11 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 25901 T11 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 25904 T11 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:50015
[junit4:junit4] 2> 25906 T11 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 25907 T11 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 25907 T11 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1371331899501
[junit4:junit4] 2> 25908 T11 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1371331899501/solr.xml
[junit4:junit4] 2> 25909 T11 oasc.CoreContainer.<init> New CoreContainer 614434290
[junit4:junit4] 2> 25910 T11 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1371331899501/'
[junit4:junit4] 2> 25911 T11 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1371331899501/'
[junit4:junit4] 2> 26084 T11 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 26084 T11 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 26085 T11 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 26085 T11 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 26086 T11 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 26087 T11 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 26087 T11 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 26088 T11 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 26088 T11 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 26089 T11 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 26105 T11 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 26106 T11 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:63824/solr
[junit4:junit4] 2> 26106 T11 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 26108 T11 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 26112 T69 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@39b57f1 name:ZooKeeperConnection Watcher:127.0.0.1:63824 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 26112 T11 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 26115 T11 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 26126 T11 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 26129 T71 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@712ab9c5 name:ZooKeeperConnection Watcher:127.0.0.1:63824/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 26129 T11 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 26142 T11 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 26978 T36 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 26980 T36 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:46163_z_eq%2Fbb_collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:46163_z_eq%2Fbb",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:46163/z_eq/bb"}
[junit4:junit4] 2> 26997 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 26998 T71 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 26997 T55 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 26997 T35 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 27148 T11 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50015_z_eq%2Fbb
[junit4:junit4] 2> 27150 T11 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50015_z_eq%2Fbb
[junit4:junit4] 2> 27154 T55 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 27155 T71 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 27155 T42 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 27155 T35 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 27156 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 27155 T71 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 27156 T35 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 27158 T55 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 27165 T72 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 27165 T72 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 28507 T36 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 28509 T36 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:50015_z_eq%2Fbb",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:50015/z_eq/bb"}
[junit4:junit4] 2> 28509 T36 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 28510 T36 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 28534 T71 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 28534 T55 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 28534 T35 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 28534 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 29170 T72 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1371331899501/collection1
[junit4:junit4] 2> 29170 T72 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 29172 T72 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 29173 T72 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 29176 T72 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1371331899501/collection1/'
[junit4:junit4] 2> 29178 T72 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty2-1371331899501/collection1/lib/README' to classloader
[junit4:junit4] 2> 29179 T72 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty2-1371331899501/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 29252 T72 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 29347 T72 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 29450 T72 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 29519 T72 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 30261 T72 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 30278 T72 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 30281 T72 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 30316 T72 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 30323 T72 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 30328 T72 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 30330 T72 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 30330 T72 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 30331 T72 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 30332 T72 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 30333 T72 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 30333 T72 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 30334 T72 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1371331899501/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty2/
[junit4:junit4] 2> 30334 T72 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6069cf0d
[junit4:junit4] 2> 30335 T72 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 30336 T72 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty2
[junit4:junit4] 2> 30337 T72 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty2/index/
[junit4:junit4] 2> 30337 T72 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 30338 T72 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty2/index
[junit4:junit4] 2> 30344 T72 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@15d6f752; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 30345 T72 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 30349 T72 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 30349 T72 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 30350 T72 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 30352 T72 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 30354 T72 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 30354 T72 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 30355 T72 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 30356 T72 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 30357 T72 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 30370 T72 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 30378 T72 oass.SolrIndexSearcher.<init> Opening Searcher@6de2eb01 main
[junit4:junit4] 2> 30380 T72 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 30380 T72 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 30396 T73 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6de2eb01 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 30403 T72 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 30403 T72 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:50015/z_eq/bb collection:collection1 shard:shard1
[junit4:junit4] 2> 30408 T72 oasc.ZkController.register We are http://127.0.0.1:50015/z_eq/bb/collection1/ and leader is http://127.0.0.1:46163/z_eq/bb/collection1/
[junit4:junit4] 2> 30409 T72 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:50015/z_eq/bb
[junit4:junit4] 2> 30409 T72 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 30410 T72 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> 30416 T72 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 30418 T11 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 30419 T11 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 30420 T11 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C0 name=collection1 org.apache.solr.core.SolrCore@761454de url=http://127.0.0.1:50015/z_eq/bb/collection1 node=127.0.0.1:50015_z_eq%2Fbb C0_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:50015_z_eq%2Fbb, base_url=http://127.0.0.1:50015/z_eq/bb}
[junit4:junit4] 2> 30427 T74 C0 P50015 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 30432 T74 C0 P50015 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 30432 T74 C0 P50015 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 30433 T74 C0 P50015 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 30436 T74 C0 P50015 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 30707 T11 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 30711 T11 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:18162
[junit4:junit4] 2> 30711 T11 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 30712 T11 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 30713 T11 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1371331904402
[junit4:junit4] 2> 30713 T11 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1371331904402/solr.xml
[junit4:junit4] 2> 30714 T11 oasc.CoreContainer.<init> New CoreContainer 1572254483
[junit4:junit4] 2> 30714 T11 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1371331904402/'
[junit4:junit4] 2> 30715 T11 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1371331904402/'
[junit4:junit4] 2> 30834 T11 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 30835 T11 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 30836 T11 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 30836 T11 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 30837 T11 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 30837 T11 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 30838 T11 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 30838 T11 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 30839 T11 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 30839 T11 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 30855 T11 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 30856 T11 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:63824/solr
[junit4:junit4] 2> 30857 T11 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 30858 T11 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 30861 T86 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3a1b1241 name:ZooKeeperConnection Watcher:127.0.0.1:63824 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 30862 T11 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 30865 T11 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 30880 T11 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 30882 T88 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@330b3697 name:ZooKeeperConnection Watcher:127.0.0.1:63824/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 30883 T11 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 30895 T11 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 31547 T36 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 31549 T36 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:50015_z_eq%2Fbb_collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:50015_z_eq%2Fbb",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:50015/z_eq/bb"}
[junit4:junit4] 2> 31565 T35 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 31566 T71 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 31566 T88 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 31566 T55 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 31565 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 31901 T11 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:18162_z_eq%2Fbb
[junit4:junit4] 2> 31903 T11 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:18162_z_eq%2Fbb
[junit4:junit4] 2> 31908 T55 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 31908 T35 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 31908 T42 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 31908 T71 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 31908 T88 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 31911 T71 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 31911 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 31910 T35 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 31912 T88 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 31917 T55 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 31932 T89 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 31933 T89 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 31958 T45 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:50015_z_eq%2Fbb_collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 31960 T45 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:50015_z_eq%2Fbb_collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 0 seconds.
[junit4:junit4] 2> 31961 T45 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:50015_z_eq%252Fbb_collection1&state=recovering&nodeName=127.0.0.1:50015_z_eq%252Fbb&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=29
[junit4:junit4] 2> 33072 T36 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 33074 T36 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:18162_z_eq%2Fbb",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:18162/z_eq/bb"}
[junit4:junit4] 2> 33075 T36 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 33076 T36 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 33092 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 33092 T71 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 33092 T88 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 33092 T55 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 33092 T35 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 33938 T89 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1371331904402/collection1
[junit4:junit4] 2> 33939 T89 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 33940 T89 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 33941 T89 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 33947 T89 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1371331904402/collection1/'
[junit4:junit4] 2> 33949 T89 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty3-1371331904402/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 33950 T89 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty3-1371331904402/collection1/lib/README' to classloader
[junit4:junit4] 2> 34051 T89 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> ASYNC NEW_CORE C1 name=collection1 org.apache.solr.core.SolrCore@761454de url=http://127.0.0.1:50015/z_eq/bb/collection1 node=127.0.0.1:50015_z_eq%2Fbb C1_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:50015_z_eq%2Fbb, base_url=http://127.0.0.1:50015/z_eq/bb}
[junit4:junit4] 2> 34197 T74 C1 P50015 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:46163/z_eq/bb/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 34212 T74 C1 P50015 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4] 2> 34212 T89 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 34243 T74 C1 P50015 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:50015/z_eq/bb START replicas=[http://127.0.0.1:46163/z_eq/bb/collection1/] nUpdates=100
[junit4:junit4] 2> 34258 T74 C1 P50015 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 34258 T74 C1 P50015 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 34259 T74 C1 P50015 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 34259 T74 C1 P50015 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 34260 T74 C1 P50015 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 34261 T74 C1 P50015 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:46163/z_eq/bb/collection1/. core=collection1
[junit4:junit4] 2> 34262 T74 C1 P50015 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 34316 T89 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> ASYNC NEW_CORE C2 name=collection1 org.apache.solr.core.SolrCore@5cc771a9 url=http://127.0.0.1:46163/z_eq/bb/collection1 node=127.0.0.1:46163_z_eq%2Fbb C2_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:46163_z_eq%2Fbb, base_url=http://127.0.0.1:46163/z_eq/bb, leader=true}
[junit4:junit4] 2> 34334 T46 C2 P46163 oasc.SolrCore.execute [collection1] webapp=/z_eq/bb path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=19
[junit4:junit4] 2> 34369 T89 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 34394 T47 C2 P46163 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 34401 T47 C2 P46163 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@27c73122; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 34401 T47 C2 P46163 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 34408 T47 C2 P46163 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@27c73122; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@27c73122; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> 34410 T47 C2 P46163 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 34413 T47 C2 P46163 oass.SolrIndexSearcher.<init> Opening Searcher@54170d32 realtime
[junit4:junit4] 2> 34413 T47 C2 P46163 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 34414 T47 C2 P46163 oasup.LogUpdateProcessor.finish [collection1] webapp=/z_eq/bb path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 99
[junit4:junit4] 2> 34512 T74 C1 P50015 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 34513 T74 C1 P50015 oascsi.HttpClientUtil.createClient Creating new http client, config:connTimeout=5000&socketTimeout=20000&allowCompression=false&maxConnections=10000&maxConnectionsPerHost=10000
[junit4:junit4] 2> 34554 T74 C1 P50015 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> ASYNC NEW_CORE C3 name=collection1 org.apache.solr.core.SolrCore@5cc771a9 url=http://127.0.0.1:46163/z_eq/bb/collection1 node=127.0.0.1:46163_z_eq%2Fbb C3_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:46163_z_eq%2Fbb, base_url=http://127.0.0.1:46163/z_eq/bb, leader=true}
[junit4:junit4] 2> 34672 T48 C3 P46163 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 34674 T48 C3 P46163 oasc.SolrCore.execute [collection1] webapp=/z_eq/bb path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=116
[junit4:junit4] 2> ASYNC NEW_CORE C4 name=collection1 org.apache.solr.core.SolrCore@761454de url=http://127.0.0.1:50015/z_eq/bb/collection1 node=127.0.0.1:50015_z_eq%2Fbb C4_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:50015_z_eq%2Fbb, base_url=http://127.0.0.1:50015/z_eq/bb}
[junit4:junit4] 2> 34676 T74 C4 P50015 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 34677 T74 C4 P50015 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 34677 T74 C4 P50015 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 34682 T48 C3 P46163 oasc.SolrCore.execute [collection1] webapp=/z_eq/bb path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=1
[junit4:junit4] 2> 34684 T74 C4 P50015 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 34687 T74 C4 P50015 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty2/index.20130615193148646
[junit4:junit4] 2> 34688 T74 C4 P50015 oash.SnapPuller.fetchLatestIndex Starting download to NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty2/index.20130615193148646 lockFactory=org.apache.lucene.store.NativeFSLockFactory@91d1bc6; maxCacheMB=48.0 maxMergeSizeMB=4.0) fullCopy=false
[junit4:junit4] 2> 34706 T48 C3 P46163 oasc.SolrCore.execute [collection1] webapp=/z_eq/bb path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=7
[junit4:junit4] 2> 34722 T74 C4 P50015 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 34729 T74 C4 P50015 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 34729 T74 C4 P50015 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 34740 T74 C4 P50015 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@15d6f752; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@15d6f752; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> 34740 T74 C4 P50015 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 34741 T74 C4 P50015 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 34742 T74 C4 P50015 oass.SolrIndexSearcher.<init> Opening Searcher@4f61fd51 main
[junit4:junit4] 2> 34757 T73 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4f61fd51 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 34759 T74 C4 P50015 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty2/index.20130615193148646 [CachedDir<<refCount=0;path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty2/index.20130615193148646;done=true>>]
[junit4:junit4] 2> 34760 T74 C4 P50015 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty2/index.20130615193148646
[junit4:junit4] 2> 34760 T74 C4 P50015 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty2/index.20130615193148646
[junit4:junit4] 2> 34768 T74 C4 P50015 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 34768 T74 C4 P50015 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 34769 T74 C4 P50015 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 34769 T74 C4 P50015 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 34771 T74 C4 P50015 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 35192 T89 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 35208 T89 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 35212 T89 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 35242 T89 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 35258 T89 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 35264 T89 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 35266 T89 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 35267 T89 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 35267 T89 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 35269 T89 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 35269 T89 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 35269 T89 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 35270 T89 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1371331904402/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty3/
[junit4:junit4] 2> 35270 T89 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6069cf0d
[junit4:junit4] 2> 35271 T89 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 35272 T89 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty3
[junit4:junit4] 2> 35273 T89 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty3/index/
[junit4:junit4] 2> 35274 T89 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 35274 T89 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty3/index
[junit4:junit4] 2> 35280 T89 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6dc9b99a; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 35281 T89 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 35285 T89 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 35286 T89 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 35287 T89 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 35289 T89 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 35291 T89 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 35292 T89 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 35303 T89 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 35304 T89 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 35305 T89 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 35316 T89 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 35324 T89 oass.SolrIndexSearcher.<init> Opening Searcher@206fb381 main
[junit4:junit4] 2> 35325 T89 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 35326 T89 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 35336 T92 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@206fb381 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 35340 T89 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 35341 T89 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:18162/z_eq/bb collection:collection1 shard:shard1
[junit4:junit4] 2> 35346 T89 oasc.ZkController.register We are http://127.0.0.1:18162/z_eq/bb/collection1/ and leader is http://127.0.0.1:46163/z_eq/bb/collection1/
[junit4:junit4] 2> 35346 T89 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:18162/z_eq/bb
[junit4:junit4] 2> 35347 T89 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 35347 T89 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C5 name=collection1 org.apache.solr.core.SolrCore@4d801dc2 url=http://127.0.0.1:18162/z_eq/bb/collection1 node=127.0.0.1:18162_z_eq%2Fbb C5_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:18162_z_eq%2Fbb, base_url=http://127.0.0.1:18162/z_eq/bb}
[junit4:junit4] 2> 35348 T93 C5 P18162 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 35348 T93 C5 P18162 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 35348 T89 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 35349 T93 C5 P18162 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 35349 T93 C5 P18162 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 35350 T11 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 35351 T11 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 35351 T93 C5 P18162 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 35352 T11 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 35375 T49 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:18162_z_eq%2Fbb_collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 35573 T11 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 35577 T11 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:56844
[junit4:junit4] 2> 35579 T11 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 35579 T11 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 35580 T11 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1371331909333
[junit4:junit4] 2> 35581 T11 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1371331909333/solr.xml
[junit4:junit4] 2> 35582 T11 oasc.CoreContainer.<init> New CoreContainer 804907818
[junit4:junit4] 2> 35583 T11 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1371331909333/'
[junit4:junit4] 2> 35584 T11 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1371331909333/'
[junit4:junit4] 2> 35749 T11 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 35750 T11 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 35751 T11 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 35752 T11 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 35753 T11 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 35753 T11 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 35754 T11 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 35755 T11 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 35756 T11 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 35757 T11 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 35776 T11 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 35777 T11 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:63824/solr
[junit4:junit4] 2> 35778 T11 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 35780 T11 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 35783 T105 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6124f16a name:ZooKeeperConnection Watcher:127.0.0.1:63824 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 35784 T11 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 35788 T11 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 35803 T11 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 35806 T107 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@45f81de9 name:ZooKeeperConnection Watcher:127.0.0.1:63824/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 35806 T11 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 35819 T11 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 36102 T36 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 36104 T36 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:50015_z_eq%2Fbb_collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:50015_z_eq%2Fbb",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:50015/z_eq/bb"}
[junit4:junit4] 2> 36111 T36 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:18162_z_eq%2Fbb_collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:18162_z_eq%2Fbb",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:18162/z_eq/bb"}
[junit4:junit4] 2> 36124 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 36124 T71 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 36124 T55 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 36124 T107 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 36124 T88 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 36124 T35 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 36378 T49 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:18162_z_eq%2Fbb_collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 36379 T49 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:18162_z_eq%252Fbb_collection1&state=recovering&nodeName=127.0.0.1:18162_z_eq%252Fbb&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1004
[junit4:junit4] 2> 36825 T11 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56844_z_eq%2Fbb
[junit4:junit4] 2> 36828 T11 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56844_z_eq%2Fbb
[junit4:junit4] 2> 36832 T107 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 36832 T42 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 36833 T71 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 36833 T35 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 36832 T55 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 36834 T35 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 36834 T71 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 36833 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 36833 T88 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 36837 T107 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 36837 T88 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 36838 T55 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 36845 T108 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 36846 T108 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 37635 T36 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 37636 T36 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:56844_z_eq%2Fbb",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:56844/z_eq/bb"}
[junit4:junit4] 2> 37637 T36 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 37637 T36 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 37652 T35 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 37652 T107 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 37652 T88 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 37652 T71 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 37652 T55 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 37652 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 37849 T108 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1371331909333/collection1
[junit4:junit4] 2> 37850 T108 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 37851 T108 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 37851 T108 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 37854 T108 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1371331909333/collection1/'
[junit4:junit4] 2> 37856 T108 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty4-1371331909333/collection1/lib/README' to classloader
[junit4:junit4] 2> 37857 T108 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty4-1371331909333/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 37927 T108 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 38015 T108 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 38118 T108 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 38151 T108 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> ASYNC NEW_CORE C6 name=collection1 org.apache.solr.core.SolrCore@4d801dc2 url=http://127.0.0.1:18162/z_eq/bb/collection1 node=127.0.0.1:18162_z_eq%2Fbb C6_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:18162_z_eq%2Fbb, base_url=http://127.0.0.1:18162/z_eq/bb}
[junit4:junit4] 2> 38381 T93 C6 P18162 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:46163/z_eq/bb/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 38381 T93 C6 P18162 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:18162/z_eq/bb START replicas=[http://127.0.0.1:46163/z_eq/bb/collection1/] nUpdates=100
[junit4:junit4] 2> 38382 T93 C6 P18162 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 38383 T93 C6 P18162 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 38383 T93 C6 P18162 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 38383 T93 C6 P18162 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 38384 T93 C6 P18162 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 38384 T93 C6 P18162 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:46163/z_eq/bb/collection1/. core=collection1
[junit4:junit4] 2> 38385 T93 C6 P18162 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C7 name=collection1 org.apache.solr.core.SolrCore@5cc771a9 url=http://127.0.0.1:46163/z_eq/bb/collection1 node=127.0.0.1:46163_z_eq%2Fbb C7_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:46163_z_eq%2Fbb, base_url=http://127.0.0.1:46163/z_eq/bb, leader=true}
[junit4:junit4] 2> 38387 T46 C7 P46163 oasc.SolrCore.execute [collection1] webapp=/z_eq/bb path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 38397 T50 C7 P46163 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 38460 T50 C7 P46163 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@27c73122; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@27c73122; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> 38461 T50 C7 P46163 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 38463 T50 C7 P46163 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 38464 T50 C7 P46163 oasup.LogUpdateProcessor.finish [collection1] webapp=/z_eq/bb path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 67
[junit4:junit4] 2> 38466 T93 C6 P18162 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 38466 T93 C6 P18162 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 38470 T48 C7 P46163 oasc.SolrCore.execute [collection1] webapp=/z_eq/bb path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4] 2> 38471 T93 C6 P18162 oash.SnapPuller.fetchLatestIndex Master's generation: 3
[junit4:junit4] 2> 38471 T93 C6 P18162 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 38472 T93 C6 P18162 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 38475 T48 C7 P46163 oasc.SolrCore.execute [collection1] webapp=/z_eq/bb path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=3&version=2} status=0 QTime=1
[junit4:junit4] 2> 38476 T93 C6 P18162 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 38478 T93 C6 P18162 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty3/index.20130615193152438
[junit4:junit4] 2> 38479 T93 C6 P18162 oash.SnapPuller.fetchLatestIndex Starting download to NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty3/index.20130615193152438 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6b206820; maxCacheMB=48.0 maxMergeSizeMB=4.0) fullCopy=false
[junit4:junit4] 2> 38484 T48 C7 P46163 oasc.SolrCore.execute [collection1] webapp=/z_eq/bb path=/replication params={file=segments_3&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=3} status=0 QTime=0
[junit4:junit4] 2> 38486 T93 C6 P18162 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> ASYNC NEW_CORE C8 name=collection1 org.apache.solr.core.SolrCore@4d801dc2 url=http://127.0.0.1:18162/z_eq/bb/collection1 node=127.0.0.1:18162_z_eq%2Fbb C8_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:18162_z_eq%2Fbb, base_url=http://127.0.0.1:18162/z_eq/bb}
[junit4:junit4] 2> 38498 T93 C8 P18162 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 38499 T93 C8 P18162 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 38506 T93 C8 P18162 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6dc9b99a; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6dc9b99a; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> 38507 T93 C8 P18162 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 38508 T93 C8 P18162 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 38510 T93 C8 P18162 oass.SolrIndexSearcher.<init> Opening Searcher@7d38b67c main
[junit4:junit4] 2> 38513 T92 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7d38b67c main{StandardDirectoryReader(segments_3:1:nrt)}
[junit4:junit4] 2> 38515 T93 C8 P18162 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty3/index.20130615193152438 [CachedDir<<refCount=0;path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty3/index.20130615193152438;done=true>>]
[junit4:junit4] 2> 38515 T93 C8 P18162 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty3/index.20130615193152438
[junit4:junit4] 2> 38516 T93 C8 P18162 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty3/index.20130615193152438
[junit4:junit4] 2> 38517 T93 C8 P18162 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 38518 T93 C8 P18162 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 38518 T93 C8 P18162 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 38519 T93 C8 P18162 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 38521 T93 C8 P18162 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 38728 T108 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 38743 T108 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 38748 T108 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 38785 T108 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 38807 T108 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 38814 T108 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 38816 T108 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 38817 T108 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 38817 T108 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 38819 T108 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 38819 T108 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 38820 T108 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 38820 T108 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1371331909333/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty4/
[junit4:junit4] 2> 38821 T108 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6069cf0d
[junit4:junit4] 2> 38822 T108 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 38823 T108 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty4
[junit4:junit4] 2> 38824 T108 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty4/index/
[junit4:junit4] 2> 38825 T108 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 38825 T108 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty4/index
[junit4:junit4] 2> 38835 T108 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@a31785a; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 38836 T108 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 38840 T108 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 38840 T108 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 38841 T108 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 38843 T108 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 38844 T108 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 38844 T108 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 38849 T108 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 38851 T108 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 38852 T108 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 38879 T108 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 38891 T108 oass.SolrIndexSearcher.<init> Opening Searcher@7f8574aa main
[junit4:junit4] 2> 38893 T108 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 38893 T108 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 38903 T111 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7f8574aa main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 38908 T108 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 38909 T108 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:56844/z_eq/bb collection:collection1 shard:shard1
[junit4:junit4] 2> 38914 T108 oasc.ZkController.register We are http://127.0.0.1:56844/z_eq/bb/collection1/ and leader is http://127.0.0.1:46163/z_eq/bb/collection1/
[junit4:junit4] 2> 38915 T108 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:56844/z_eq/bb
[junit4:junit4] 2> 38915 T108 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 38915 T108 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C9 name=collection1 org.apache.solr.core.SolrCore@757e2379 url=http://127.0.0.1:56844/z_eq/bb/collection1 node=127.0.0.1:56844_z_eq%2Fbb C9_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:56844_z_eq%2Fbb, base_url=http://127.0.0.1:56844/z_eq/bb}
[junit4:junit4] 2> 38916 T112 C9 P56844 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 38917 T108 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 38917 T112 C9 P56844 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 38918 T112 C9 P56844 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 38918 T112 C9 P56844 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 38919 T11 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 38919 T11 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 38920 T11 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 38921 T112 C9 P56844 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 38938 T11 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 38941 T51 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:56844_z_eq%2Fbb_collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 38941 T11 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 2> 38942 T11 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 2> 38944 T11 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 39159 T36 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 39161 T36 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:18162_z_eq%2Fbb_collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:18162_z_eq%2Fbb",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:18162/z_eq/bb"}
[junit4:junit4] 2> 39168 T36 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:56844_z_eq%2Fbb_collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:56844_z_eq%2Fbb",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:56844/z_eq/bb"}
[junit4:junit4] 2> 39181 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 39181 T71 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 39181 T55 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 39181 T88 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 39181 T107 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 39181 T35 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 39943 T51 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:56844_z_eq%2Fbb_collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 39944 T51 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:56844_z_eq%252Fbb_collection1&state=recovering&nodeName=127.0.0.1:56844_z_eq%252Fbb&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1003
[junit4:junit4] 2> 39948 T11 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 40953 T11 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C9_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:56844_z_eq%2Fbb, base_url=http://127.0.0.1:56844/z_eq/bb}
[junit4:junit4] 2> 41947 T112 C9 P56844 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:46163/z_eq/bb/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 41948 T112 C9 P56844 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:56844/z_eq/bb START replicas=[http://127.0.0.1:46163/z_eq/bb/collection1/] nUpdates=100
[junit4:junit4] 2> 41948 T112 C9 P56844 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 41949 T112 C9 P56844 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 41949 T112 C9 P56844 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 41950 T112 C9 P56844 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 41950 T112 C9 P56844 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 41951 T112 C9 P56844 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:46163/z_eq/bb/collection1/. core=collection1
[junit4:junit4] 2> 41951 T112 C9 P56844 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C10 name=collection1 org.apache.solr.core.SolrCore@5cc771a9 url=http://127.0.0.1:46163/z_eq/bb/collection1 node=127.0.0.1:46163_z_eq%2Fbb C10_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:46163_z_eq%2Fbb, base_url=http://127.0.0.1:46163/z_eq/bb, leader=true}
[junit4:junit4] 2> 41953 T46 C10 P46163 oasc.SolrCore.execute [collection1] webapp=/z_eq/bb path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 41957 T11 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 41968 T45 C10 P46163 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 41985 T45 C10 P46163 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=3
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@27c73122; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@27c73122; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@27c73122; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> 41986 T45 C10 P46163 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4:junit4] 2> 41988 T45 C10 P46163 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 41989 T45 C10 P46163 oasup.LogUpdateProcessor.finish [collection1] webapp=/z_eq/bb path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 22
[junit4:junit4] 2> 41991 T112 C9 P56844 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 41991 T112 C9 P56844 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 41995 T48 C10 P46163 oasc.SolrCore.execute [collection1] webapp=/z_eq/bb path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4] 2> 41997 T112 C9 P56844 oash.SnapPuller.fetchLatestIndex Master's generation: 4
[junit4:junit4] 2> 41997 T112 C9 P56844 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 41998 T112 C9 P56844 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 42002 T48 C10 P46163 oasc.SolrCore.execute [collection1] webapp=/z_eq/bb path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=4&version=2} status=0 QTime=1
[junit4:junit4] 2> 42003 T112 C9 P56844 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 42005 T112 C9 P56844 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty4/index.20130615193155965
[junit4:junit4] 2> 42007 T112 C9 P56844 oash.SnapPuller.fetchLatestIndex Starting download to NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty4/index.20130615193155965 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1f864014; maxCacheMB=48.0 maxMergeSizeMB=4.0) fullCopy=false
[junit4:junit4] 2> 42012 T48 C10 P46163 oasc.SolrCore.execute [collection1] webapp=/z_eq/bb path=/replication params={file=segments_4&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=4} status=0 QTime=0
[junit4:junit4] 2> 42015 T112 C9 P56844 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 42018 T112 C9 P56844 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 42019 T112 C9 P56844 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 42025 T112 C9 P56844 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@a31785a; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@a31785a; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> 42026 T112 C9 P56844 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4:junit4] 2> 42027 T112 C9 P56844 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 42028 T112 C9 P56844 oass.SolrIndexSearcher.<init> Opening Searcher@64c88cb main
[junit4:junit4] 2> 42031 T111 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@64c88cb main{StandardDirectoryReader(segments_4:1:nrt)}
[junit4:junit4] 2> 42033 T112 C9 P56844 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty4/index.20130615193155965 [CachedDir<<refCount=0;path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty4/index.20130615193155965;done=true>>]
[junit4:junit4] 2> 42034 T112 C9 P56844 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty4/index.20130615193155965
[junit4:junit4] 2> 42034 T112 C9 P56844 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty4/index.20130615193155965
[junit4:junit4] 2> 42036 T112 C9 P56844 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 42036 T112 C9 P56844 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 42037 T112 C9 P56844 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 42037 T112 C9 P56844 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 42040 T112 C9 P56844 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 42199 T36 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 42200 T36 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:56844_z_eq%2Fbb_collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:56844_z_eq%2Fbb",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:56844/z_eq/bb"}
[junit4:junit4] 2> 42214 T107 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 42214 T55 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 42214 T71 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 42214 T88 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 42214 T35 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 42214 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 42962 T11 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 42964 T11 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> ASYNC NEW_CORE C11 name=collection1 org.apache.solr.core.SolrCore@a1172c5 url=http://127.0.0.1:32576/z_eq/bb/collection1 node=127.0.0.1:32576_z_eq%2Fbb C11_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:32576_z_eq%2Fbb, base_url=http://127.0.0.1:32576/z_eq/bb, leader=true}
[junit4:junit4] 2> 42975 T25 C11 P32576 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 42980 T25 C11 P32576 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@38dcf88e; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 42980 T25 C11 P32576 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 42985 T25 C11 P32576 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@38dcf88e; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@38dcf88e; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> 42985 T25 C11 P32576 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 42987 T25 C11 P32576 oass.SolrIndexSearcher.<init> Opening Searcher@18740ad1 main
[junit4:junit4] 2> 42988 T25 C11 P32576 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 42990 T39 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@18740ad1 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 42992 T25 C11 P32576 oasup.LogUpdateProcessor.finish [collection1] webapp=/z_eq/bb path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 17
[junit4:junit4] 2> 43020 T47 C10 P46163 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 43025 T47 C10 P46163 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=4
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@27c73122; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@27c73122; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@27c73122; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@27c73122; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5}
[junit4:junit4] 2> 43025 T47 C10 P46163 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 5
[junit4:junit4] 2> 43026 T47 C10 P46163 oass.SolrIndexSearcher.<init> Opening Searcher@56d1bc6b main
[junit4:junit4] 2> 43027 T47 C10 P46163 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 43029 T57 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@56d1bc6b main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 43038 T47 C10 P46163 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:50015/z_eq/bb/collection1/, StdNode: http://127.0.0.1:18162/z_eq/bb/collection1/, StdNode: http://127.0.0.1:56844/z_eq/bb/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> C9_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:56844_z_eq%2Fbb, base_url=http://127.0.0.1:56844/z_eq/bb}
[junit4:junit4] 2> 43062 T97 C9 P56844 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> ASYNC NEW_CORE C12 name=collection1 org.apache.solr.core.SolrCore@761454de url=http://127.0.0.1:50015/z_eq/bb/collection1 node=127.0.0.1:50015_z_eq%2Fbb C12_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:50015_z_eq%2Fbb, base_url=http://127.0.0.1:50015/z_eq/bb}
[junit4:junit4] 2> 43062 T61 C12 P50015 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> ASYNC NEW_CORE C13 name=collection1 org.apache.solr.core.SolrCore@4d801dc2 url=http://127.0.0.1:18162/z_eq/bb/collection1 node=127.0.0.1:18162_z_eq%2Fbb C13_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:18162_z_eq%2Fbb, base_url=http://127.0.0.1:18162/z_eq/bb}
[junit4:junit4] 2> 43067 T78 C13 P18162 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 43079 T97 C9 P56844 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@a31785a; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@a31785a; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5}
[junit4:junit4] 2> 43079 T61 C12 P50015 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@15d6f752; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@15d6f752; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> 43080 T97 C9 P56844 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 5
[junit4:junit4] 2> 43080 T61 C12 P50015 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 43082 T78 C13 P18162 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6dc9b99a; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6dc9b99a; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> 43083 T78 C13 P18162 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4:junit4] 2> 43083 T97 C9 P56844 oass.SolrIndexSearcher.<init> Opening Searcher@21375169 main
[junit4:junit4] 2> 43084 T61 C12 P50015 oass.SolrIndexSearcher.<init> Opening Searcher@7dbeb500 main
[junit4:junit4] 2> 43084 T97 C9 P56844 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 43085 T78 C13 P18162 oass.SolrIndexSearcher.<init> Opening Searcher@7ca7db75 main
[junit4:junit4] 2> 43085 T61 C12 P50015 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 43086 T78 C13 P18162 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 43087 T111 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@21375169 main{StandardDirectoryReader(segments_4:1:nrt)}
[junit4:junit4] 2> 43089 T92 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7ca7db75 main{StandardDirectoryReader(segments_3:1:nrt)}
[junit4:junit4] 2> 43089 T97 C9 P56844 oasup.LogUpdateProcessor.finish [collection1] webapp=/z_eq/bb path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 27
[junit4:junit4] 2> 43090 T78 C13 P18162 oasup.LogUpdateProcessor.finish [collection1] webapp=/z_eq/bb path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 23
[junit4:junit4] 2> 43093 T73 oasc.JmxMonitoredMap.put WARN Failed to register info bean: searcher javax.management.InstanceAlreadyExistsException: solr/collection1:type=searcher,id=org.apache.solr.search.SolrIndexSearcher
[junit4:junit4] 2> at com.sun.jmx.mbeanserver.Repository.addMBean(Repository.java:437)
[junit4:junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerWithRepository(DefaultMBeanServerInterceptor.java:1898)
[junit4:junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:966)
[junit4:junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)
[junit4:junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)
[junit4:junit4] 2> at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:513)
[junit4:junit4] 2> at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:140)
[junit4:junit4] 2> at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:51)
[junit4:junit4] 2> at org.apache.solr.search.SolrIndexSearcher.register(SolrIndexSearcher.java:298)
[junit4:junit4] 2> at org.apache.solr.core.SolrCore.registerSearcher(SolrCore.java:1846)
[junit4:junit4] 2> at org.apache.solr.core.SolrCore.access$000(SolrCore.java:135)
[junit4:junit4] 2> at org.apache.solr.core.SolrCore$7.call(SolrCore.java:1723)
[junit4:junit4] 2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
[junit4:junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:166)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2>
[junit4:junit4] 2> 43096 T73 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7dbeb500 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 43098 T61 C12 P50015 oasup.LogUpdateProcessor.finish [collection1] webapp=/z_eq/bb path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 36
[junit4:junit4] 2> 43099 T47 C10 P46163 oasup.LogUpdateProcessor.finish [collection1] webapp=/z_eq/bb path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 79
[junit4:junit4] 2> 43101 T11 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 43473 T49 C10 P46163 oasc.SolrCore.execute [collection1] webapp=/z_eq/bb path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=345
[junit4:junit4] 2> 43491 T62 C12 P50015 oasc.SolrCore.execute [collection1] webapp=/z_eq/bb path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 43495 T79 C13 P18162 oasc.SolrCore.execute [collection1] webapp=/z_eq/bb path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 43499 T98 C9 P56844 oasc.SolrCore.execute [collection1] webapp=/z_eq/bb path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 46157 T25 C11 P32576 oasup.LogUpdateProcessor.finish [collection1] webapp=/z_eq/bb path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1437945739367940096)} 0 560
[junit4:junit4] 2> 46174 T97 C9 P56844 oasup.LogUpdateProcessor.finish [collection1] webapp=/z_eq/bb path=/update params={update.distrib=FROMLEADER&_version_=-1437945739474894848&update.from=http://127.0.0.1:46163/z_eq/bb/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1437945739474894848)} 0 2
[junit4:junit4] 2> 46174 T78 C13 P18162 oasup.LogUpdateProcessor.finish [collection1] webapp=/z_eq/bb path=/update params={update.distrib=FROMLEADER&_version_=-1437945739474894848&update.from=http://127.0.0.1:46163/z_eq/bb/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1437945739474894848)} 0 2
[junit4:junit4] 2> 46174 T61 C12 P50015 oasup.LogUpdateProcessor.finish [collection1] webapp=/z_eq/bb path=/update params={update.distrib=FROMLEADER&_version_=-1437945739474894848&update.from=http://127.0.0.1:46163/z_eq/bb/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1437945739474894848)} 0 2
[junit4:junit4] 2> 46175 T47 C10 P46163 oasup.LogUpdateProcessor.finish [collection1] webapp=/z_eq/bb path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1437945739474894848)} 0 13
[junit4:junit4] 2> 46482 T25 C11 P32576 oasup.LogUpdateProcessor.finish [collection1] webapp=/z_eq/bb path=/update params={wt=javabin&version=2} {add=[0 (1437945739525226496)]} 0 296
[junit4:junit4] 2> 46508 T97 C9 P56844 oasup.LogUpdateProcessor.finish [collection1] webapp=/z_eq/bb path=/update params={distrib.from=http://127.0.0.1:46163/z_eq/bb/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1437945739814633472)]} 0 5
[junit4:junit4] 2> 46508 T61 C12 P50015 oasup.LogUpdateProcessor.finish [collection1] webapp=/z_eq/bb path=/update params={distrib.from=http://127.0.0.1:46163/z_eq/bb/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1437945739814633472)]} 0 5
[junit4:junit4] 2> 46510 T78 C13 P18162 oasup.LogUpdateProcessor.finish [collection1] webapp=/z_eq/bb path=/update params={distrib.from=http://127.0.0.1:46163/z_eq/bb/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1437945739814633472)]} 0 7
[junit4:junit4] 2> 46512 T47 C10 P46163 oasup.LogUpdateProcessor.finish [collection1] webapp=/z_eq/bb path=/update params={wt=javabin&version=2} {add=[0 (1437945739814633472)]} 0 27
[junit4:junit4] 2> 46520 T25 C11 P32576 oasup.LogUpdateProcessor.finish [collection1] webapp=/z_eq/bb path=/update params={wt=javabin&version=2} {add=[1 (1437945739846090752)]} 0 4
[junit4:junit4] 2> 46533 T61 C12 P50015 oasup.LogUpdateProcessor.finish [collection1] webapp=/z_eq/bb path=/update params={distrib.from=http://127.0.0.1:46163/z_eq/bb/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1437945739854479360)]} 0 3
[junit4:junit4] 2> 46533 T97 C9 P56844 oasup.LogUpdateProcessor.finish [collection1] webapp=/z_eq/bb path=/update params={distrib.from=http://127.0.0.1:46163/z_eq/bb/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1437945739854479360)]} 0 3
[junit4:junit4] 2> 46534 T78 C13 P18162 oasup.LogUpdateProcessor.finish [collection1] webapp=/z_eq/bb path=/update params={distrib.from=http://127.0.0.1:46163/z_eq/bb/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1437945739854479360)]} 0 4
[junit4:junit4] 2> 46535 T47 C10 P46163 oasup.LogUpdateProcessor.finish [collection1] webapp=/z_eq/bb path=/update params={wt=javabin&version=2} {add=[1 (1437945739854479360)]} 0 11
[junit4:junit4] 2> 46543 T25 C11 P32576 oasup.LogUpdateProcessor.finish [collection1] webapp=/z_eq/bb path=/update params={wt=javabin&version=2} {add=[2 (1437945739871256576)]} 0 3
[junit4:junit4] 2> 46548 T47 C10 P46163 oasup.DistributedUpdateProcessor.setupRequest test.distrib.skip.servers was found and contains:[http://127.0.0.1:50015/z_eq/bb/collection1/]
[junit4:junit4] 2> 46549 T47 C10 P46163 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:50015/z_eq/bb/collection1/ against:[http://127.0.0.1:50015/z_eq/bb/collection1/] result:true
[junit4:junit4] 2> 46549 T47 C10 P46163 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:18162/z_eq/bb/collection1/ against:[http://127.0.0.1:50015/z_eq/bb/collection1/] result:false
[junit4:junit4] 2> 46549 T47 C10 P46163 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:56844/z_eq/bb/collection1/ against:[http://127.0.0.1:50015/z_eq/bb/collection1/] result:false
[junit4:junit4] 2> 46561 T78 C13 P18162 oasup.LogUpdateProcessor.finish [collection1] webapp=/z_eq/bb path=/update params={distrib.from=http://127.0.0.1:46163/z_eq/bb/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:50015/z_eq/bb/collection1/&wt=javabin&version=2} {add=[2 (1437945739881742336)]} 0 5
[junit4:junit4] 2> 46561 T97 C9 P56844 oasup.LogUpdateProcessor.finish [collection1] webapp=/z_eq/bb path=/update params={distrib.from=http://127.0.0.1:46163/z_eq/bb/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:50015/z_eq/bb/collection1/&wt=javabin&version=2} {add=[2 (1437945739881742336)]} 0 5
[junit4:junit4] 2> 46563 T47 C10 P46163 oasup.LogUpdateProcessor.finish [collection1] webapp=/z_eq/bb path=/update params={test.distrib.skip.servers=http://127.0.0.1:50015/z_eq/bb/collection1/&wt=javabin&version=2} {add=[2 (1437945739881742336)]} 0 15
[junit4:junit4] 2> 46569 T25 C11 P32576 oasup.LogUpdateProcessor.finish [collection1] webapp=/z_eq/bb path=/update params={wt=javabin&version=2} {add=[3 (1437945739899568128)]} 0 3
[junit4:junit4] 2> 46575 T47 C10 P46163 oasup.DistributedUpdateProcessor.setupRequest test.distrib.skip.servers was found and contains:[http://127.0.0.1:18162/z_eq/bb/collection1/, http://127.0.0.1:50015/z_eq/bb/collection1/]
[junit4:junit4] 2> 46576 T47 C10 P46163 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:50015/z_eq/bb/collection1/ against:[http://127.0.0.1:18162/z_eq/bb/collection1/, http://127.0.0.1:50015/z_eq/bb/collection1/] result:true
[junit4:junit4] 2> 46576 T47 C10 P46163 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:18162/z_eq/bb/collection1/ against:[http://127.0.0.1:18162/z_eq/bb/collection1/, http://127.0.0.1:50015/z_eq/bb/collection1/] result:true
[junit4:junit4] 2> 46577 T47 C10 P46163 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:56844/z_eq/bb/collection1/ against:[http://127.0.0.1:18162/z_eq/bb/collection1/, http://127.0.0.1:50015/z_eq/bb/collection1/] result:false
[junit4:junit4] 2> 46587 T97 C9 P56844 oasup.LogUpdateProcessor.finish [collection1] webapp=/z_eq/bb path=/update params={distrib.from=http://127.0.0.1:46163/z_eq/bb/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:50015/z_eq/bb/collection1/&wt=javabin&version=2} {add=[3 (1437945739910053888)]} 0 4
[junit4:junit4] 2> ASYNC NEW_CORE C14 name=collection1 org.apache.solr.core.SolrCore@5cc771a9 url=http://127.0.0.1:46163/z_eq/bb/collection1 node=127.0.0.1:46163_z_eq%2Fbb C14_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:46163_z_eq%2Fbb, base_url=http://127.0.0.1:46163/z_eq/bb, leader=true}
[junit4:junit4] 2> 46598 T47 C14 P46163 oasup.LogUpdateProcessor.finish [collection1] webapp=/z_eq/bb path=/update params={test.distrib.skip.servers=http://127.0.0.1:50015/z_eq/bb/collection1/&test.distrib.skip.servers=http://127.0.0.1:18162/z_eq/bb/collection1/&wt=javabin&version=2} {add=[3 (1437945739910053888)]} 0 23
[junit4:junit4] 2> ASYNC NEW_CORE C15 name=collection1 org.apache.solr.core.SolrCore@a1172c5 url=http://127.0.0.1:32576/z_eq/bb/collection1 node=127.0.0.1:32576_z_eq%2Fbb C15_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:32576_z_eq%2Fbb, base_url=http://127.0.0.1:32576/z_eq/bb, leader=true}
[junit4:junit4] 2> 46603 T25 C15 P32576 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 46961 T25 C15 P32576 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@38dcf88e; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@38dcf88e; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> 46962 T25 C15 P32576 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 47268 T25 C15 P32576 oass.SolrIndexSearcher.<init> Opening Searcher@56da67af main
[junit4:junit4] 2> 47270 T25 C15 P32576 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 47272 T39 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@56da67af main{StandardDirectoryReader(segments_3:3:nrt _0(4.4):c4)}
[junit4:junit4] 2> 47274 T25 C15 P32576 oasup.LogUpdateProcessor.finish [collection1] webapp=/z_eq/bb path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 672
[junit4:junit4] 2> 47280 T47 C14 P46163 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 47337 T47 C14 P46163 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=5
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@27c73122; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@27c73122; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@27c73122; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@27c73122; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@27c73122; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_6,generation=6}
[junit4:junit4] 2> 47339 T47 C14 P46163 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 6
[junit4:junit4] 2> 47347 T47 C14 P46163 oass.SolrIndexSearcher.<init> Opening Searcher@4b06e721 main
[junit4:junit4] 2> 47348 T47 C14 P46163 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 47351 T57 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4b06e721 main{StandardDirectoryReader(segments_6:3:nrt _0(4.4):c4)}
[junit4:junit4] 2> 47352 T47 C14 P46163 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:50015/z_eq/bb/collection1/, StdNode: http://127.0.0.1:18162/z_eq/bb/collection1/, StdNode: http://127.0.0.1:56844/z_eq/bb/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> ASYNC NEW_CORE C16 name=collection1 org.apache.solr.core.SolrCore@4d801dc2 url=http://127.0.0.1:18162/z_eq/bb/collection1 node=127.0.0.1:18162_z_eq%2Fbb C16_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:18162_z_eq%2Fbb, base_url=http://127.0.0.1:18162/z_eq/bb}
[junit4:junit4] 2> 47357 T78 C16 P18162 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> ASYNC NEW_CORE C17 name=collection1 org.apache.solr.core.SolrCore@757e2379 url=http://127.0.0.1:56844/z_eq/bb/collection1 node=127.0.0.1:56844_z_eq%2Fbb C17_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:56844_z_eq%2Fbb, base_url=http://127.0.0.1:56844/z_eq/bb}
[junit4:junit4] 2> 47357 T97 C17 P56844 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> ASYNC NEW_CORE C18 name=collection1 org.apache.solr.core.SolrCore@761454de url=http://127.0.0.1:50015/z_eq/bb/collection1 node=127.0.0.1:50015_z_eq%2Fbb C18_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:50015_z_eq%2Fbb, base_url=http://127.0.0.1:50015/z_eq/bb}
[junit4:junit4] 2> 47357 T61 C18 P50015 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 47440 T61 C18 P50015 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@15d6f752; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@15d6f752; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> 47441 T61 C18 P50015 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4:junit4] 2> 47449 T97 C17 P56844 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@a31785a; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@a31785a; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_6,generation=6}
[junit4:junit4] 2> 47449 T61 C18 P50015 oass.SolrIndexSearcher.<init> Opening Searcher@308cd450 main
[junit4:junit4] 2> 47449 T97 C17 P56844 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 6
[junit4:junit4] 2> 47451 T78 C16 P18162 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6dc9b99a; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371331876300/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6dc9b99a; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5}
[junit4:junit4] 2> 47451 T61 C18 P50015 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 47452 T78 C16 P18162 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 5
[junit4:junit4] 2> 47454 T73 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@308cd450 main{StandardDirectoryReader(segments_4:3:nrt _0(4.4):c2)}
[junit4:junit4] 2> 47455 T61 C18 P50015 oasup.LogUpdateProcessor.finish [collection1] webapp=/z_eq/bb path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 98
[junit4:junit4] 2> 47458 T97 C17 P56844 oass.SolrIndexSearcher.<init> Opening Searcher@132c0adc main
[junit4:junit4] 2> 47459 T97 C17 P56844 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 47460 T78 C16 P18162 oass.SolrIndexSearcher.<init> Opening Searcher@46739fd5 main
[junit4:junit4] 2> 47461 T78 C16 P18162 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 47462 T111 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@132c0adc main{StandardDirectoryReader(segments_6:3:nrt _0(4.4):c4)}
[junit4:junit4] 2> 47464 T97 C17 P56844 oasup.LogUpdateProcessor.finish [collection1] webapp=/z_eq/bb path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 107
[junit4:junit4] 2> 47464 T92 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@46739fd5 main{StandardDirectoryReader(segments_5:3:nrt _0(4.4):c3)}
[junit4:junit4] 2> 47466 T78 C16 P18162 oasup.LogUpdateProcessor.finish [collection1] webapp=/z_eq/bb path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 109
[junit4:junit4] 2> 47467 T47 C14 P46163 oasup.LogUpdateProcessor.finish [collection1] webapp=/z_eq/bb path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 187
[junit4:junit4] 2> 47468 T11 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):230
[junit4:junit4] 2> 47470 T11 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 47472 T11 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> 47484 T49 C14 P46163 oasc.SolrCore.execute [collection1] webapp=/z_eq/bb path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=8
[junit4:junit4] 2> 47489 T62 C18 P50015 oasc.SolrCore.execute [collection1] webapp=/z_eq/bb path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=2 status=0 QTime=0
[junit4:junit4] 2> 47494 T79 C16 P18162 oasc.SolrCore.execute [collection1] webapp=/z_eq/bb path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=3 status=0 QTime=0
[junit4:junit4] 2> 47499 T98 C17 P56844 oasc.SolrCore.execute [collection1] webapp=/z_eq/bb path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=0
[junit4:junit4] 2> 47507 T11 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 47541 T80 oasha.CollectionsHandler.handleSyncShardAction Syncing shard : shard=shard1&action=SYNCSHARD&collection=collection1&wt=javabin&version=2
[junit4:junit4] 2> 47542 T80 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 47559 T50 oasha.CoreAdminHandler.handleRequestSyncAction I have been requested to sync up my shard
[junit4:junit4] 2> 47560 T50 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:46163/z_eq/bb/collection1/
[junit4:junit4] 2> 47561 T50 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:46163/z_eq/bb START replicas=[http://127.0.0.1:50015/z_eq/bb/collection1/, http://127.0.0.1:18162/z_eq/bb/collection1/, http://127.0.0.1:56844/z_eq/bb/collection1/] nUpdates=100
[junit4:junit4] 2> 47583 T63 C18 P50015 oasc.SolrCore.execute [collection1] webapp=/z_eq/bb path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=17
[junit4:junit4] 2> 47583 T99 C17 P56844 oasc.SolrCore.execute [collection1] webapp=/z_eq/bb path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=16
[junit4:junit4] 2> 47583 T81 C16 P18162 oasc.SolrCore.execute [collection1] webapp=/z_eq/bb path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=17
[junit4:junit4] 2> 47585 T50 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:46163/z_eq/bb Received 3 versions from 127.0.0.1:50015/z_eq/bb/collection1/
[junit4:junit4] 2> 47586 T50 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:46163/z_eq/bb Our versions are newer. ourLowThreshold=1437945739474894848 otherHigh=1437945739854479360
[junit4:junit4] 2> 47587 T50 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:46163/z_eq/bb Received 5 versions from 127.0.0.1:56844/z_eq/bb/collection1/
[junit4:junit4] 2> 47587 T50 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:46163/z_eq/bb Our versions are newer. ourLowThreshold=1437945739474894848 otherHigh=1437945739881742336
[junit4:junit4] 2> 47588 T50 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:46163/z_eq/bb Received 4 versions from 127.0.0.1:18162/z_eq/bb/collection1/
[junit4:junit4] 2> 47588 T50 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:46163/z_eq/bb Our versions are newer. ourLowThreshold=1437945739474894848 otherHigh=1437945739881742336
[junit4:junit4] 2> 47589 T50 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:46163/z_eq/bb DONE. sync succeeded
[junit4:junit4] 2> 47590 T50 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 47590 T50 oasc.SyncStrategy.syncToMe http://127.0.0.1:46163/z_eq/bb/collection1/: try and ask http://127.0.0.1:50015/z_eq/bb/collection1/ to sync
[junit4:junit4] 2> 47591 T50 oasc.SyncStrategy.syncToMe http://127.0.0.1:46163/z_eq/bb/collection1/: try and ask http://127.0.0.1:18162/z_eq/bb/collection1/ to sync
[junit4:junit4] 2> 47592 T50 oasc.SyncStrategy.syncToMe http://127.0.0.1:46163/z_eq/bb/collection1/: try and ask http://127.0.0.1:56844/z_eq/bb/collection1/ to sync
[junit4:junit4] 2> 47596 T82 C16 P18162 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:18162/z_eq/bb START replicas=[http://127.0.0.1:46163/z_eq/bb/collection1/] nUpdates=100
[junit4:junit4] 2> 47596 T64 C18 P50015 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:50015/z_eq/bb START replicas=[http://127.0.0.1:46163/z_eq/bb/collection1/] nUpdates=100
[junit4:junit4] 2> 47597 T100 C17 P56844 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:56844/z_eq/bb START replicas=[http://127.0.0.1:46163/z_eq/bb/collection1/] nUpdates=100
[junit4:junit4] 2> 47602 T51 C14 P46163 oasc.SolrCore.execute [collection1] webapp=/z_eq/bb path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 47602 T45 C14 P46163 oasc.SolrCore.execute [collection1] webapp=/z_eq/bb path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 47603 T64 C18 P50015 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:50015/z_eq/bb Received 5 versions from 127.0.0.1:46163/z_eq/bb/collection1/
[junit4:junit4] 2> 47602 T46 C14 P46163 oasc.SolrCore.execute [collection1] webapp=/z_eq/bb path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 47604 T64 C18 P50015 oasu.PeerSync.requestUpdates PeerSync: core=collection1 url=http://127.0.0.1:50015/z_eq/bb Requesting updates from 127.0.0.1:46163/z_eq/bb/collection1/n=2 versions=[1437945739910053888, 1437945739881742336]
[junit4:junit4] 2> 47603 T100 C17 P56844 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:56844/z_eq/bb Received 5 versions from 127.0.0.1:46163/z_eq/bb/collection1/
[junit4:junit4] 2> 47605 T82 C16 P18162 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:18162/z_eq/bb Received 5 versions from 127.0.0.1:46163/z_eq/bb/collection1/
[junit4:junit4] 2> 47606 T100 C17 P56844 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:56844/z_eq/bb Our versions are newer. ourLowThreshold=1437945739474894848 otherHigh=1437945739881742336
[junit4:junit4] 2> 47607 T82 C16 P18162 oasu.PeerSync.requestUpdates PeerSync: core=collection1 url=http://127.0.0.1:18162/z_eq/bb Requesting updates from 127.0.0.1:46163/z_eq/bb/collection1/n=1 versions=[1437945739910053888]
[junit4:junit4] 2> 47607 T100 C17 P56844 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:56844/z_eq/bb DONE. sync succeeded
[junit4:junit4] 2> 47609 T100 C17 P56844 oasc.SolrCore.execute [collection1] webapp=/z_eq/bb path=/get params={sync=http://127.0.0.1:46163/z_eq/bb/collection1/&getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=12
[junit4:junit4] 2> 47610 T46 C14 P46163 oasc.SolrCore.execute [collection1] webapp=/z_eq/bb path=/get params={distrib=false&getUpdates=1437945739910053888,1437945739881742336&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 47610 T50 oasc.SyncStrategy.syncToMe http://127.0.0.1:46163/z_eq/bb/collection1/: sync completed with http://127.0.0.1:56844/z_eq/bb/collection1/
[junit4:junit4] 2> 47612 T45 C14 P46163 oasc.SolrCore.execute [collection1] webapp=/z_eq/bb path=/get params={distrib=false&getUpdates=1437945739910053888&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 47656 T82 C16 P18162 oasup.LogUpdateProcessor.finish [collection1] {add=[3 (1437945739910053888)]} 0 43
[junit4:junit4] 2> 47657 T82 C16 P18162 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:18162/z_eq/bb DONE. sync succeeded
[junit4:junit4] 2> 47658 T82 C16 P18162 oasc.SolrCore.execute [collection1] webapp=/z_eq/bb path=/get params={sync=http://127.0.0.1:46163/z_eq/bb/collection1/&getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=62
[junit4:junit4] 2> 47659 T50 oasc.SyncStrategy.syncToMe http://127.0.0.1:46163/z_eq/bb/collection1/: sync completed with http://127.0.0.1:18162/z_eq/bb/collection1/
[junit4:junit4] 2> 47659 T64 C18 P50015 oasup.LogUpdateProcessor.finish [collection1] {add=[2 (1437945739881742336), 3 (1437945739910053888)]} 0 48
[junit4:junit4] 2> 47660 T64 C18 P50015 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:50015/z_eq/bb DONE. sync succeeded
[junit4:junit4] 2> 47661 T64 C18 P50015 oasc.SolrCore.execute [collection1] webapp=/z_eq/bb path=/get params={sync=http://127.0.0.1:46163/z_eq/bb/collection1/&getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=65
[junit4:junit4] 2> 47662 T50 oasc.SyncStrategy.syncToMe http://127.0.0.1:46163/z_eq/bb/collection1/: sync completed with http://127.0.0.1:50015/z_eq/bb/collection1/
[junit4:junit4] 2> 47663 T50 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={shard=shard1&action=REQUESTSYNCSHARD&core=collection1&collection=collection1&wt=javabin&version=2} status=0 QTime=104
[junit4:junit4] 2> 47664 T80 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/collections params={shard=shard1&acti
[...truncated too long message...]
base_url":"http://127.0.0.1:46163/z_eq/bb",
[junit4:junit4] 1> "leader":"true"},
[junit4:junit4] 1> "127.0.0.1:50015_z_eq%2Fbb_collection1":{
[junit4:junit4] 1> "shard":"shard1",
[junit4:junit4] 1> "state":"down",
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "collection":"collection1",
[junit4:junit4] 1> "node_name":"127.0.0.1:50015_z_eq%2Fbb",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:50015/z_eq/bb"},
[junit4:junit4] 1> "127.0.0.1:18162_z_eq%2Fbb_collection1":{
[junit4:junit4] 1> "shard":"shard1",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "collection":"collection1",
[junit4:junit4] 1> "node_name":"127.0.0.1:18162_z_eq%2Fbb",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:18162/z_eq/bb"},
[junit4:junit4] 1> "127.0.0.1:56844_z_eq%2Fbb_collection1":{
[junit4:junit4] 1> "shard":"shard1",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "collection":"collection1",
[junit4:junit4] 1> "node_name":"127.0.0.1:56844_z_eq%2Fbb",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:56844/z_eq/bb"}}}},
[junit4:junit4] 1> "router":"compositeId"},
[junit4:junit4] 1> "control_collection":{
[junit4:junit4] 1> "shards":{"shard1":{
[junit4:junit4] 1> "range":"80000000-7fffffff",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "replicas":{"127.0.0.1:32576_z_eq%2Fbb_collection1":{
[junit4:junit4] 1> "shard":"shard1",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "collection":"control_collection",
[junit4:junit4] 1> "node_name":"127.0.0.1:32576_z_eq%2Fbb",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:32576/z_eq/bb",
[junit4:junit4] 1> "leader":"true"}}}},
[junit4:junit4] 1> "router":"compositeId"}}
[junit4:junit4] 1> /solr/aliases.json (0)
[junit4:junit4] 1> /solr/live_nodes (4)
[junit4:junit4] 1> /solr/live_nodes/127.0.0.1:46163_z_eq%2Fbb (0)
[junit4:junit4] 1> /solr/live_nodes/127.0.0.1:18162_z_eq%2Fbb (0)
[junit4:junit4] 1> /solr/live_nodes/127.0.0.1:32576_z_eq%2Fbb (0)
[junit4:junit4] 1> /solr/live_nodes/127.0.0.1:56844_z_eq%2Fbb (0)
[junit4:junit4] 1> /solr/overseer (3)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1>
[junit4:junit4] 1> /solr/overseer/queue (0)
[junit4:junit4] 1> /solr/overseer/queue-work (0)
[junit4:junit4] 1> /solr/overseer/collection-queue-work (0)
[junit4:junit4] 1> /solr/collections (2)
[junit4:junit4] 1> /solr/collections/collection1 (3)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {"configName":"conf1"}
[junit4:junit4] 1> /solr/collections/collection1/shards (0)
[junit4:junit4] 1> /solr/collections/collection1/leader_elect (1)
[junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard1 (1)
[junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard1/election (3)
[junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard1/election/89871605866233866-127.0.0.1:18162_z_eq%2Fbb_collection1-n_0000000005 (0)
[junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard1/election/89871605866233868-127.0.0.1:56844_z_eq%2Fbb_collection1-n_0000000006 (0)
[junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard1/election/89871605866233870-127.0.0.1:46163_z_eq%2Fbb_collection1-n_0000000004 (0)
[junit4:junit4] 1> /solr/collections/collection1/leaders (1)
[junit4:junit4] 1> /solr/collections/collection1/leaders/shard1 (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "node_name":"127.0.0.1:46163_z_eq%2Fbb",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:46163/z_eq/bb"}
[junit4:junit4] 1> /solr/collections/control_collection (3)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {"configName":"conf1"}
[junit4:junit4] 1> /solr/collections/control_collection/shards (0)
[junit4:junit4] 1> /solr/collections/control_collection/leader_elect (1)
[junit4:junit4] 1> /solr/collections/control_collection/leader_elect/shard1 (1)
[junit4:junit4] 1> /solr/collections/control_collection/leader_elect/shard1/election (1)
[junit4:junit4] 1> /solr/collections/control_collection/leader_elect/shard1/election/89871605866233859-127.0.0.1:32576_z_eq%2Fbb_collection1-n_0000000000 (0)
[junit4:junit4] 1> /solr/collections/control_collection/leaders (1)
[junit4:junit4] 1> /solr/collections/control_collection/leaders/shard1 (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "node_name":"127.0.0.1:32576_z_eq%2Fbb",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:32576/z_eq/bb"}
[junit4:junit4] 1> /solr/overseer_elect (2)
[junit4:junit4] 1> /solr/overseer_elect/election (4)
[junit4:junit4] 1> /solr/overseer_elect/election/89871605866233868-127.0.0.1:56844_z_eq%2Fbb-n_0000000004 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89871605866233859-127.0.0.1:32576_z_eq%2Fbb-n_0000000000 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89871605866233866-127.0.0.1:18162_z_eq%2Fbb-n_0000000003 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89871605866233870-127.0.0.1:46163_z_eq%2Fbb-n_0000000005 (0)
[junit4:junit4] 1> /solr/overseer_elect/leader (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {"id":"89871605866233859-127.0.0.1:32576_z_eq%2Fbb-n_0000000000"}
[junit4:junit4] 1> /zookeeper (1)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1>
[junit4:junit4] 1>
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=SyncSliceTest -Dtests.method=testDistribSearch -Dtests.seed=1584830D3B8D6775 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=bg_BG -Dtests.timezone=Atlantic/South_Georgia -Dtests.file.encoding=US-ASCII
[junit4:junit4] FAILURE 517s J0 | SyncSliceTest.testDistribSearch <<<
[junit4:junit4] > Throwable #1: java.lang.AssertionError: shard1 is not consistent. Got 305 from http://127.0.0.1:18162/z_eq/bb/collection1lastClient and got 5 from http://127.0.0.1:56844/z_eq/bb/collection1
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([1584830D3B8D6775:94620D154CD20749]:0)
[junit4:junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:963)
[junit4:junit4] > at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:238)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 519399 T11 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> NOTE: test params are: codec=Lucene42: {range_facet_l=Pulsing41(freqCutoff=7 minBlockSize=84 maxBlockSize=183), text=PostingsFormat(name=Lucene41WithOrds), _version_=Pulsing41(freqCutoff=7 minBlockSize=84 maxBlockSize=183), rnd_b=MockFixedIntBlock(blockSize=225), intDefault=Pulsing41(freqCutoff=7 minBlockSize=84 maxBlockSize=183), timestamp=Pulsing41(freqCutoff=7 minBlockSize=84 maxBlockSize=183), id=MockFixedIntBlock(blockSize=225), a_t=Pulsing41(freqCutoff=7 minBlockSize=84 maxBlockSize=183), range_facet_sl=PostingsFormat(name=Lucene41WithOrds), range_facet_si=PostingsFormat(name=SimpleText), other_tl1=Pulsing41(freqCutoff=7 minBlockSize=84 maxBlockSize=183), multiDefault=PostingsFormat(name=SimpleText), a_si=PostingsFormat(name=SimpleText)}, docValues:{}, sim=DefaultSimilarity, locale=bg_BG, timezone=Atlantic/South_Georgia
[junit4:junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_21 (64-bit)/cpus=16,threads=5,free=45406840,total=115343360
[junit4:junit4] 2> NOTE: All tests run in this JVM: [SyncSliceTest]
[junit4:junit4] Completed on J0 in 520.11s, 1 test, 1 failure <<< FAILURES!
[...truncated 809 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:392: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:372: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build.xml:181: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/common-build.xml:437: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:1246: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:890: There were test failures: 297 suites, 1246 tests, 1 failure, 13 ignored (7 assumptions)
Total time: 55 minutes 19 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure