You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2013/05/19 20:07:13 UTC
[JENKINS] Lucene-Solr-Tests-4.x-Java6 - Build # 1635 - Failure
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java6/1635/
1 tests failed.
REGRESSION: org.apache.solr.cloud.SyncSliceTest.testDistribSearch
Error Message:
shard1 is not consistent. Got 305 from http://127.0.0.1:60579/y_/collection1lastClient and got 5 from http://127.0.0.1:60591/y_/collection1
Stack Trace:
java.lang.AssertionError: shard1 is not consistent. Got 305 from http://127.0.0.1:60579/y_/collection1lastClient and got 5 from http://127.0.0.1:60591/y_/collection1
at __randomizedtesting.SeedInfo.seed([CC0CA1ECBEF18497:4DEA2FF4C9AEE4AB]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:963)
at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:238)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:679)
Build Log:
[...truncated 9553 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.SyncSliceTest
[junit4:junit4] 2> 993266 T2118 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /y_/
[junit4:junit4] 2> 993271 T2118 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./solrtest-SyncSliceTest-1368985677639
[junit4:junit4] 2> 993272 T2118 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 993273 T2119 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 993374 T2118 oasc.ZkTestServer.run start zk server on port:60479
[junit4:junit4] 2> 993374 T2118 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 993378 T2125 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@439f91e6 name:ZooKeeperConnection Watcher:127.0.0.1:60479 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 993378 T2118 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 993378 T2118 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 993390 T2118 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 993391 T2127 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@19e63bff name:ZooKeeperConnection Watcher:127.0.0.1:60479/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 993392 T2118 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 993392 T2118 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 993396 T2118 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 993406 T2118 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 993408 T2118 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 993411 T2118 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 993411 T2118 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 993421 T2118 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 993422 T2118 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 993525 T2118 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 993526 T2118 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 993528 T2118 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 993529 T2118 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 993532 T2118 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 993532 T2118 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 993540 T2118 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 993540 T2118 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 993543 T2118 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 993544 T2118 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 993547 T2118 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 993547 T2118 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 993550 T2118 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 993551 T2118 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 993814 T2118 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 993819 T2118 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:60482
[junit4:junit4] 2> 993820 T2118 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 993820 T2118 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 993821 T2118 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1368985677929
[junit4:junit4] 2> 993821 T2118 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1368985677929/solr.xml
[junit4:junit4] 2> 993821 T2118 oasc.CoreContainer.<init> New CoreContainer 2116252982
[junit4:junit4] 2> 993822 T2118 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1368985677929/'
[junit4:junit4] 2> 993823 T2118 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1368985677929/'
[junit4:junit4] 2> 993928 T2118 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 993928 T2118 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 993929 T2118 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 993929 T2118 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 993930 T2118 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 993930 T2118 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 993931 T2118 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 993931 T2118 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 993931 T2118 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 993932 T2118 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 993947 T2118 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 993948 T2118 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:60479/solr
[junit4:junit4] 2> 993948 T2118 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 993949 T2118 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 993952 T2138 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@33ab1fda name:ZooKeeperConnection Watcher:127.0.0.1:60479 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 993953 T2118 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 993964 T2118 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 993974 T2118 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 993976 T2140 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5b12e697 name:ZooKeeperConnection Watcher:127.0.0.1:60479/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 993977 T2118 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 993979 T2118 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 993989 T2118 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 993992 T2118 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 993994 T2118 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60482_y_
[junit4:junit4] 2> 994003 T2118 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:60482_y_
[junit4:junit4] 2> 994006 T2118 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 994023 T2118 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 994026 T2118 oasc.Overseer.start Overseer (id=89717845370142723-127.0.0.1:60482_y_-n_0000000000) starting
[junit4:junit4] 2> 994038 T2118 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 994049 T2142 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 994050 T2118 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 994052 T2118 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 994054 T2118 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 994056 T2141 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 994060 T2143 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1368985677929/collection1
[junit4:junit4] 2> 994060 T2143 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 994061 T2143 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 994061 T2143 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 994062 T2143 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1368985677929/collection1/'
[junit4:junit4] 2> 994064 T2143 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-controljetty-1368985677929/collection1/lib/README' to classloader
[junit4:junit4] 2> 994064 T2143 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-controljetty-1368985677929/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 994113 T2143 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 994171 T2143 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 994272 T2143 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 994278 T2143 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 994779 T2143 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 994791 T2143 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 994796 T2143 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 994808 T2143 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 994812 T2143 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 994817 T2143 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 994818 T2143 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 994818 T2143 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 994819 T2143 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 994820 T2143 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 994820 T2143 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 994820 T2143 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 994867 T2143 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1368985677929/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1368985677638/control/data/
[junit4:junit4] 2> 994867 T2143 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@30d647d8
[junit4:junit4] 2> 994868 T2143 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 994869 T2143 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/control/data
[junit4:junit4] 2> 994870 T2143 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1368985677638/control/data/index/
[junit4:junit4] 2> 994871 T2143 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1368985677638/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 994872 T2143 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/control/data/index
[junit4:junit4] 2> 994879 T2143 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1b7664f0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 994879 T2143 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 994882 T2143 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 994882 T2143 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 994883 T2143 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 994884 T2143 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 994884 T2143 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 994884 T2143 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 994884 T2143 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 994885 T2143 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 994885 T2143 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 994895 T2143 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 994904 T2143 oass.SolrIndexSearcher.<init> Opening Searcher@6f9b5ea4 main
[junit4:junit4] 2> 994905 T2143 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 994905 T2143 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 994908 T2144 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6f9b5ea4 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 994910 T2143 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 994910 T2143 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 995559 T2141 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 995560 T2141 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:60482_y_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:60482/y_"}
[junit4:junit4] 2> 995560 T2141 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 995560 T2141 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 995591 T2140 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 995912 T2143 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 995912 T2143 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:60482/y_ collection:control_collection shard:shard1
[junit4:junit4] 2> 995913 T2143 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 995928 T2143 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 995931 T2143 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 995931 T2143 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 995931 T2143 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:60482/y_/collection1/
[junit4:junit4] 2> 995931 T2143 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 995931 T2143 oasc.SyncStrategy.syncToMe http://127.0.0.1:60482/y_/collection1/ has no replicas
[junit4:junit4] 2> 995931 T2143 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:60482/y_/collection1/
[junit4:junit4] 2> 995932 T2143 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 997094 T2141 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 997147 T2140 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 997169 T2143 oasc.ZkController.register We are http://127.0.0.1:60482/y_/collection1/ and leader is http://127.0.0.1:60482/y_/collection1/
[junit4:junit4] 2> 997169 T2143 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:60482/y_
[junit4:junit4] 2> 997169 T2143 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 997169 T2143 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 997169 T2143 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 997171 T2143 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 997172 T2118 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1
[junit4:junit4] 2> 997172 T2118 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 997173 T2118 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 997183 T2118 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 997184 T2118 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 997186 T2147 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@44977c22 name:ZooKeeperConnection Watcher:127.0.0.1:60479/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 997186 T2118 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 997188 T2118 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 997189 T2118 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 997625 T2118 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 997634 T2118 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:60547
[junit4:junit4] 2> 997635 T2118 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 997635 T2118 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 997636 T2118 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1368985681557
[junit4:junit4] 2> 997636 T2118 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1368985681557/solr.xml
[junit4:junit4] 2> 997637 T2118 oasc.CoreContainer.<init> New CoreContainer 1658702493
[junit4:junit4] 2> 997639 T2118 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1368985681557/'
[junit4:junit4] 2> 997640 T2118 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1368985681557/'
[junit4:junit4] 2> 998329 T2118 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 998330 T2118 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 998330 T2118 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 998331 T2118 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 998331 T2118 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 998332 T2118 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 998332 T2118 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 998332 T2118 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 998333 T2118 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 998333 T2118 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 998431 T2118 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 998432 T2118 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:60479/solr
[junit4:junit4] 2> 998432 T2118 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 998435 T2118 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 998447 T2158 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6c6eb3c8 name:ZooKeeperConnection Watcher:127.0.0.1:60479 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 998448 T2118 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 998458 T2118 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 998477 T2118 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 998481 T2160 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ef0e667 name:ZooKeeperConnection Watcher:127.0.0.1:60479/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 998481 T2118 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 998502 T2118 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 998662 T2141 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 998664 T2141 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:60482_y_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:60482/y_"}
[junit4:junit4] 2> 998684 T2140 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 998685 T2147 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 998694 T2160 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 999519 T2118 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60547_y_
[junit4:junit4] 2> 999525 T2118 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:60547_y_
[junit4:junit4] 2> 999561 T2147 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 999562 T2140 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 999566 T2160 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 999566 T2160 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 999568 T2140 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 999575 T2147 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 999597 T2161 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1368985681557/collection1
[junit4:junit4] 2> 999598 T2161 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 999600 T2161 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 999600 T2161 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 999606 T2161 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1368985681557/collection1/'
[junit4:junit4] 2> 999607 T2161 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty1-1368985681557/collection1/lib/README' to classloader
[junit4:junit4] 2> 999608 T2161 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty1-1368985681557/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 999774 T2161 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 999979 T2161 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1000086 T2161 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1000101 T2161 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1000996 T2161 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 1001014 T2161 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1001018 T2161 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1001031 T2161 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1001036 T2161 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1001040 T2161 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1001042 T2161 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1001042 T2161 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 1001043 T2161 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1001044 T2161 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1001044 T2161 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 1001044 T2161 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 1001044 T2161 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1368985681557/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty1/
[junit4:junit4] 2> 1001044 T2161 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@30d647d8
[junit4:junit4] 2> 1001045 T2161 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 1001046 T2161 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty1
[junit4:junit4] 2> 1001047 T2161 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty1/index/
[junit4:junit4] 2> 1001048 T2161 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1001050 T2161 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty1/index
[junit4:junit4] 2> 1001060 T2161 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6f53c131; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1001060 T2161 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1001064 T2161 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1001064 T2161 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1001065 T2161 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1001065 T2161 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1001066 T2161 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1001066 T2161 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1001066 T2161 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1001066 T2161 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1001067 T2161 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1001078 T2161 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1001088 T2161 oass.SolrIndexSearcher.<init> Opening Searcher@3da86466 main
[junit4:junit4] 2> 1001089 T2161 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1001089 T2161 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1001092 T2162 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3da86466 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1001094 T2161 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1001095 T2161 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1001715 T2141 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1001716 T2141 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:60547_y_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:60547/y_"}
[junit4:junit4] 2> 1001716 T2141 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 1
[junit4:junit4] 2> 1001716 T2141 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 1001729 T2160 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1001729 T2147 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1001729 T2140 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1002097 T2161 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1002097 T2161 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:60547/y_ collection:collection1 shard:shard1
[junit4:junit4] 2> 1002098 T2161 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 1002114 T2161 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 1002124 T2161 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 1002124 T2161 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 1002124 T2161 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:60547/y_/collection1/
[junit4:junit4] 2> 1002125 T2161 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 1002125 T2161 oasc.SyncStrategy.syncToMe http://127.0.0.1:60547/y_/collection1/ has no replicas
[junit4:junit4] 2> 1002125 T2161 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:60547/y_/collection1/
[junit4:junit4] 2> 1002125 T2161 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 1003233 T2141 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1003248 T2160 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1003248 T2147 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1003248 T2140 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1003265 T2161 oasc.ZkController.register We are http://127.0.0.1:60547/y_/collection1/ and leader is http://127.0.0.1:60547/y_/collection1/
[junit4:junit4] 2> 1003265 T2161 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:60547/y_
[junit4:junit4] 2> 1003265 T2161 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 1003265 T2161 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1003265 T2161 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1003267 T2161 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1003268 T2118 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1
[junit4:junit4] 2> 1003268 T2118 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1003269 T2118 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1003495 T2118 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1003497 T2118 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:60573
[junit4:junit4] 2> 1003498 T2118 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1003498 T2118 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1003498 T2118 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1368985687648
[junit4:junit4] 2> 1003499 T2118 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1368985687648/solr.xml
[junit4:junit4] 2> 1003499 T2118 oasc.CoreContainer.<init> New CoreContainer 1294248436
[junit4:junit4] 2> 1003499 T2118 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1368985687648/'
[junit4:junit4] 2> 1003500 T2118 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1368985687648/'
[junit4:junit4] 2> 1003583 T2118 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1003583 T2118 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1003583 T2118 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1003584 T2118 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1003584 T2118 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1003584 T2118 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1003585 T2118 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1003585 T2118 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1003585 T2118 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1003585 T2118 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1003595 T2118 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1003596 T2118 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:60479/solr
[junit4:junit4] 2> 1003596 T2118 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1003597 T2118 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1003599 T2174 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@49643130 name:ZooKeeperConnection Watcher:127.0.0.1:60479 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1003599 T2118 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1003601 T2118 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1003608 T2118 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1003609 T2176 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7bab1037 name:ZooKeeperConnection Watcher:127.0.0.1:60479/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1003609 T2118 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1003621 T2118 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1004623 T2118 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60573_y_
[junit4:junit4] 2> 1004625 T2118 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:60573_y_
[junit4:junit4] 2> 1004626 T2140 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1004626 T2147 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1004627 T2160 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1004628 T2160 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1004628 T2176 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1004628 T2140 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1004629 T2147 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1004637 T2177 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1368985687648/collection1
[junit4:junit4] 2> 1004638 T2177 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1004638 T2177 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1004638 T2177 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1004639 T2177 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1368985687648/collection1/'
[junit4:junit4] 2> 1004640 T2177 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty2-1368985687648/collection1/lib/README' to classloader
[junit4:junit4] 2> 1004640 T2177 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty2-1368985687648/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1004673 T2177 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 1004712 T2177 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1004752 T2141 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1004753 T2141 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:60547_y_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:60547/y_"}
[junit4:junit4] 2> 1004768 T2147 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1004768 T2140 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1004768 T2160 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1004813 T2177 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1004813 T2176 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1004817 T2177 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1005237 T2177 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 1005245 T2177 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1005248 T2177 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1005258 T2177 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1005262 T2177 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1005266 T2177 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1005267 T2177 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1005267 T2177 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 1005268 T2177 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1005268 T2177 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1005268 T2177 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 1005269 T2177 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 1005269 T2177 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1368985687648/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty2/
[junit4:junit4] 2> 1005269 T2177 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@30d647d8
[junit4:junit4] 2> 1005269 T2177 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 1005270 T2177 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty2
[junit4:junit4] 2> 1005271 T2177 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty2/index/
[junit4:junit4] 2> 1005271 T2177 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1005272 T2177 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty2/index
[junit4:junit4] 2> 1005276 T2177 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@44d38ef0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1005277 T2177 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1005279 T2177 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1005279 T2177 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1005279 T2177 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1005280 T2177 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1005280 T2177 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1005280 T2177 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1005281 T2177 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1005281 T2177 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1005281 T2177 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1005287 T2177 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1005294 T2177 oass.SolrIndexSearcher.<init> Opening Searcher@63f29e72 main
[junit4:junit4] 2> 1005294 T2177 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1005295 T2177 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1005297 T2178 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@63f29e72 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1005298 T2177 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1005298 T2177 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1006272 T2141 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1006273 T2141 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:60573_y_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:60573/y_"}
[junit4:junit4] 2> 1006273 T2141 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 1006273 T2141 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 1006313 T2147 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1006313 T2176 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1006313 T2140 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1006313 T2160 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1007302 T2177 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1007302 T2177 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:60573/y_ collection:collection1 shard:shard1
[junit4:junit4] 2> 1007305 T2177 oasc.ZkController.register We are http://127.0.0.1:60573/y_/collection1/ and leader is http://127.0.0.1:60547/y_/collection1/
[junit4:junit4] 2> 1007305 T2177 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:60573/y_
[junit4:junit4] 2> 1007305 T2177 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 1007305 T2177 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C135 name=collection1 org.apache.solr.core.SolrCore@73f33cd4 url=http://127.0.0.1:60573/y_/collection1 node=127.0.0.1:60573_y_ C135_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:60573_y_, base_url=http://127.0.0.1:60573/y_}
[junit4:junit4] 2> 1007306 T2179 C135 P60573 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 1007306 T2177 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1007307 T2179 C135 P60573 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 1007307 T2179 C135 P60573 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 1007307 T2179 C135 P60573 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1007307 T2118 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1
[junit4:junit4] 2> 1007308 T2118 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1007308 T2179 C135 P60573 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1007309 T2118 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1007353 T2151 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 3, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 1007596 T2118 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1007598 T2118 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:60579
[junit4:junit4] 2> 1007599 T2118 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1007600 T2118 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1007600 T2118 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1368985691694
[junit4:junit4] 2> 1007600 T2118 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1368985691694/solr.xml
[junit4:junit4] 2> 1007601 T2118 oasc.CoreContainer.<init> New CoreContainer 37649508
[junit4:junit4] 2> 1007602 T2118 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1368985691694/'
[junit4:junit4] 2> 1007602 T2118 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1368985691694/'
[junit4:junit4] 2> 1007708 T2118 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1007708 T2118 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1007709 T2118 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1007709 T2118 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1007710 T2118 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1007710 T2118 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1007711 T2118 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1007711 T2118 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1007711 T2118 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1007712 T2118 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1007728 T2118 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1007729 T2118 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:60479/solr
[junit4:junit4] 2> 1007730 T2118 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1007731 T2118 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1007758 T2191 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e55331 name:ZooKeeperConnection Watcher:127.0.0.1:60479 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1007759 T2118 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1007762 T2118 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1007773 T2118 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1007775 T2193 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@763012cc name:ZooKeeperConnection Watcher:127.0.0.1:60479/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1007775 T2118 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1007787 T2118 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1007817 T2141 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1007818 T2141 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:60573_y_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:60573/y_"}
[junit4:junit4] 2> 1007827 T2147 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1007827 T2140 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1007827 T2176 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1007827 T2160 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1007827 T2193 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1008354 T2151 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 3, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 1008354 T2151 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=3&state=recovering&nodeName=127.0.0.1:60573_y_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1001
[junit4:junit4] 2> 1008790 T2118 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60579_y_
[junit4:junit4] 2> 1008792 T2118 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:60579_y_
[junit4:junit4] 2> 1008794 T2147 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1008794 T2140 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1008794 T2193 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1008794 T2176 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1008794 T2193 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1008794 T2160 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1008795 T2160 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1008795 T2147 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1008795 T2140 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1008810 T2176 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1008815 T2194 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1368985691694/collection1
[junit4:junit4] 2> 1008815 T2194 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1008816 T2194 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1008816 T2194 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1008817 T2194 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1368985691694/collection1/'
[junit4:junit4] 2> 1008818 T2194 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty3-1368985691694/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1008818 T2194 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty3-1368985691694/collection1/lib/README' to classloader
[junit4:junit4] 2> 1008850 T2194 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 1008892 T2194 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1008994 T2194 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1008999 T2194 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1009414 T2194 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 1009423 T2194 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1009425 T2194 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1009435 T2194 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1009439 T2194 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1009442 T2194 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1009442 T2194 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1009443 T2194 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 1009443 T2194 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1009444 T2194 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1009444 T2194 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 1009444 T2194 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 1009445 T2194 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1368985691694/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty3/
[junit4:junit4] 2> 1009445 T2194 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@30d647d8
[junit4:junit4] 2> 1009445 T2194 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 1009446 T2194 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty3
[junit4:junit4] 2> 1009446 T2194 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty3/index/
[junit4:junit4] 2> 1009447 T2194 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1009447 T2194 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty3/index
[junit4:junit4] 2> 1009481 T2194 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@5b5e2bec; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1009481 T2194 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1009483 T2194 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1009483 T2194 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1009483 T2194 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1009484 T2194 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1009484 T2194 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1009484 T2194 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1009484 T2194 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1009485 T2194 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1009485 T2194 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1009491 T2194 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1009497 T2194 oass.SolrIndexSearcher.<init> Opening Searcher@2099868c main
[junit4:junit4] 2> 1009498 T2194 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1009498 T2194 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1009501 T2195 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2099868c main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1009502 T2194 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1009502 T2194 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> C135_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:60573_y_, base_url=http://127.0.0.1:60573/y_}
[junit4:junit4] 2> 1010356 T2179 C135 P60573 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:60547/y_/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 1010356 T2179 C135 P60573 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:60573/y_ START replicas=[http://127.0.0.1:60547/y_/collection1/] nUpdates=100
[junit4:junit4] 2> 1010356 T2179 C135 P60573 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 1010357 T2179 C135 P60573 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 1010357 T2179 C135 P60573 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 1010357 T2179 C135 P60573 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 1010357 T2179 C135 P60573 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 1010358 T2179 C135 P60573 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:60547/y_/collection1/. core=collection1
[junit4:junit4] 2> 1010358 T2179 C135 P60573 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C136 name=collection1 org.apache.solr.core.SolrCore@36effd05 url=http://127.0.0.1:60547/y_/collection1 node=127.0.0.1:60547_y_ C136_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:60547_y_, base_url=http://127.0.0.1:60547/y_, leader=true}
[junit4:junit4] 2> 1010363 T2150 C136 P60547 oasc.SolrCore.execute [collection1] webapp=/y_ path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 1010369 T2152 C136 P60547 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1010372 T2152 C136 P60547 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6f53c131; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1010372 T2152 C136 P60547 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1010383 T2152 C136 P60547 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6f53c131; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6f53c131; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1010383 T2152 C136 P60547 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1010384 T2152 C136 P60547 oass.SolrIndexSearcher.<init> Opening Searcher@7e0f0b5d realtime
[junit4:junit4] 2> 1010385 T2152 C136 P60547 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1010385 T2152 C136 P60547 oasup.LogUpdateProcessor.finish [collection1] webapp=/y_ path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 17
[junit4:junit4] 2> 1010386 T2179 C135 P60573 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1010386 T2179 C135 P60573 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 1010387 T2153 C136 P60547 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1010387 T2153 C136 P60547 oasc.SolrCore.execute [collection1] webapp=/y_ path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4] 2> 1010388 T2179 C135 P60573 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 1010388 T2179 C135 P60573 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 1010388 T2179 C135 P60573 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 1010390 T2153 C136 P60547 oasc.SolrCore.execute [collection1] webapp=/y_ path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 1010391 T2179 C135 P60573 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 1010392 T2179 C135 P60573 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty2/index.20130520064814758
[junit4:junit4] 2> 1010392 T2179 C135 P60573 oash.SnapPuller.fetchLatestIndex Starting download to NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty2/index.20130520064814758 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1deea715; maxCacheMB=48.0 maxMergeSizeMB=4.0) fullCopy=false
[junit4:junit4] 2> 1010395 T2153 C136 P60547 oasc.SolrCore.execute [collection1] webapp=/y_ path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 1010396 T2179 C135 P60573 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 1010398 T2179 C135 P60573 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 1010398 T2179 C135 P60573 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 1010401 T2179 C135 P60573 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@44d38ef0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@44d38ef0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1010401 T2179 C135 P60573 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1010401 T2179 C135 P60573 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 1010402 T2179 C135 P60573 oass.SolrIndexSearcher.<init> Opening Searcher@6b9844b2 main
[junit4:junit4] 2> 1010403 T2178 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6b9844b2 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1010403 T2179 C135 P60573 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty2/index.20130520064814758 [CachedDir<<refCount=0;path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty2/index.20130520064814758;done=true>>]
[junit4:junit4] 2> 1010403 T2179 C135 P60573 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty2/index.20130520064814758
[junit4:junit4] 2> 1010403 T2179 C135 P60573 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty2/index.20130520064814758
[junit4:junit4] 2> 1010404 T2179 C135 P60573 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 1010404 T2179 C135 P60573 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 1010404 T2179 C135 P60573 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1010404 T2179 C135 P60573 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1010405 T2179 C135 P60573 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 1010840 T2141 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1010841 T2141 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:60579_y_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:60579/y_"}
[junit4:junit4] 2> 1010841 T2141 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 1010841 T2141 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 1010845 T2141 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:60573_y_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:60573/y_"}
[junit4:junit4] 2> 1010858 T2160 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1010858 T2147 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1010858 T2176 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1010858 T2193 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1010858 T2140 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1011505 T2194 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1011505 T2194 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:60579/y_ collection:collection1 shard:shard1
[junit4:junit4] 2> 1011534 T2194 oasc.ZkController.register We are http://127.0.0.1:60579/y_/collection1/ and leader is http://127.0.0.1:60547/y_/collection1/
[junit4:junit4] 2> 1011535 T2194 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:60579/y_
[junit4:junit4] 2> 1011535 T2194 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 1011535 T2194 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C137 name=collection1 org.apache.solr.core.SolrCore@4005e8cd url=http://127.0.0.1:60579/y_/collection1 node=127.0.0.1:60579_y_ C137_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:60579_y_, base_url=http://127.0.0.1:60579/y_}
[junit4:junit4] 2> 1011535 T2198 C137 P60579 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 1011536 T2194 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1011536 T2198 C137 P60579 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 1011537 T2198 C137 P60579 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 1011537 T2198 C137 P60579 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1011537 T2118 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1
[junit4:junit4] 2> 1011538 T2118 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1011538 T2118 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1011539 T2198 C137 P60579 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1011558 T2154 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 1011751 T2118 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1011753 T2118 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:60591
[junit4:junit4] 2> 1011754 T2118 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1011754 T2118 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1011754 T2118 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1368985695924
[junit4:junit4] 2> 1011755 T2118 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1368985695924/solr.xml
[junit4:junit4] 2> 1011755 T2118 oasc.CoreContainer.<init> New CoreContainer 1511141056
[junit4:junit4] 2> 1011755 T2118 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1368985695924/'
[junit4:junit4] 2> 1011756 T2118 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1368985695924/'
[junit4:junit4] 2> 1011825 T2118 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1011826 T2118 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1011826 T2118 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1011826 T2118 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1011827 T2118 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1011827 T2118 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1011827 T2118 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1011828 T2118 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1011828 T2118 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1011828 T2118 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1011838 T2118 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1011839 T2118 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:60479/solr
[junit4:junit4] 2> 1011839 T2118 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1011840 T2118 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1011842 T2210 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a0e8878 name:ZooKeeperConnection Watcher:127.0.0.1:60479 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1011842 T2118 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1011844 T2118 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1011851 T2118 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1011853 T2212 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ec55c55 name:ZooKeeperConnection Watcher:127.0.0.1:60479/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1011853 T2118 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1011864 T2118 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1012363 T2141 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1012364 T2141 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:60579_y_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:60579/y_"}
[junit4:junit4] 2> 1012399 T2140 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1012400 T2193 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1012400 T2176 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1012400 T2212 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1012400 T2160 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1012399 T2147 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1012559 T2154 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 1012559 T2154 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=4&state=recovering&nodeName=127.0.0.1:60579_y_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1001
[junit4:junit4] 2> 1012866 T2118 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60591_y_
[junit4:junit4] 2> 1012868 T2118 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:60591_y_
[junit4:junit4] 2> 1012870 T2212 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1012870 T2147 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1012870 T2193 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1012870 T2176 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1012870 T2140 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1012870 T2193 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1012870 T2160 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1012871 T2160 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1012871 T2212 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1012872 T2147 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1012880 T2176 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1012880 T2140 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1012885 T2213 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1368985695924/collection1
[junit4:junit4] 2> 1012885 T2213 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1012885 T2213 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1012886 T2213 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1012887 T2213 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1368985695924/collection1/'
[junit4:junit4] 2> 1012888 T2213 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty4-1368985695924/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1012888 T2213 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty4-1368985695924/collection1/lib/README' to classloader
[junit4:junit4] 2> 1012922 T2213 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 1012971 T2213 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1013077 T2213 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1013081 T2213 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1013484 T2213 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 1013493 T2213 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1013496 T2213 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1013508 T2213 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1013512 T2213 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1013515 T2213 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1013516 T2213 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1013517 T2213 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 1013517 T2213 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1013518 T2213 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1013518 T2213 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 1013518 T2213 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 1013518 T2213 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1368985695924/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty4/
[junit4:junit4] 2> 1013519 T2213 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@30d647d8
[junit4:junit4] 2> 1013519 T2213 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 1013520 T2213 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty4
[junit4:junit4] 2> 1013520 T2213 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty4/index/
[junit4:junit4] 2> 1013521 T2213 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1013521 T2213 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty4/index
[junit4:junit4] 2> 1013526 T2213 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6aa428aa; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1013526 T2213 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1013528 T2213 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1013528 T2213 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1013529 T2213 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1013529 T2213 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1013530 T2213 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1013530 T2213 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1013530 T2213 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1013530 T2213 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1013531 T2213 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1013537 T2213 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1013543 T2213 oass.SolrIndexSearcher.<init> Opening Searcher@1a9826da main
[junit4:junit4] 2> 1013544 T2213 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1013544 T2213 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1013547 T2214 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1a9826da main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1013548 T2213 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1013548 T2213 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1013904 T2141 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1013905 T2141 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:60591_y_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:60591/y_"}
[junit4:junit4] 2> 1013905 T2141 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 1013905 T2141 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 1013918 T2147 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1013918 T2176 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1013918 T2193 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1013918 T2140 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1013918 T2212 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1013918 T2160 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1014551 T2213 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1014551 T2213 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:60591/y_ collection:collection1 shard:shard1
[junit4:junit4] 2> C137_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:60579_y_, base_url=http://127.0.0.1:60579/y_}
[junit4:junit4] 2> 1014560 T2198 C137 P60579 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:60547/y_/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 1014560 T2198 C137 P60579 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:60579/y_ START replicas=[http://127.0.0.1:60547/y_/collection1/] nUpdates=100
[junit4:junit4] 2> 1014560 T2198 C137 P60579 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 1014561 T2198 C137 P60579 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 1014561 T2198 C137 P60579 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 1014561 T2198 C137 P60579 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 1014562 T2198 C137 P60579 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 1014562 T2198 C137 P60579 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:60547/y_/collection1/. core=collection1
[junit4:junit4] 2> 1014562 T2150 C136 P60547 oasc.SolrCore.execute [collection1] webapp=/y_ path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 1014562 T2198 C137 P60579 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1014563 T2213 oasc.ZkController.register We are http://127.0.0.1:60591/y_/collection1/ and leader is http://127.0.0.1:60547/y_/collection1/
[junit4:junit4] 2> 1014563 T2213 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:60591/y_
[junit4:junit4] 2> 1014564 T2213 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 1014564 T2213 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C138 name=collection1 org.apache.solr.core.SolrCore@28c0d943 url=http://127.0.0.1:60591/y_/collection1 node=127.0.0.1:60591_y_ C138_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:60591_y_, base_url=http://127.0.0.1:60591/y_}
[junit4:junit4] 2> 1014564 T2216 C138 P60591 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 1014565 T2216 C138 P60591 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 1014565 T2213 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1014565 T2216 C138 P60591 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 1014565 T2216 C138 P60591 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1014566 T2118 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1
[junit4:junit4] 2> 1014566 T2118 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1014566 T2118 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1014585 T2155 C136 P60547 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1014588 T2118 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1014588 T2216 C138 P60591 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1014589 T2118 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 2> 1014589 T2118 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 2> 1014590 T2118 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1014599 T2156 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 1014617 T2155 C136 P60547 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6f53c131; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6f53c131; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> 1014617 T2155 C136 P60547 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 1014618 T2155 C136 P60547 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1014618 T2155 C136 P60547 oasup.LogUpdateProcessor.finish [collection1] webapp=/y_ path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 33
[junit4:junit4] 2> 1014618 T2198 C137 P60579 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1014619 T2198 C137 P60579 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 1014621 T2153 C136 P60547 oasc.SolrCore.execute [collection1] webapp=/y_ path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4] 2> 1014621 T2198 C137 P60579 oash.SnapPuller.fetchLatestIndex Master's generation: 3
[junit4:junit4] 2> 1014621 T2198 C137 P60579 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 1014621 T2198 C137 P60579 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 1014624 T2153 C136 P60547 oasc.SolrCore.execute [collection1] webapp=/y_ path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=3&version=2} status=0 QTime=0
[junit4:junit4] 2> 1014624 T2198 C137 P60579 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 1014625 T2198 C137 P60579 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty3/index.20130520064818992
[junit4:junit4] 2> 1014626 T2198 C137 P60579 oash.SnapPuller.fetchLatestIndex Starting download to NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty3/index.20130520064818992 lockFactory=org.apache.lucene.store.NativeFSLockFactory@700bdcb4; maxCacheMB=48.0 maxMergeSizeMB=4.0) fullCopy=false
[junit4:junit4] 2> 1014629 T2153 C136 P60547 oasc.SolrCore.execute [collection1] webapp=/y_ path=/replication params={file=segments_3&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=3} status=0 QTime=0
[junit4:junit4] 2> 1014630 T2198 C137 P60579 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 1014631 T2198 C137 P60579 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 1014631 T2198 C137 P60579 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 1014634 T2198 C137 P60579 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@5b5e2bec; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@5b5e2bec; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> 1014635 T2198 C137 P60579 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 1014635 T2198 C137 P60579 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 1014636 T2198 C137 P60579 oass.SolrIndexSearcher.<init> Opening Searcher@2af091d5 main
[junit4:junit4] 2> 1014637 T2195 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2af091d5 main{StandardDirectoryReader(segments_3:1:nrt)}
[junit4:junit4] 2> 1014637 T2198 C137 P60579 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty3/index.20130520064818992 [CachedDir<<refCount=0;path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty3/index.20130520064818992;done=true>>]
[junit4:junit4] 2> 1014637 T2198 C137 P60579 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty3/index.20130520064818992
[junit4:junit4] 2> 1014637 T2198 C137 P60579 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty3/index.20130520064818992
[junit4:junit4] 2> 1014638 T2198 C137 P60579 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 1014638 T2198 C137 P60579 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 1014638 T2198 C137 P60579 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1014638 T2198 C137 P60579 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1014662 T2198 C137 P60579 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 1015422 T2141 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1015423 T2141 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:60591_y_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:60591/y_"}
[junit4:junit4] 2> 1015438 T2141 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:60579_y_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:60579/y_"}
[junit4:junit4] 2> 1015454 T2140 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1015454 T2193 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1015454 T2212 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1015454 T2147 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1015454 T2176 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1015454 T2160 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1015591 T2118 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1015600 T2156 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 1015600 T2156 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=5&state=recovering&nodeName=127.0.0.1:60591_y_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1001
[junit4:junit4] 2> 1016593 T2118 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1017595 T2118 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C138_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:60591_y_, base_url=http://127.0.0.1:60591/y_}
[junit4:junit4] 2> 1017601 T2216 C138 P60591 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:60547/y_/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 1017601 T2216 C138 P60591 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:60591/y_ START replicas=[http://127.0.0.1:60547/y_/collection1/] nUpdates=100
[junit4:junit4] 2> 1017601 T2216 C138 P60591 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 1017602 T2216 C138 P60591 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 1017602 T2216 C138 P60591 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 1017602 T2216 C138 P60591 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 1017602 T2216 C138 P60591 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 1017602 T2216 C138 P60591 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:60547/y_/collection1/. core=collection1
[junit4:junit4] 2> 1017602 T2216 C138 P60591 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1017603 T2150 C136 P60547 oasc.SolrCore.execute [collection1] webapp=/y_ path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 1017617 T2151 C136 P60547 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1017646 T2151 C136 P60547 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=3
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6f53c131; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6f53c131; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6f53c131; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> 1017647 T2151 C136 P60547 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4:junit4] 2> 1017648 T2151 C136 P60547 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1017648 T2151 C136 P60547 oasup.LogUpdateProcessor.finish [collection1] webapp=/y_ path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 31
[junit4:junit4] 2> 1017648 T2216 C138 P60591 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1017649 T2216 C138 P60591 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 1017651 T2153 C136 P60547 oasc.SolrCore.execute [collection1] webapp=/y_ path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4] 2> 1017651 T2216 C138 P60591 oash.SnapPuller.fetchLatestIndex Master's generation: 4
[junit4:junit4] 2> 1017652 T2216 C138 P60591 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 1017652 T2216 C138 P60591 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 1017654 T2153 C136 P60547 oasc.SolrCore.execute [collection1] webapp=/y_ path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=4&version=2} status=0 QTime=0
[junit4:junit4] 2> 1017655 T2216 C138 P60591 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 1017657 T2216 C138 P60591 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty4/index.20130520064822022
[junit4:junit4] 2> 1017658 T2216 C138 P60591 oash.SnapPuller.fetchLatestIndex Starting download to NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty4/index.20130520064822022 lockFactory=org.apache.lucene.store.NativeFSLockFactory@47881035; maxCacheMB=48.0 maxMergeSizeMB=4.0) fullCopy=false
[junit4:junit4] 2> 1017661 T2153 C136 P60547 oasc.SolrCore.execute [collection1] webapp=/y_ path=/replication params={file=segments_4&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=4} status=0 QTime=0
[junit4:junit4] 2> 1017662 T2216 C138 P60591 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 1017665 T2216 C138 P60591 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 1017665 T2216 C138 P60591 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 1017669 T2216 C138 P60591 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6aa428aa; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6aa428aa; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> 1017671 T2216 C138 P60591 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4:junit4] 2> 1017671 T2216 C138 P60591 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 1017672 T2216 C138 P60591 oass.SolrIndexSearcher.<init> Opening Searcher@6aef2f29 main
[junit4:junit4] 2> 1017673 T2214 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6aef2f29 main{StandardDirectoryReader(segments_4:1:nrt)}
[junit4:junit4] 2> 1017673 T2216 C138 P60591 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty4/index.20130520064822022 [CachedDir<<refCount=0;path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty4/index.20130520064822022;done=true>>]
[junit4:junit4] 2> 1017674 T2216 C138 P60591 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty4/index.20130520064822022
[junit4:junit4] 2> 1017674 T2216 C138 P60591 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty4/index.20130520064822022
[junit4:junit4] 2> 1017675 T2216 C138 P60591 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 1017675 T2216 C138 P60591 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 1017675 T2216 C138 P60591 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1017675 T2216 C138 P60591 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1017677 T2216 C138 P60591 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 1018462 T2141 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1018463 T2141 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:60591_y_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:60591/y_"}
[junit4:junit4] 2> 1018481 T2140 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1018481 T2193 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1018481 T2176 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1018481 T2160 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1018481 T2147 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1018481 T2212 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1018597 T2118 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1018598 T2118 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> ASYNC NEW_CORE C139 name=collection1 org.apache.solr.core.SolrCore@21a1f1dc url=http://127.0.0.1:60482/y_/collection1 node=127.0.0.1:60482_y_ C139_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:60482_y_, base_url=http://127.0.0.1:60482/y_, leader=true}
[junit4:junit4] 2> 1018606 T2130 C139 P60482 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1018610 T2130 C139 P60482 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1b7664f0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1018611 T2130 C139 P60482 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1018614 T2130 C139 P60482 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1b7664f0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1b7664f0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1018614 T2130 C139 P60482 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1018616 T2130 C139 P60482 oass.SolrIndexSearcher.<init> Opening Searcher@403e47a1 main
[junit4:junit4] 2> 1018616 T2130 C139 P60482 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1018617 T2144 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@403e47a1 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1018617 T2130 C139 P60482 oasup.LogUpdateProcessor.finish [collection1] webapp=/y_ path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 11
[junit4:junit4] 2> 1018624 T2152 C136 P60547 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1018627 T2152 C136 P60547 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=4
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6f53c131; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6f53c131; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6f53c131; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6f53c131; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5}
[junit4:junit4] 2> 1018628 T2152 C136 P60547 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 5
[junit4:junit4] 2> 1018628 T2152 C136 P60547 oass.SolrIndexSearcher.<init> Opening Searcher@31df630b main
[junit4:junit4] 2> 1018629 T2152 C136 P60547 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1018629 T2162 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@31df630b main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1018630 T2152 C136 P60547 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:60573/y_/collection1/, StdNode: http://127.0.0.1:60579/y_/collection1/, StdNode: http://127.0.0.1:60591/y_/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> C138_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:60591_y_, base_url=http://127.0.0.1:60591/y_}
[junit4:junit4] 2> 1018641 T2202 C138 P60591 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> C135_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:60573_y_, base_url=http://127.0.0.1:60573/y_}
[junit4:junit4] 2> 1018642 T2166 C135 P60573 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> C137_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:60579_y_, base_url=http://127.0.0.1:60579/y_}
[junit4:junit4] 2> 1018642 T2183 C137 P60579 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1018655 T2202 C138 P60591 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6aa428aa; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6aa428aa; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5}
[junit4:junit4] 2> 1018656 T2202 C138 P60591 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 5
[junit4:junit4] 2> 1018657 T2202 C138 P60591 oass.SolrIndexSearcher.<init> Opening Searcher@576268bf main
[junit4:junit4] 2> 1018658 T2202 C138 P60591 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1018658 T2183 C137 P60579 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@5b5e2bec; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@5b5e2bec; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> 1018658 T2214 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@576268bf main{StandardDirectoryReader(segments_4:1:nrt)}
[junit4:junit4] 2> 1018658 T2183 C137 P60579 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4:junit4] 2> 1018658 T2166 C135 P60573 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@44d38ef0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@44d38ef0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> 1018659 T2202 C138 P60591 oasup.LogUpdateProcessor.finish [collection1] webapp=/y_ path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 18
[junit4:junit4] 2> 1018659 T2166 C135 P60573 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 1018660 T2183 C137 P60579 oass.SolrIndexSearcher.<init> Opening Searcher@1a886fab main
[junit4:junit4] 2> 1018660 T2183 C137 P60579 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1018660 T2195 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1a886fab main{StandardDirectoryReader(segments_3:1:nrt)}
[junit4:junit4] 2> 1018661 T2183 C137 P60579 oasup.LogUpdateProcessor.finish [collection1] webapp=/y_ path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 19
[junit4:junit4] 2> 1018661 T2166 C135 P60573 oass.SolrIndexSearcher.<init> Opening Searcher@702d5442 main
[junit4:junit4] 2> 1018661 T2166 C135 P60573 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1018662 T2178 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@702d5442 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1018662 T2166 C135 P60573 oasup.LogUpdateProcessor.finish [collection1] webapp=/y_ path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 21
[junit4:junit4] 2> 1018662 T2152 C136 P60547 oasup.LogUpdateProcessor.finish [collection1] webapp=/y_ path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 38
[junit4:junit4] 2> 1018663 T2118 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1018665 T2154 C136 P60547 oasc.SolrCore.execute [collection1] webapp=/y_ path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 1018666 T2167 C135 P60573 oasc.SolrCore.execute [collection1] webapp=/y_ path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 1018667 T2184 C137 P60579 oasc.SolrCore.execute [collection1] webapp=/y_ path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 1018668 T2203 C138 P60591 oasc.SolrCore.execute [collection1] webapp=/y_ path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 1020674 T2130 C139 P60482 oasup.LogUpdateProcessor.finish [collection1] webapp=/y_ path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1435485554646974464)} 0 2
[junit4:junit4] 2> 1020682 T2166 C135 P60573 oasup.LogUpdateProcessor.finish [collection1] webapp=/y_ path=/update params={update.distrib=FROMLEADER&_version_=-1435485554652217344&update.from=http://127.0.0.1:60547/y_/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1435485554652217344)} 0 1
[junit4:junit4] 2> 1020683 T2202 C138 P60591 oasup.LogUpdateProcessor.finish [collection1] webapp=/y_ path=/update params={update.distrib=FROMLEADER&_version_=-1435485554652217344&update.from=http://127.0.0.1:60547/y_/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1435485554652217344)} 0 2
[junit4:junit4] 2> 1020683 T2183 C137 P60579 oasup.LogUpdateProcessor.finish [collection1] webapp=/y_ path=/update params={update.distrib=FROMLEADER&_version_=-1435485554652217344&update.from=http://127.0.0.1:60547/y_/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1435485554652217344)} 0 2
[junit4:junit4] 2> 1020684 T2152 C136 P60547 oasup.LogUpdateProcessor.finish [collection1] webapp=/y_ path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1435485554652217344)} 0 7
[junit4:junit4] 2> 1020688 T2130 C139 P60482 oasup.LogUpdateProcessor.finish [collection1] webapp=/y_ path=/update params={wt=javabin&version=2} {add=[0 (1435485554661654528)]} 0 2
[junit4:junit4] 2> 1020695 T2183 C137 P60579 oasup.LogUpdateProcessor.finish [collection1] webapp=/y_ path=/update params={distrib.from=http://127.0.0.1:60547/y_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1435485554665848832)]} 0 2
[junit4:junit4] 2> 1020695 T2166 C135 P60573 oasup.LogUpdateProcessor.finish [collection1] webapp=/y_ path=/update params={distrib.from=http://127.0.0.1:60547/y_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1435485554665848832)]} 0 2
[junit4:junit4] 2> 1020695 T2202 C138 P60591 oasup.LogUpdateProcessor.finish [collection1] webapp=/y_ path=/update params={distrib.from=http://127.0.0.1:60547/y_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1435485554665848832)]} 0 2
[junit4:junit4] 2> 1020696 T2152 C136 P60547 oasup.LogUpdateProcessor.finish [collection1] webapp=/y_ path=/update params={wt=javabin&version=2} {add=[0 (1435485554665848832)]} 0 6
[junit4:junit4] 2> 1020698 T2130 C139 P60482 oasup.LogUpdateProcessor.finish [collection1] webapp=/y_ path=/update params={wt=javabin&version=2} {add=[1 (1435485554674237440)]} 0 0
[junit4:junit4] 2> 1020703 T2166 C135 P60573 oasup.LogUpdateProcessor.finish [collection1] webapp=/y_ path=/update params={distrib.from=http://127.0.0.1:60547/y_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1435485554677383168)]} 0 0
[junit4:junit4] 2> 1020703 T2202 C138 P60591 oasup.LogUpdateProcessor.finish [collection1] webapp=/y_ path=/update params={distrib.from=http://127.0.0.1:60547/y_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1435485554677383168)]} 0 0
[junit4:junit4] 2> 1020703 T2183 C137 P60579 oasup.LogUpdateProcessor.finish [collection1] webapp=/y_ path=/update params={distrib.from=http://127.0.0.1:60547/y_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1435485554677383168)]} 0 0
[junit4:junit4] 2> 1020704 T2152 C136 P60547 oasup.LogUpdateProcessor.finish [collection1] webapp=/y_ path=/update params={wt=javabin&version=2} {add=[1 (1435485554677383168)]} 0 3
[junit4:junit4] 2> 1020707 T2130 C139 P60482 oasup.LogUpdateProcessor.finish [collection1] webapp=/y_ path=/update params={wt=javabin&version=2} {add=[2 (1435485554683674624)]} 0 0
[junit4:junit4] 2> 1020710 T2152 C136 P60547 oasup.DistributedUpdateProcessor.setupRequest test.distrib.skip.servers was found and contains:[http://127.0.0.1:60573/y_/collection1/]
[junit4:junit4] 2> 1020710 T2152 C136 P60547 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:60573/y_/collection1/ against:[http://127.0.0.1:60573/y_/collection1/] result:true
[junit4:junit4] 2> 1020711 T2152 C136 P60547 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:60579/y_/collection1/ against:[http://127.0.0.1:60573/y_/collection1/] result:false
[junit4:junit4] 2> 1020711 T2152 C136 P60547 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:60591/y_/collection1/ against:[http://127.0.0.1:60573/y_/collection1/] result:false
[junit4:junit4] 2> 1020714 T2183 C137 P60579 oasup.LogUpdateProcessor.finish [collection1] webapp=/y_ path=/update params={distrib.from=http://127.0.0.1:60547/y_/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:60573/y_/collection1/&wt=javabin&version=2} {add=[2 (1435485554687868928)]} 0 0
[junit4:junit4] 2> 1020714 T2202 C138 P60591 oasup.LogUpdateProcessor.finish [collection1] webapp=/y_ path=/update params={distrib.from=http://127.0.0.1:60547/y_/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:60573/y_/collection1/&wt=javabin&version=2} {add=[2 (1435485554687868928)]} 0 0
[junit4:junit4] 2> 1020715 T2152 C136 P60547 oasup.LogUpdateProcessor.finish [collection1] webapp=/y_ path=/update params={test.distrib.skip.servers=http://127.0.0.1:60573/y_/collection1/&wt=javabin&version=2} {add=[2 (1435485554687868928)]} 0 5
[junit4:junit4] 2> 1020717 T2130 C139 P60482 oasup.LogUpdateProcessor.finish [collection1] webapp=/y_ path=/update params={wt=javabin&version=2} {add=[3 (1435485554694160384)]} 0 0
[junit4:junit4] 2> 1020720 T2152 C136 P60547 oasup.DistributedUpdateProcessor.setupRequest test.distrib.skip.servers was found and contains:[http://127.0.0.1:60573/y_/collection1/, http://127.0.0.1:60579/y_/collection1/]
[junit4:junit4] 2> 1020720 T2152 C136 P60547 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:60573/y_/collection1/ against:[http://127.0.0.1:60573/y_/collection1/, http://127.0.0.1:60579/y_/collection1/] result:true
[junit4:junit4] 2> 1020721 T2152 C136 P60547 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:60579/y_/collection1/ against:[http://127.0.0.1:60573/y_/collection1/, http://127.0.0.1:60579/y_/collection1/] result:true
[junit4:junit4] 2> 1020721 T2152 C136 P60547 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:60591/y_/collection1/ against:[http://127.0.0.1:60573/y_/collection1/, http://127.0.0.1:60579/y_/collection1/] result:false
[junit4:junit4] 2> 1020724 T2202 C138 P60591 oasup.LogUpdateProcessor.finish [collection1] webapp=/y_ path=/update params={distrib.from=http://127.0.0.1:60547/y_/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:60573/y_/collection1/&wt=javabin&version=2} {add=[3 (1435485554698354688)]} 0 0
[junit4:junit4] 2> 1020725 T2152 C136 P60547 oasup.LogUpdateProcessor.finish [collection1] webapp=/y_ path=/update params={test.distrib.skip.servers=http://127.0.0.1:60573/y_/collection1/&test.distrib.skip.servers=http://127.0.0.1:60579/y_/collection1/&wt=javabin&version=2} {add=[3 (1435485554698354688)]} 0 5
[junit4:junit4] 2> 1020727 T2130 C139 P60482 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1020793 T2130 C139 P60482 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1b7664f0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1b7664f0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> 1020794 T2130 C139 P60482 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 1020799 T2130 C139 P60482 oass.SolrIndexSearcher.<init> Opening Searcher@26b8657 main
[junit4:junit4] 2> 1020799 T2130 C139 P60482 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1020800 T2144 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@26b8657 main{StandardDirectoryReader(segments_3:3:nrt _0(4.4):C4)}
[junit4:junit4] 2> 1020800 T2130 C139 P60482 oasup.LogUpdateProcessor.finish [collection1] webapp=/y_ path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 73
[junit4:junit4] 2> 1020802 T2152 C136 P60547 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1020847 T2152 C136 P60547 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=5
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6f53c131; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6f53c131; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6f53c131; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6f53c131; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6f53c131; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_6,generation=6}
[junit4:junit4] 2> 1020847 T2152 C136 P60547 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 6
[junit4:junit4] 2> 1020851 T2152 C136 P60547 oass.SolrIndexSearcher.<init> Opening Searcher@33e8c7b2 main
[junit4:junit4] 2> 1020852 T2152 C136 P60547 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1020852 T2162 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@33e8c7b2 main{StandardDirectoryReader(segments_6:3:nrt _0(4.4):C4)}
[junit4:junit4] 2> 1020852 T2152 C136 P60547 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:60573/y_/collection1/, StdNode: http://127.0.0.1:60579/y_/collection1/, StdNode: http://127.0.0.1:60591/y_/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 1020855 T2183 C137 P60579 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1020855 T2166 C135 P60573 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1020855 T2202 C138 P60591 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1020942 T2166 C135 P60573 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@44d38ef0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@44d38ef0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> 1020942 T2166 C135 P60573 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4:junit4] 2> 1020943 T2202 C138 P60591 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6aa428aa; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6aa428aa; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_6,generation=6}
[junit4:junit4] 2> 1020943 T2202 C138 P60591 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 6
[junit4:junit4] 2> 1020944 T2183 C137 P60579 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@5b5e2bec; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@5b5e2bec; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5}
[junit4:junit4] 2> 1020944 T2183 C137 P60579 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 5
[junit4:junit4] 2> 1020946 T2166 C135 P60573 oass.SolrIndexSearcher.<init> Opening Searcher@15ef3e72 main
[junit4:junit4] 2> 1020947 T2166 C135 P60573 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1020947 T2178 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@15ef3e72 main{StandardDirectoryReader(segments_4:3:nrt _0(4.4):C2)}
[junit4:junit4] 2> 1020947 T2202 C138 P60591 oass.SolrIndexSearcher.<init> Opening Searcher@49d16f21 main
[junit4:junit4] 2> 1020948 T2166 C135 P60573 oasup.LogUpdateProcessor.finish [collection1] webapp=/y_ path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 93
[junit4:junit4] 2> 1020948 T2202 C138 P60591 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1020948 T2183 C137 P60579 oass.SolrIndexSearcher.<init> Opening Searcher@518f5f6d main
[junit4:junit4] 2> 1020948 T2214 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@49d16f21 main{StandardDirectoryReader(segments_6:3:nrt _0(4.4):C4)}
[junit4:junit4] 2> 1020949 T2183 C137 P60579 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1020949 T2202 C138 P60591 oasup.LogUpdateProcessor.finish [collection1] webapp=/y_ path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 94
[junit4:junit4] 2> 1020949 T2195 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@518f5f6d main{StandardDirectoryReader(segments_5:3:nrt _0(4.4):C3)}
[junit4:junit4] 2> 1020949 T2183 C137 P60579 oasup.LogUpdateProcessor.finish [collection1] webapp=/y_ path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 94
[junit4:junit4] 2> 1020950 T2152 C136 P60547 oasup.LogUpdateProcessor.finish [collection1] webapp=/y_ path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 148
[junit4:junit4] 2> 1020950 T2118 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):230
[junit4:junit4] 2> 1020951 T2118 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1020951 T2118 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> 1020954 T2154 C136 P60547 oasc.SolrCore.execute [collection1] webapp=/y_ path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=0
[junit4:junit4] 2> 1020956 T2167 C135 P60573 oasc.SolrCore.execute [collection1] webapp=/y_ path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=2 status=0 QTime=0
[junit4:junit4] 2> 1020958 T2184 C137 P60579 oasc.SolrCore.execute [collection1] webapp=/y_ path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=3 status=0 QTime=0
[junit4:junit4] 2> 1020960 T2203 C138 P60591 oasc.SolrCore.execute [collection1] webapp=/y_ path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=0
[junit4:junit4] 2> 1020964 T2118 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1020978 T2185 oasha.CollectionsHandler.handleSyncShardAction Syncing shard : shard=shard1&action=SYNCSHARD&collection=collection1&wt=javabin&version=2
[junit4:junit4] 2> 1020979 T2185 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1020985 T2155 oasha.CoreAdminHandler.handleRequestSyncAction I have been requested to sync up my shard
[junit4:junit4] 2> 1020986 T2155 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:60547/y_/collection1/
[junit4:junit4] 2> 1020986 T2155 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:60547/y_ START replicas=[http://127.0.0.1:60573/y_/collection1/, http://127.0.0.1:60579/y_/collection1/, http://127.0.0.1:60591/y_/collection1/] nUpdates=100
[junit4:junit4] 2> 1020987 T2186 C137 P60579 oasc.SolrCore.execute [collection1] webapp=/y_ path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 1020987 T2168 C135 P60573 oasc.SolrCore.execute [collection1] webapp=/y_ path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 1020988 T2204 C138 P60591 oasc.SolrCore.execute [collection1] webapp=/y_ path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 1020988 T2155 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:60547/y_ Received 4 versions from 127.0.0.1:60579/y_/collection1/
[junit4:junit4] 2> 1020988 T2155 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:60547/y_ Our versions are newer. ourLowThreshold=1435485554652217344 otherHigh=1435485554687868928
[junit4:junit4] 2> 1020988 T2155 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:60547/y_ Received 3 versions from 127.0.0.1:60573/y_/collection1/
[junit4:junit4] 2> 1020989 T2155 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:60547/y_ Our versions are newer. ourLowThreshold=1435485554652217344 otherHigh=1435485554677383168
[junit4:junit4] 2> 1020989 T2155 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:60547/y_ Received 5 versions from 127.0.0.1:60591/y_/collection1/
[junit4:junit4] 2> 1020989 T2155 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:60547/y_ Our versions are newer. ourLowThreshold=1435485554652217344 otherHigh=1435485554687868928
[junit4:junit4] 2> 1020989 T2155 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:60547/y_ DONE. sync succeeded
[junit4:junit4] 2> 1020989 T2155 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 1020990 T2155 oasc.SyncStrategy.syncToMe http://127.0.0.1:60547/y_/collection1/: try and ask http://127.0.0.1:60573/y_/collection1/ to sync
[junit4:junit4] 2> 1020990 T2155 oasc.SyncStrategy.syncToMe http://127.0.0.1:60547/y_/collection1/: try and ask http://127.0.0.1:60579/y_/collection1/ to sync
[junit4:junit4] 2> 1020990 T2155 oasc.SyncStrategy.syncToMe http://127.0.0.1:60547/y_/collection1/: try and ask http://127.0.0.1:60591/y_/collection1/ to sync
[junit4:junit4] 2> 1020991 T2169 C135 P60573 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:60573/y_ START replicas=[http://127.0.0.1:60547/y_/collection1/] nUpdates=100
[junit4:junit4] 2> 1020991 T2187 C137 P60579 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:60579/y_ START replicas=[http://127.0.0.1:60547/y_/collection1/] nUpdates=100
[junit4:junit4] 2> 1020991 T2205 C138 P60591 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:60591/y_ START replicas=[http://127.0.0.1:60547/y_/collection1/] nUpdates=100
[junit4:junit4] 2> 1020992 T2156 C136 P60547 oasc.SolrCore.execute [collection1] webapp=/y_ path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 1020992 T2151 C136 P60547 oasc.SolrCore.execute [collection1] webapp=/y_ path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 1020992 T2187 C137 P60579 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:60579/y_ Received 5 versions from 127.0.0.1:60547/y_/collection1/
[junit4:junit4] 2> 1020992 T2205 C138 P60591 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:60591/y_ Received 5 versions from 127.0.0.1:60547/y_/collection1/
[junit4:junit4] 2> 1020993 T2150 C136 P60547 oasc.SolrCore.execute [collection1] webapp=/y_ path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 1020993 T2187 C137 P60579 oasu.PeerSync.requestUpdates PeerSync: core=collection1 url=http://127.0.0.1:60579/y_ Requesting updates from 127.0.0.1:60547/y_/collection1/n=1 versions=[1435485554698354688]
[junit4:junit4] 2> 1020993 T2169 C135 P60573 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:60573/y_ Received 5 versions from 127.0.0.1:60547/y_/collection1/
[junit4:junit4] 2> 1020993 T2205 C138 P60591 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:60591/y_ Our versions are newer. ourLowThreshold=1435485554652217344 otherHigh=1435485554687868928
[junit4:junit4] 2> 1020994 T2169 C135 P60573 oasu.PeerSync.requestUpdates PeerSync: core=collection1 url=http://127.0.0.1:60573/y_ Requesting updates from 127.0.0.1:60547/y_/collection1/n=2 versions=[1435485554698354688, 1435485554687868928]
[junit4:junit4] 2> 1020994 T2205 C138 P60591 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:60591/y_ DONE. sync succeeded
[junit4:junit4] 2> 1020994 T2205 C138 P60591 oasc.SolrCore.execute [collection1] webapp=/y_ path=/get params={sync=http://127.0.0.1:60547/y_/collection1/&getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=3
[junit4:junit4] 2> 1020994 T2155 oasc.SyncStrategy.syncToMe http://127.0.0.1:60547/y_/collection1/: sync completed with http://127.0.0.1:60591/y_/collection1/
[junit4:junit4] 2> 1020995 T2150 C136 P60547 oasc.SolrCore.execute [collection1] webapp=/y_ path=/get params={distrib=false&getUpdates=1435485554698354688&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 1020997 T2151 C136 P60547 oasc.SolrCore.execute [collection1] webapp=/y_ path=/get params={distrib=false&getUpdates=1435485554698354688,1435485554687868928&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 1021000 T2187 C137 P60579 oasup.LogUpdateProcessor.finish [collection1] {add=[3 (1435485554698354688)]} 0 5
[junit4:junit4] 2> 1021000 T2187 C137 P60579 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:60579/y_ DONE. sync succeeded
[junit4:junit4] 2> 1021000 T2187 C137 P60579 oasc.SolrCore.execute [collection1] webapp=/y_ path=/get params={sync=http://127.0.0.1:60547/y_/collection1/&getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=9
[junit4:junit4] 2> 1021000 T2169 C135 P60573 oasup.LogUpdateProcessor.finish [collection1] {add=[2 (1435485554687868928), 3 (1435485554698354688)]} 0 2
[junit4:junit4] 2> 1021000 T2155 oasc.SyncStrategy.syncToMe http://127.0.0.1:60547/y_/collection1/: sync completed with http://127.0.0.1:60579/y_/collection1/
[junit4:junit4] 2> 1021001 T2169 C135 P60573 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:60573/y_ DONE. sync succeeded
[junit4:junit4] 2> 1021001 T2169 C135 P60573 oasc.SolrCore.execute [collection1] webapp=/y_ path=/get params={sync=http://127.0.0.1:60547/y_/collection1/&getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=10
[junit4:junit4] 2> 1021001 T2155 oasc.SyncStrategy.syncToMe http://127.0.0.1:60547/y_/collection1/: sync completed with http://127.0.0.1:60573/y_/collection1/
[junit4:junit4] 2> 1021001 T2155 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={shard=shard1&action=REQUESTSYNCSHARD&core=collection1&collection=collection1&wt=javabin&version=2} status=0 QTime=16
[junit4:junit4] 2> 1021002 T2185 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/collections params={shard=shard1&action=SYNCSHARD&collection=collection1&wt=javabin&version=2} status=0 QTime=28
[junit4:junit4] 2> 1021003 T2118 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 2> 1021003 T2118 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 2> 1021004 T2118 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1021004 T2118 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> 1021006 T2130 C139 P60482 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1021012 T2130 C139 P60482 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1b7664f0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1b7664f0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> 1021013 T2130 C139 P60482 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4:junit4] 2> 1021014 T2130 C139 P60482 oass.SolrIndexSearcher.<init> Opening Searcher@6c2bb5d3 main
[junit4:junit4] 2> 1021014 T2130 C139 P60482 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1021015 T2144 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6c2bb5d3 main{StandardDirectoryReader(segments_3:3:nrt _0(4.4):C4)}
[junit4:junit4] 2> 1021015 T2130 C139 P60482 oasup.LogUpdateProcessor.finish [collection1] webapp=/y_ path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 9
[junit4:junit4] 2> 1021018 T2152 C136 P60547 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1021032 T2152 C136 P60547 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=4
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6f53c131; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6f53c131; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6f53c131; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_6,generation=6}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6f53c131; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_7,generation=7}
[junit4:junit4] 2> 1021033 T2152 C136 P60547 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 7
[junit4:junit4] 2> 1021034 T2152 C136 P60547 oass.SolrIndexSearcher.<init> Opening Searcher@78f47b40 main
[junit4:junit4] 2> 1021034 T2152 C136 P60547 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1021035 T2162 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@78f47b40 main{StandardDirectoryReader(segments_6:3:nrt _0(4.4):C4)}
[junit4:junit4] 2> 1021035 T2152 C136 P60547 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:60573/y_/collection1/, StdNode: http://127.0.0.1:60579/y_/collection1/, StdNode: http://127.0.0.1:60591/y_/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 1021037 T2202 C138 P60591 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,ex
[...truncated too long message...]
ollection/leader_elect/shard1 (1)
[junit4:junit4] 1> /solr/collections/control_collection/leader_elect/shard1/election (1)
[junit4:junit4] 1> /solr/collections/control_collection/leader_elect/shard1/election/89717845370142723-1-n_0000000000 (0)
[junit4:junit4] 1> /solr/collections/control_collection/leaders (1)
[junit4:junit4] 1> /solr/collections/control_collection/leaders/shard1 (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "node_name":"127.0.0.1:60482_y_",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:60482/y_"}
[junit4:junit4] 1> /solr/overseer_elect (2)
[junit4:junit4] 1> /solr/overseer_elect/election (4)
[junit4:junit4] 1> /solr/overseer_elect/election/89717845370142723-127.0.0.1:60482_y_-n_0000000000 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89717845370142734-127.0.0.1:60547_y_-n_0000000005 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89717845370142732-127.0.0.1:60591_y_-n_0000000004 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89717845370142730-127.0.0.1:60579_y_-n_0000000003 (0)
[junit4:junit4] 1> /solr/overseer_elect/leader (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {"id":"89717845370142723-127.0.0.1:60482_y_-n_0000000000"}
[junit4:junit4] 1> /zookeeper (1)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1>
[junit4:junit4] 1>
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=SyncSliceTest -Dtests.method=testDistribSearch -Dtests.seed=CC0CA1ECBEF18497 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=mk_MK -Dtests.timezone=MIT -Dtests.file.encoding=ISO-8859-1
[junit4:junit4] FAILURE 837s J1 | SyncSliceTest.testDistribSearch <<<
[junit4:junit4] > Throwable #1: java.lang.AssertionError: shard1 is not consistent. Got 305 from http://127.0.0.1:60579/y_/collection1lastClient and got 5 from http://127.0.0.1:60591/y_/collection1
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([CC0CA1ECBEF18497:4DEA2FF4C9AEE4AB]:0)
[junit4:junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:963)
[junit4:junit4] > at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:238)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:679)
[junit4:junit4] 2> 1830128 T2118 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 1857412 T2193 oasu.PeerSync.handleResponse WARN PeerSync: core=collection1 url=http://127.0.0.1:60579/y_ couldn't connect to http://127.0.0.1:60547/y_/collection1/, counting as success
[junit4:junit4] 2> 1857412 T2193 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:60579/y_ DONE. sync succeeded
[junit4:junit4] 2> 1857412 T2193 oasc.SyncStrategy.syncReplicas We have been closed, won't attempt to sync replicas back to leader
[junit4:junit4] 2> 1857413 T2193 oasc.ShardLeaderElectionContext.rejoinLeaderElection Not rejoining election because CoreContainer is shutdown
[junit4:junit4] 2> 1857413 T2193 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@4005e8cd
[junit4:junit4] 2> 1857414 T2193 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=51,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=5,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0}
[junit4:junit4] 2> 1857415 T2193 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 1857415 T2193 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 1857415 T2193 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 1857418 T2193 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 1857420 T2193 oasc.CachingDirectoryFactory.close Closing NRTCachingDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 1857420 T2193 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty3/index.20130520065535467 [CachedDir<<refCount=0;path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty3/index.20130520065535467;done=false>>]
[junit4:junit4] 2> 1857420 T2193 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty3/index.20130520065535467
[junit4:junit4] 2> 1857421 T2193 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty3 [CachedDir<<refCount=0;path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty3;done=false>>]
[junit4:junit4] 2> 1857421 T2193 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1368985677638/jetty3
[junit4:junit4] 2> 1857421 T2193 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 1857421 T2193 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1857422 T2193 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 1857422 T2193 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1857422 T2193 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> NOTE: test params are: codec=Lucene40, sim=RandomSimilarityProvider(queryNorm=false,coord=crazy): {}, locale=mk_MK, timezone=MIT
[junit4:junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Sun Microsystems Inc. 1.6.0_32 (64-bit)/cpus=16,threads=3,free=167452424,total=418578432
[junit4:junit4] 2> NOTE: All tests run in this JVM: [TestJmxMonitoredMap, HardAutoCommitTest, TestStressLucene, TestLMJelinekMercerSimilarityFactory, TestCodecSupport, TestIndexingPerformance, BasicZkTest, TestRTGBase, TestOmitPositions, TestDefaultSearchFieldResource, TestFiltering, TestFieldTypeResource, OpenExchangeRatesOrgProviderTest, FieldAnalysisRequestHandlerTest, TestWordDelimiterFilterFactory, TestRandomFaceting, TestPropInject, RequestHandlersTest, SpellCheckComponentTest, SignatureUpdateProcessorFactoryTest, TestDefaultSimilarityFactory, TestSolrQueryParserResource, TestIndexSearcher, PingRequestHandlerTest, IndexBasedSpellCheckerTest, FileUtilsTest, CurrencyFieldOpenExchangeTest, HighlighterConfigTest, DefaultValueUpdateProcessorTest, SuggesterTSTTest, MultiTermTest, TestRecovery, TestCopyFieldCollectionResource, TestDistributedGrouping, PreAnalyzedUpdateProcessorTest, TestSolrJ, ConvertedLegacyTest, TestSchemaNameResource, FullSolrCloudDistribCmdsTest, TestBinaryField, CurrencyFieldXmlFileTest, TestDynamicFieldCollectionResource, TestAddFieldRealTimeGet, SolrCmdDistributorTest, TestZkChroot, IndexSchemaRuntimeFieldTest, NoCacheHeaderTest, TestMergePolicyConfig, TestSchemaSimilarityResource, SimplePostToolTest, TestElisionMultitermQuery, TestDistributedSearch, TestUpdate, TestPartialUpdateDeduplication, TestCSVResponseWriter, TestRangeQuery, TestCoreDiscovery, BadIndexSchemaTest, TestSystemIdResolver, DebugComponentTest, PathHierarchyTokenizerFactoryTest, TestMaxScoreQueryParser, TestFastOutputStream, TestJmxIntegration, NotRequiredUniqueKeyTest, TestSolr4Spatial, SolrRequestParserTest, SolrIndexConfigTest, TestPostingsSolrHighlighter, URLClassifyProcessorTest, BasicDistributedZkTest, ChaosMonkeySafeLeaderTest, SyncSliceTest]
[junit4:junit4] Completed on J1 in 864.22s, 1 test, 1 failure <<< FAILURES!
[...truncated 49 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/build.xml:383: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/build.xml:363: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build.xml:181: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/common-build.xml:437: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/common-build.xml:1243: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/common-build.xml:887: There were test failures: 296 suites, 1234 tests, 1 failure, 27 ignored (8 assumptions)
Total time: 59 minutes 20 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-Tests-4.x-Java6 - Build # 1638 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java6/1638/
3 tests failed.
REGRESSION: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testDistribSearch
Error Message:
There are still nodes recoverying - waited for 230 seconds
Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 230 seconds
at __randomizedtesting.SeedInfo.seed([5C2F5BDC8F93160:84247BA5BFA6515C]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:173)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:131)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:126)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:512)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:146)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:679)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.CollectionsAPIDistributedZkTest
Error Message:
1 thread leaked from SUITE scope at org.apache.solr.cloud.CollectionsAPIDistributedZkTest: 1) Thread[id=1381, name=recoveryCmdExecutor-586-thread-1, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest] at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:327) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:193) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:180) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:384) at java.net.Socket.connect(Socket.java:546) at org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:127) at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:180) at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:294) at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:645) at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:480) at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:906) at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:805) at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:784) at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:365) at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180) at org.apache.solr.cloud.SyncStrategy$1.run(SyncStrategy.java:298) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:679)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.CollectionsAPIDistributedZkTest:
1) Thread[id=1381, name=recoveryCmdExecutor-586-thread-1, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
at java.net.PlainSocketImpl.socketConnect(Native Method)
at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:327)
at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:193)
at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:180)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:384)
at java.net.Socket.connect(Socket.java:546)
at org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:127)
at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:180)
at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:294)
at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:645)
at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:480)
at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:906)
at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:805)
at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:784)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:365)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.cloud.SyncStrategy$1.run(SyncStrategy.java:298)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:679)
at __randomizedtesting.SeedInfo.seed([5C2F5BDC8F93160]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.CollectionsAPIDistributedZkTest
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=1381, name=recoveryCmdExecutor-586-thread-1, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest] at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:327) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:193) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:180) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:384) at java.net.Socket.connect(Socket.java:546) at org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:127) at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:180) at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:294) at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:645) at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:480) at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:906) at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:805) at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:784) at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:365) at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180) at org.apache.solr.cloud.SyncStrategy$1.run(SyncStrategy.java:298) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:679)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=1381, name=recoveryCmdExecutor-586-thread-1, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
at java.net.PlainSocketImpl.socketConnect(Native Method)
at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:327)
at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:193)
at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:180)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:384)
at java.net.Socket.connect(Socket.java:546)
at org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:127)
at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:180)
at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:294)
at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:645)
at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:480)
at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:906)
at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:805)
at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:784)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:365)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.cloud.SyncStrategy$1.run(SyncStrategy.java:298)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:679)
at __randomizedtesting.SeedInfo.seed([5C2F5BDC8F93160]:0)
Build Log:
[...truncated 8954 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
[junit4:junit4] 2> 671035 T1185 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /pm/iv
[junit4:junit4] 2> 671039 T1185 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./solrtest-CollectionsAPIDistributedZkTest-1369044956159
[junit4:junit4] 2> 671041 T1185 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 671041 T1186 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 671142 T1185 oasc.ZkTestServer.run start zk server on port:13994
[junit4:junit4] 2> 671143 T1185 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 671147 T1192 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2c2ac6f name:ZooKeeperConnection Watcher:127.0.0.1:13994 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 671147 T1185 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 671148 T1185 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 671161 T1185 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 671168 T1194 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4f345357 name:ZooKeeperConnection Watcher:127.0.0.1:13994/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 671168 T1185 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 671169 T1185 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 671172 T1185 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 671182 T1185 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 671185 T1185 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 671188 T1185 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 671189 T1185 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 671199 T1185 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 671200 T1185 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 671305 T1185 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 671305 T1185 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 671309 T1185 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 671309 T1185 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 671318 T1185 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 671319 T1185 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 671323 T1185 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 671323 T1185 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 671327 T1185 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 671327 T1185 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 671330 T1185 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 671331 T1185 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 671334 T1185 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 671335 T1185 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 671627 T1185 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 671631 T1185 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:48169
[junit4:junit4] 2> 671632 T1185 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 671632 T1185 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 671633 T1185 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369044956458
[junit4:junit4] 2> 671633 T1185 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369044956458/solr.xml
[junit4:junit4] 2> 671634 T1185 oasc.CoreContainer.<init> New CoreContainer 2132114241
[junit4:junit4] 2> 671634 T1185 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369044956458/'
[junit4:junit4] 2> 671635 T1185 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369044956458/'
[junit4:junit4] 2> 671738 T1185 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369044956458
[junit4:junit4] 2> 671742 T1185 oasc.SolrCoreDiscoverer.addCore Discovered properties file /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369044956458/conf/core.properties, adding to cores
[junit4:junit4] 2> 671746 T1185 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369044956458/collection1
[junit4:junit4] 2> 671747 T1185 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369044956458/collection1/lib
[junit4:junit4] 2> 671748 T1185 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369044956458/collection1/lib/classes
[junit4:junit4] 2> 671750 T1185 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369044956458/collection1/conf
[junit4:junit4] 2> 671785 T1185 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369044956458/collection1/conf/xslt
[junit4:junit4] 2> 671906 T1185 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4] 2> 671906 T1185 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 671907 T1185 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4] 2> 671907 T1185 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 671908 T1185 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 671908 T1185 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 671909 T1185 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 671909 T1185 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 671910 T1185 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 671910 T1185 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4] 2> 671928 T1185 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 671928 T1185 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:13994/solr
[junit4:junit4] 2> 671929 T1185 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 671930 T1185 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 671933 T1205 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3829edd name:ZooKeeperConnection Watcher:127.0.0.1:13994 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 671933 T1185 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 671935 T1185 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 671944 T1185 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 671946 T1207 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@728394d8 name:ZooKeeperConnection Watcher:127.0.0.1:13994/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 671946 T1185 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 671948 T1185 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 671958 T1185 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 671962 T1185 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 671964 T1185 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48169_pm%2Fiv
[junit4:junit4] 2> 671971 T1185 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:48169_pm%2Fiv
[junit4:junit4] 2> 671974 T1185 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 671991 T1185 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 671994 T1185 oasc.Overseer.start Overseer (id=89721730247163907-127.0.0.1:48169_pm%2Fiv-n_0000000000) starting
[junit4:junit4] 2> 672006 T1185 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 672010 T1209 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 672011 T1185 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 672018 T1185 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 672020 T1185 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 672023 T1208 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 672025 T1185 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1
[junit4:junit4] 2> 672026 T1185 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 672026 T1185 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 672038 T1185 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 672040 T1185 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 672042 T1212 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4870f5bf name:ZooKeeperConnection Watcher:127.0.0.1:13994/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 672042 T1185 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 672044 T1185 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 672046 T1185 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 672310 T1185 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 672313 T1185 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:50547
[junit4:junit4] 2> 672314 T1185 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 672314 T1185 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 672315 T1185 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369044957166
[junit4:junit4] 2> 672315 T1185 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369044957166/solr.xml
[junit4:junit4] 2> 672316 T1185 oasc.CoreContainer.<init> New CoreContainer 1705924650
[junit4:junit4] 2> 672316 T1185 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369044957166/'
[junit4:junit4] 2> 672317 T1185 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369044957166/'
[junit4:junit4] 2> 672416 T1185 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369044957166
[junit4:junit4] 2> 672421 T1185 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369044957166/collection1
[junit4:junit4] 2> 672422 T1185 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369044957166/collection1/conf
[junit4:junit4] 2> 672569 T1185 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369044957166/collection1/conf/xslt
[junit4:junit4] 2> 672573 T1185 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369044957166/collection1/lib
[junit4:junit4] 2> 672574 T1185 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369044957166/collection1/lib/classes
[junit4:junit4] 2> 672578 T1185 oasc.SolrCoreDiscoverer.addCore Discovered properties file /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369044957166/conf/core.properties, adding to cores
[junit4:junit4] 2> 672587 T1185 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4] 2> 672587 T1185 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 672588 T1185 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4] 2> 672588 T1185 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 672589 T1185 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 672589 T1185 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 672589 T1185 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 672590 T1185 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 672590 T1185 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 672591 T1185 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4] 2> 672609 T1185 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 672609 T1185 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:13994/solr
[junit4:junit4] 2> 672610 T1185 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 672611 T1185 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 672613 T1223 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@26883a11 name:ZooKeeperConnection Watcher:127.0.0.1:13994 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 672614 T1185 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 672616 T1185 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 672629 T1185 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 672631 T1225 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6a00d4f name:ZooKeeperConnection Watcher:127.0.0.1:13994/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 672631 T1185 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 672643 T1185 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 673647 T1185 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50547_pm%2Fiv
[junit4:junit4] 2> 673649 T1185 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50547_pm%2Fiv
[junit4:junit4] 2> 673653 T1207 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 673653 T1225 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 673653 T1212 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 673658 T1185 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1
[junit4:junit4] 2> 673659 T1185 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 673659 T1185 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 673833 T1185 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 673835 T1185 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:52966
[junit4:junit4] 2> 673836 T1185 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 673836 T1185 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 673836 T1185 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369044958786
[junit4:junit4] 2> 673837 T1185 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369044958786/solr.xml
[junit4:junit4] 2> 673837 T1185 oasc.CoreContainer.<init> New CoreContainer 1296442962
[junit4:junit4] 2> 673838 T1185 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369044958786/'
[junit4:junit4] 2> 673838 T1185 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369044958786/'
[junit4:junit4] 2> 673902 T1185 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369044958786
[junit4:junit4] 2> 673903 T1185 oasc.SolrCoreDiscoverer.addCore Discovered properties file /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369044958786/conf/core.properties, adding to cores
[junit4:junit4] 2> 673908 T1185 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369044958786/collection1
[junit4:junit4] 2> 673908 T1185 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369044958786/collection1/lib
[junit4:junit4] 2> 673909 T1185 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369044958786/collection1/lib/classes
[junit4:junit4] 2> 673911 T1185 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369044958786/collection1/conf
[junit4:junit4] 2> 673912 T1185 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369044958786/collection1/conf/xslt
[junit4:junit4] 2> 674010 T1185 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4] 2> 674010 T1185 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 674010 T1185 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4] 2> 674011 T1185 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 674011 T1185 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 674011 T1185 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 674012 T1185 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 674012 T1185 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 674012 T1185 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 674013 T1185 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4] 2> 674023 T1185 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 674023 T1185 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:13994/solr
[junit4:junit4] 2> 674024 T1185 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 674024 T1185 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 674027 T1237 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@566ec0d9 name:ZooKeeperConnection Watcher:127.0.0.1:13994 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 674027 T1185 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 674029 T1185 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 674040 T1185 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 674042 T1239 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2315ef89 name:ZooKeeperConnection Watcher:127.0.0.1:13994/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 674043 T1185 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 674054 T1185 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 675057 T1185 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52966_pm%2Fiv
[junit4:junit4] 2> 675059 T1185 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52966_pm%2Fiv
[junit4:junit4] 2> 675063 T1212 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 675063 T1207 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 675063 T1239 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 675063 T1225 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 675077 T1185 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1
[junit4:junit4] 2> 675077 T1185 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 675078 T1185 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 675344 T1185 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 675347 T1185 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:13870
[junit4:junit4] 2> 675348 T1185 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 675349 T1185 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 675349 T1185 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369044960207
[junit4:junit4] 2> 675350 T1185 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369044960207/solr.xml
[junit4:junit4] 2> 675350 T1185 oasc.CoreContainer.<init> New CoreContainer 843710169
[junit4:junit4] 2> 675351 T1185 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369044960207/'
[junit4:junit4] 2> 675358 T1185 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369044960207/'
[junit4:junit4] 2> 675456 T1185 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369044960207
[junit4:junit4] 2> 675459 T1185 oasc.SolrCoreDiscoverer.addCore Discovered properties file /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369044960207/conf/core.properties, adding to cores
[junit4:junit4] 2> 675462 T1185 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369044960207/collection1
[junit4:junit4] 2> 675463 T1185 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369044960207/collection1/conf
[junit4:junit4] 2> 675507 T1185 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369044960207/collection1/conf/xslt
[junit4:junit4] 2> 675612 T1185 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369044960207/collection1/lib
[junit4:junit4] 2> 675613 T1185 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369044960207/collection1/lib/classes
[junit4:junit4] 2> 675624 T1185 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4] 2> 675625 T1185 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 675625 T1185 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4] 2> 675626 T1185 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 675626 T1185 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 675627 T1185 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 675627 T1185 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 675627 T1185 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 675628 T1185 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 675628 T1185 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4] 2> 675644 T1185 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 675645 T1185 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:13994/solr
[junit4:junit4] 2> 675645 T1185 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 675646 T1185 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 675649 T1251 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b9fb35b name:ZooKeeperConnection Watcher:127.0.0.1:13994 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 675650 T1185 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 675652 T1185 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 675663 T1185 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 675665 T1253 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@70de6db3 name:ZooKeeperConnection Watcher:127.0.0.1:13994/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 675666 T1185 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 675670 T1185 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 676674 T1185 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:13870_pm%2Fiv
[junit4:junit4] 2> 676686 T1185 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:13870_pm%2Fiv
[junit4:junit4] 2> 676690 T1212 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 676690 T1225 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 676690 T1239 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 676690 T1253 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 676690 T1207 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 676706 T1185 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1
[junit4:junit4] 2> 676706 T1185 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 676707 T1185 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 676973 T1185 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 676976 T1185 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:51984
[junit4:junit4] 2> 676977 T1185 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 676977 T1185 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 676978 T1185 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369044961836
[junit4:junit4] 2> 676978 T1185 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369044961836/solr.xml
[junit4:junit4] 2> 676979 T1185 oasc.CoreContainer.<init> New CoreContainer 157080368
[junit4:junit4] 2> 676979 T1185 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369044961836/'
[junit4:junit4] 2> 676980 T1185 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369044961836/'
[junit4:junit4] 2> 677077 T1185 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369044961836
[junit4:junit4] 2> 677079 T1185 oasc.SolrCoreDiscoverer.addCore Discovered properties file /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369044961836/conf/core.properties, adding to cores
[junit4:junit4] 2> 677082 T1185 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369044961836/collection1
[junit4:junit4] 2> 677083 T1185 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369044961836/collection1/lib
[junit4:junit4] 2> 677084 T1185 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369044961836/collection1/lib/classes
[junit4:junit4] 2> 677087 T1185 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369044961836/collection1/conf
[junit4:junit4] 2> 677192 T1185 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369044961836/collection1/conf/xslt
[junit4:junit4] 2> 677246 T1185 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4] 2> 677247 T1185 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 677247 T1185 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4] 2> 677248 T1185 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 677248 T1185 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 677249 T1185 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 677249 T1185 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 677250 T1185 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 677250 T1185 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 677251 T1185 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4] 2> 677268 T1185 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 677269 T1185 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:13994/solr
[junit4:junit4] 2> 677269 T1185 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 677271 T1185 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 677273 T1265 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@156e7f24 name:ZooKeeperConnection Watcher:127.0.0.1:13994 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 677274 T1185 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 677276 T1185 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 677289 T1185 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 677291 T1267 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3afdd787 name:ZooKeeperConnection Watcher:127.0.0.1:13994/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 677291 T1185 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 677304 T1185 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 678307 T1185 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51984_pm%2Fiv
[junit4:junit4] 2> 678309 T1185 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51984_pm%2Fiv
[junit4:junit4] 2> 678313 T1212 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 678313 T1253 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 678313 T1225 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 678313 T1207 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 678313 T1267 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 678313 T1239 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 678326 T1185 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1
[junit4:junit4] 2> 678326 T1185 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 678327 T1185 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 678339 T1185 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 678351 T1215 oasha.CollectionsHandler.handleCreateAction Creating Collection : numShards=2&name=nodes_used_collection&replicationFactor=2&action=CREATE&wt=javabin&version=2
[junit4:junit4] 2> 678353 T1207 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4:junit4] 2> 678354 T1209 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
[junit4:junit4] 2> "operation":"createcollection",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "maxShardsPerNode":null,
[junit4:junit4] 2> "createNodeSet":null,
[junit4:junit4] 2> "name":"nodes_used_collection",
[junit4:junit4] 2> "replicationFactor":"2"}
[junit4:junit4] 2> 678355 T1209 oasc.OverseerCollectionProcessor.createCollection Creating shard nodes_used_collection_shard1_replica1 as part of slice shard1 of collection nodes_used_collection on 127.0.0.1:51984_pm%2Fiv
[junit4:junit4] 2> 678355 T1209 oasc.OverseerCollectionProcessor.createCollection Creating shard nodes_used_collection_shard1_replica2 as part of slice shard1 of collection nodes_used_collection on 127.0.0.1:52966_pm%2Fiv
[junit4:junit4] 2> 678356 T1209 oasc.OverseerCollectionProcessor.createCollection Creating shard nodes_used_collection_shard2_replica1 as part of slice shard2 of collection nodes_used_collection on 127.0.0.1:48169_pm%2Fiv
[junit4:junit4] 2> 678356 T1209 oasc.OverseerCollectionProcessor.createCollection Creating shard nodes_used_collection_shard2_replica2 as part of slice shard2 of collection nodes_used_collection on 127.0.0.1:50547_pm%2Fiv
[junit4:junit4] 2> 678357 T1257 oasc.CoreContainer.create Creating SolrCore 'nodes_used_collection_shard1_replica1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369044961836/nodes_used_collection_shard1_replica1
[junit4:junit4] 2> 678357 T1229 oasc.CoreContainer.create Creating SolrCore 'nodes_used_collection_shard1_replica2' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369044958786/nodes_used_collection_shard1_replica2
[junit4:junit4] 2> 678358 T1197 oasc.CoreContainer.create Creating SolrCore 'nodes_used_collection_shard2_replica1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369044956458/nodes_used_collection_shard2_replica1
[junit4:junit4] 2> 678359 T1197 oasc.ZkController.createCollectionZkNode Check for collection zkNode:nodes_used_collection
[junit4:junit4] 2> 678357 T1257 oasc.ZkController.createCollectionZkNode Check for collection zkNode:nodes_used_collection
[junit4:junit4] 2> 678358 T1216 oasc.CoreContainer.create Creating SolrCore 'nodes_used_collection_shard2_replica2' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369044957166/nodes_used_collection_shard2_replica2
[junit4:junit4] 2> 678360 T1216 oasc.ZkController.createCollectionZkNode Check for collection zkNode:nodes_used_collection
[junit4:junit4] 2> 678358 T1229 oasc.ZkController.createCollectionZkNode Check for collection zkNode:nodes_used_collection
[junit4:junit4] 2> 678360 T1257 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:nodes_used_collection
[junit4:junit4] 2> 678359 T1197 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:nodes_used_collection
[junit4:junit4] 2> 678361 T1257 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 678361 T1229 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:nodes_used_collection
[junit4:junit4] 2> 678361 T1216 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:nodes_used_collection
[junit4:junit4] 2> 678362 T1229 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 678361 T1197 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 678362 T1257 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 678362 T1216 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 678364 T1229 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 678364 T1257 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection
[junit4:junit4] 2> 678364 T1229 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection
[junit4:junit4] 2> 678364 T1197 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 678365 T1216 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 678366 T1197 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection
[junit4:junit4] 2> 678366 T1216 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection
[junit4:junit4] 2> 678367 T1257 oasc.ZkController.readConfigName Load collection config from:/collections/nodes_used_collection
[junit4:junit4] 2> 678368 T1229 oasc.ZkController.readConfigName Load collection config from:/collections/nodes_used_collection
[junit4:junit4] 2> 678378 T1197 oasc.ZkController.readConfigName Load collection config from:/collections/nodes_used_collection
[junit4:junit4] 2> 678379 T1216 oasc.ZkController.readConfigName Load collection config from:/collections/nodes_used_collection
[junit4:junit4] 2> 678379 T1257 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369044961836/nodes_used_collection_shard1_replica1/'
[junit4:junit4] 2> 678380 T1229 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369044958786/nodes_used_collection_shard1_replica2/'
[junit4:junit4] 2> 678381 T1197 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369044956458/nodes_used_collection_shard2_replica1/'
[junit4:junit4] 2> 678381 T1216 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369044957166/nodes_used_collection_shard2_replica2/'
[junit4:junit4] 2> 678465 T1229 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 678465 T1216 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 678465 T1257 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 678465 T1197 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 678541 T1216 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 678542 T1257 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 678543 T1229 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 678544 T1197 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 678644 T1257 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 678644 T1216 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 678645 T1229 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 678646 T1197 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 678655 T1257 oass.IndexSchema.readSchema [nodes_used_collection_shard1_replica1] Schema name=test
[junit4:junit4] 2> 678656 T1216 oass.IndexSchema.readSchema [nodes_used_collection_shard2_replica2] Schema name=test
[junit4:junit4] 2> 678656 T1229 oass.IndexSchema.readSchema [nodes_used_collection_shard1_replica2] Schema name=test
[junit4:junit4] 2> 678656 T1197 oass.IndexSchema.readSchema [nodes_used_collection_shard2_replica1] Schema name=test
[junit4:junit4] 2> 679431 T1216 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 679432 T1197 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 679437 T1229 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 679445 T1257 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 679447 T1216 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 679447 T1197 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 679448 T1229 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 679451 T1216 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 679452 T1197 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 679453 T1229 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 679456 T1257 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 679460 T1257 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 679471 T1229 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 679472 T1216 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 679472 T1197 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 679477 T1229 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 679478 T1257 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 679479 T1197 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 679480 T1216 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 679483 T1229 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 679484 T1257 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 679484 T1197 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 679485 T1229 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 679485 T1229 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 679485 T1216 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 679486 T1229 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 679486 T1197 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 679488 T1197 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 679488 T1216 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 679489 T1216 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 679489 T1197 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 679489 T1229 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 679490 T1229 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 679490 T1257 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 679490 T1216 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 679491 T1197 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 679491 T1229 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 679492 T1257 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 679493 T1257 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 679492 T1197 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 679493 T1257 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 679493 T1216 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 679495 T1216 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 679493 T1229 oasc.SolrCore.<init> [nodes_used_collection_shard1_replica2] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369044958786/nodes_used_collection_shard1_replica2/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369044958786/nodes_used_collection_shard1_replica2/data/
[junit4:junit4] 2> 679495 T1216 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 679495 T1257 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 679497 T1257 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 679494 T1197 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 679497 T1257 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 679496 T1216 oasc.SolrCore.<init> [nodes_used_collection_shard2_replica2] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369044957166/nodes_used_collection_shard2_replica2/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369044957166/nodes_used_collection_shard2_replica2/data/
[junit4:junit4] 2> 679496 T1229 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7979a49f
[junit4:junit4] 2> 679498 T1216 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7979a49f
[junit4:junit4] 2> 679499 T1229 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 679499 T1216 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 679498 T1257 oasc.SolrCore.<init> [nodes_used_collection_shard1_replica1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369044961836/nodes_used_collection_shard1_replica1/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369044961836/nodes_used_collection_shard1_replica1/data/
[junit4:junit4] 2> 679498 T1197 oasc.SolrCore.<init> [nodes_used_collection_shard2_replica1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369044956458/nodes_used_collection_shard2_replica1/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369044956458/nodes_used_collection_shard2_replica1/data/
[junit4:junit4] 2> 679500 T1216 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369044957166/nodes_used_collection_shard2_replica2/data
[junit4:junit4] 2> 679500 T1257 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7979a49f
[junit4:junit4] 2> 679500 T1229 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369044958786/nodes_used_collection_shard1_replica2/data
[junit4:junit4] 2> 679502 T1257 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 679501 T1216 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369044957166/nodes_used_collection_shard2_replica2/data/index/
[junit4:junit4] 2> 679501 T1197 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7979a49f
[junit4:junit4] 2> 679503 T1257 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369044961836/nodes_used_collection_shard1_replica1/data
[junit4:junit4] 2> 679503 T1216 oasc.SolrCore.initIndex WARN [nodes_used_collection_shard2_replica2] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369044957166/nodes_used_collection_shard2_replica2/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 679502 T1229 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369044958786/nodes_used_collection_shard1_replica2/data/index/
[junit4:junit4] 2> 679504 T1216 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369044957166/nodes_used_collection_shard2_replica2/data/index
[junit4:junit4] 2> 679504 T1257 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369044961836/nodes_used_collection_shard1_replica1/data/index/
[junit4:junit4] 2> 679503 T1197 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 679505 T1257 oasc.SolrCore.initIndex WARN [nodes_used_collection_shard1_replica1] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369044961836/nodes_used_collection_shard1_replica1/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 679505 T1229 oasc.SolrCore.initIndex WARN [nodes_used_collection_shard1_replica2] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369044958786/nodes_used_collection_shard1_replica2/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 679506 T1257 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369044961836/nodes_used_collection_shard1_replica1/data/index
[junit4:junit4] 2> 679506 T1197 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369044956458/nodes_used_collection_shard2_replica1/data
[junit4:junit4] 2> 679507 T1229 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369044958786/nodes_used_collection_shard1_replica2/data/index
[junit4:junit4] 2> 679507 T1197 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369044956458/nodes_used_collection_shard2_replica1/data/index/
[junit4:junit4] 2> 679508 T1197 oasc.SolrCore.initIndex WARN [nodes_used_collection_shard2_replica1] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369044956458/nodes_used_collection_shard2_replica1/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 679509 T1197 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369044956458/nodes_used_collection_shard2_replica1/data/index
[junit4:junit4] 2> 679510 T1216 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7547c27 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f7252db),segFN=segments_1,generation=1}
[junit4:junit4] 2> 679511 T1216 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 679514 T1257 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@372fe3a5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3930ee96),segFN=segments_1,generation=1}
[junit4:junit4] 2> 679514 T1257 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 679515 T1216 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 679515 T1229 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@46086d2d lockFactory=org.apache.lucene.store.NativeFSLockFactory@269497a5),segFN=segments_1,generation=1}
[junit4:junit4] 2> 679516 T1197 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@153f497b lockFactory=org.apache.lucene.store.NativeFSLockFactory@3efee18b),segFN=segments_1,generation=1}
[junit4:junit4] 2> 679516 T1197 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 679515 T1216 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 679516 T1229 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 679518 T1257 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 679518 T1216 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 679518 T1257 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 679519 T1216 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 679519 T1257 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 679520 T1216 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 679520 T1197 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 679520 T1257 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 679520 T1216 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 679522 T1257 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 679522 T1257 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 679521 T1229 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 679521 T1197 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 679523 T1229 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 679524 T1197 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 679524 T1229 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 679523 T1257 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 679522 T1216 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 679525 T1257 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 679525 T1229 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 679525 T1197 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 679527 T1229 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 679526 T1257 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 679526 T1216 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 679527 T1229 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 679527 T1197 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 679529 T1197 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 679528 T1229 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 679528 T1216 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 679530 T1229 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 679529 T1197 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 679530 T1229 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 679531 T1197 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 679532 T1197 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 679543 T1229 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 679543 T1197 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 679543 T1216 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 679543 T1257 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 679556 T1229 oass.SolrIndexSearcher.<init> Opening Searcher@7b800e40 main
[junit4:junit4] 2> 679556 T1216 oass.SolrIndexSearcher.<init> Opening Searcher@2c01a0dd main
[junit4:junit4] 2> 679556 T1197 oass.SolrIndexSearcher.<init> Opening Searcher@2fc62708 main
[junit4:junit4] 2> 679556 T1257 oass.SolrIndexSearcher.<init> Opening Searcher@463056ca main
[junit4:junit4] 2> 679557 T1197 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369044956458/nodes_used_collection_shard2_replica1/data/tlog
[junit4:junit4] 2> 679557 T1216 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369044957166/nodes_used_collection_shard2_replica2/data/tlog
[junit4:junit4] 2> 679557 T1229 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369044958786/nodes_used_collection_shard1_replica2/data/tlog
[junit4:junit4] 2> 679558 T1257 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369044961836/nodes_used_collection_shard1_replica1/data/tlog
[junit4:junit4] 2> 679559 T1197 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 679560 T1216 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 679560 T1229 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 679560 T1197 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 679561 T1229 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 679561 T1257 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 679561 T1216 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 679562 T1257 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 679567 T1275 oasc.SolrCore.registerSearcher [nodes_used_collection_shard2_replica1] Registered new searcher Searcher@2fc62708 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 679567 T1273 oasc.SolrCore.registerSearcher [nodes_used_collection_shard1_replica2] Registered new searcher Searcher@7b800e40 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 679568 T1276 oasc.SolrCore.registerSearcher [nodes_used_collection_shard2_replica2] Registered new searcher Searcher@2c01a0dd main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 679568 T1274 oasc.SolrCore.registerSearcher [nodes_used_collection_shard1_replica1] Registered new searcher Searcher@463056ca main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 679570 T1197 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica1 state=down
[junit4:junit4] 2> 679571 T1229 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica2 state=down
[junit4:junit4] 2> 679571 T1216 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica2 state=down
[junit4:junit4] 2> 679572 T1257 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica1 state=down
[junit4:junit4] 2> 681038 T1208 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 681039 T1208 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"nodes_used_collection_shard2_replica1",
[junit4:junit4] 2> "collection":"nodes_used_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:48169_pm%2Fiv",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:48169/pm/iv"}
[junit4:junit4] 2> 681039 T1208 oasc.Overseer$ClusterStateUpdater.createCollection Create collection nodes_used_collection with numShards 2
[junit4:junit4] 2> 681043 T1208 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"nodes_used_collection_shard1_replica2",
[junit4:junit4] 2> "collection":"nodes_used_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52966_pm%2Fiv",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52966/pm/iv"}
[junit4:junit4] 2> 681069 T1208 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"nodes_used_collection_shard2_replica2",
[junit4:junit4] 2> "collection":"nodes_used_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:50547_pm%2Fiv",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:50547/pm/iv"}
[junit4:junit4] 2> 681073 T1208 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"nodes_used_collection_shard1_replica1",
[junit4:junit4] 2> "collection":"nodes_used_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:51984_pm%2Fiv",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:51984/pm/iv"}
[junit4:junit4] 2> 681090 T1212 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 681090 T1207 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 681090 T1239 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 681090 T1225 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 681090 T1267 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 681090 T1253 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 681575 T1197 oasc.CoreContainer.registerCore registering core: nodes_used_collection_shard2_replica1
[junit4:junit4] 2> 681575 T1197 oasc.ZkController.register Register replica - core:nodes_used_collection_shard2_replica1 address:http://127.0.0.1:48169/pm/iv collection:nodes_used_collection shard:shard2
[junit4:junit4] 2> 681577 T1197 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leader_elect/shard2/election
[junit4:junit4] 2> 681586 T1257 oasc.CoreContainer.registerCore registering core: nodes_used_collection_shard1_replica1
[junit4:junit4] 2> 681586 T1229 oasc.CoreContainer.registerCore registering core: nodes_used_collection_shard1_replica2
[junit4:junit4] 2> 681586 T1216 oasc.CoreContainer.registerCore registering core: nodes_used_collection_shard2_replica2
[junit4:junit4] 2> 681586 T1229 oasc.ZkController.register Register replica - core:nodes_used_collection_shard1_replica2 address:http://127.0.0.1:52966/pm/iv collection:nodes_used_collection shard:shard1
[junit4:junit4] 2> 681586 T1257 oasc.ZkController.register Register replica - core:nodes_used_collection_shard1_replica1 address:http://127.0.0.1:51984/pm/iv collection:nodes_used_collection shard:shard1
[junit4:junit4] 2> 681587 T1216 oasc.ZkController.register Register replica - core:nodes_used_collection_shard2_replica2 address:http://127.0.0.1:50547/pm/iv collection:nodes_used_collection shard:shard2
[junit4:junit4] 2> 681596 T1229 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leader_elect/shard1/election
[junit4:junit4] 2> 681596 T1216 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leader_elect/shard2/election
[junit4:junit4] 2> 681596 T1257 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leader_elect/shard1/election
[junit4:junit4] 2> 681627 T1197 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 681637 T1257 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 681647 T1197 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 681647 T1197 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 681647 T1197 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:48169/pm/iv/nodes_used_collection_shard2_replica1/
[junit4:junit4] 2> 681648 T1197 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard2_replica1 url=http://127.0.0.1:48169/pm/iv START replicas=[http://127.0.0.1:50547/pm/iv/nodes_used_collection_shard2_replica2/] nUpdates=100
[junit4:junit4] 2> 681648 T1257 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 681649 T1257 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 681648 T1197 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard2_replica1 url=http://127.0.0.1:48169/pm/iv DONE. We have no versions. sync failed.
[junit4:junit4] 2> 681649 T1257 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:51984/pm/iv/nodes_used_collection_shard1_replica1/
[junit4:junit4] 2> 681650 T1197 oasc.SyncStrategy.syncReplicas Leader's attempt to sync with shard failed, moving to the next canidate
[junit4:junit4] 2> 681650 T1257 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard1_replica1 url=http://127.0.0.1:51984/pm/iv START replicas=[http://127.0.0.1:52966/pm/iv/nodes_used_collection_shard1_replica2/] nUpdates=100
[junit4:junit4] 2> 681650 T1197 oasc.ShardLeaderElectionContext.runLeaderProcess We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4:junit4] 2> 681651 T1257 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard1_replica1 url=http://127.0.0.1:51984/pm/iv DONE. We have no versions. sync failed.
[junit4:junit4] 2> 681651 T1257 oasc.SyncStrategy.syncReplicas Leader's attempt to sync with shard failed, moving to the next canidate
[junit4:junit4] 2> 681651 T1197 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:48169/pm/iv/nodes_used_collection_shard2_replica1/
[junit4:junit4] 2> 681652 T1257 oasc.ShardLeaderElectionContext.runLeaderProcess We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4:junit4] 2> 681653 T1257 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:51984/pm/iv/nodes_used_collection_shard1_replica1/
[junit4:junit4] 2> 681653 T1197 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leaders/shard2
[junit4:junit4] 2> 681654 T1257 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leaders/shard1
[junit4:junit4] 2> ASYNC NEW_CORE C57 name=nodes_used_collection_shard2_replica2 org.apache.solr.core.SolrCore@64119cdc url=http://127.0.0.1:50547/pm/iv/nodes_used_collection_shard2_replica2 node=127.0.0.1:50547_pm%2Fiv C57_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica2 props:{shard=shard2, state=down, core=nodes_used_collection_shard2_replica2, collection=nodes_used_collection, node_name=127.0.0.1:50547_pm%2Fiv, base_url=http://127.0.0.1:50547/pm/iv}
[junit4:junit4] 2> 681657 T1217 C57 P50547 oasc.SolrCore.execute [nodes_used_collection_shard2_replica2] webapp=/pm/iv path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> ASYNC NEW_CORE C58 name=nodes_used_collection_shard1_replica2 org.apache.solr.core.SolrCore@1cea72b8 url=http://127.0.0.1:52966/pm/iv/nodes_used_collection_shard1_replica2 node=127.0.0.1:52966_pm%2Fiv C58_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica2 props:{shard=shard1, state=down, core=nodes_used_collection_shard1_replica2, collection=nodes_used_collection, node_name=127.0.0.1:52966_pm%2Fiv, base_url=http://127.0.0.1:52966/pm/iv}
[junit4:junit4] 2> 681659 T1230 C58 P52966 oasc.SolrCore.execute [nodes_used_collection_shard1_replica2] webapp=/pm/iv path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 682602 T1208 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 682674 T1212 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 682674 T1267 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 682674 T1225 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 682674 T1239 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 682674 T1253 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 682674 T1207 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 682694 T1257 oasc.ZkController.register We are http://127.0.0.1:51984/pm/iv/nodes_used_collection_shard1_replica1/ and leader is http://127.0.0.1:51984/pm/iv/nodes_used_collection_shard1_replica1/
[junit4:junit4] 2> 682694 T1257 oasc.ZkController.register No LogReplay needed for core=nodes_used_collection_shard1_replica1 baseURL=http://127.0.0.1:51984/pm/iv
[junit4:junit4] 2> 682694 T1257 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 682695 T1257 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica1 state=active
[junit4:junit4] 2> 682697 T1216 oasc.ZkController.register We are http://127.0.0.1:50547/pm/iv/nodes_used_collection_shard2_replica2/ and leader is http://127.0.0.1:48169/pm/iv/nodes_used_collection_shard2_replica1/
[junit4:junit4] 2> 682697 T1257 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 682697 T1216 oasc.ZkController.register No LogReplay needed for core=nodes_used_collection_shard2_replica2 baseURL=http://127.0.0.1:50547/pm/iv
[junit4:junit4] 2> 682698 T1216 oasc.ZkController.checkRecovery Core needs to recover:nodes_used_collection_shard2_replica2
[junit4:junit4] 2> 682698 T1257 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=2&shard=shard1&name=nodes_used_collection_shard1_replica1&action=CREATE&collection=nodes_used_collection&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=4341
[junit4:junit4] 2> 682698 T1216 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> 682699 T1229 oasc.ZkController.register We are http://127.0.0.1:52966/pm/iv/nodes_used_collection_shard1_replica2/ and leader is http://127.0.0.1:51984/pm/iv/nodes_used_collection_shard1_replica1/
[junit4:junit4] 2> 682699 T1279 C57 P50547 oasc.RecoveryStrategy.run Starting recovery process. core=nodes_used_collection_shard2_replica2 recoveringAfterStartup=true
[junit4:junit4] 2> 682700 T1216 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 682699 T1229 oasc.ZkController.register No LogReplay needed for core=nodes_used_collection_shard1_replica2 baseURL=http://127.0.0.1:52966/pm/iv
[junit4:junit4] 2> 682700 T1229 oasc.ZkController.checkRecovery Core needs to recover:nodes_used_collection_shard1_replica2
[junit4:junit4] 2> 682701 T1229 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> 682700 T1279 C57 P50547 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 682701 T1280 C58 P52966 oasc.RecoveryStrategy.run Starting recovery process. core=nodes_used_collection_shard1_replica2 recoveringAfterStartup=true
[junit4:junit4] 2> 682702 T1279 C57 P50547 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica2 state=recovering
[junit4:junit4] 2> 682702 T1229 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 682701 T1216 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=2&shard=shard2&name=nodes_used_collection_shard2_replica2&action=CREATE&collection=nodes_used_collection&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=4343
[junit4:junit4] 2> 682702 T1280 C58 P52966 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 682704 T1280 C58 P52966 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica2 state=recovering
[junit4:junit4] 2> 682704 T1279 C57 P50547 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 682704 T1229 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=2&shard=shard1&name=nodes_used_collection_shard1_replica2&action=CREATE&collection=nodes_used_collection&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=4347
[junit4:junit4] 2> 682705 T1280 C58 P52966 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 682732 T1198 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:50547_pm%2Fiv_nodes_used_collection_shard2_replica2, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 682732 T1258 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:52966_pm%2Fiv_nodes_used_collection_shard1_replica2, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 682745 T1197 oasc.ZkController.register We are http://127.0.0.1:48169/pm/iv/nodes_used_collection_shard2_replica1/ and leader is http://127.0.0.1:48169/pm/iv/nodes_used_collection_shard2_replica1/
[junit4:junit4] 2> 682745 T1197 oasc.ZkController.register No LogReplay needed for core=nodes_used_collection_shard2_replica1 baseURL=http://127.0.0.1:48169/pm/iv
[junit4:junit4] 2> 682745 T1197 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 682746 T1197 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica1 state=active
[junit4:junit4] 2> 682748 T1197 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 682749 T1197 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=2&shard=shard2&name=nodes_used_collection_shard2_replica1&action=CREATE&collection=nodes_used_collection&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=4391
[junit4:junit4] 2> 682750 T1209 oasc.OverseerCollectionProcessor.createCollection Finished create command on all shards for collection: nodes_used_collection
[junit4:junit4] 2> 682752 T1225 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work/qnr-0000000000 state: SyncConnected type NodeDataChanged
[junit4:junit4] 2> 682754 T1207 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4:junit4] 2> 682754 T1209 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Message id:/overseer/collection-queue-work/qn-0000000000 complete, response:{success={null={responseHeader={status=0,QTime=4341},core=nodes_used_collection_shard1_replica1},null={responseHeader={status=0,QTime=4343},core=nodes_used_collection_shard2_replica2},null={responseHeader={status=0,QTime=4347},core=nodes_used_collection_shard1_replica2},null={responseHeader={status=0,QTime=4391},core=nodes_used_collection_shard2_replica1}}}
[junit4:junit4] 2> 682766 T1215 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/collections params={numShards=2&name=nodes_used_collection&replicationFactor=2&action=CREATE&wt=javabin&version=2} status=0 QTime=4415
[junit4:junit4] 2> 682767 T1185 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 682768 T1185 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 682770 T1282 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@158a310a name:ZooKeeperConnection Watcher:127.0.0.1:13994/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 682770 T1185 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 682772 T1185 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 682775 T1185 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 682777 T1185 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 682778 T1284 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6a68c9a1 name:ZooKeeperConnection Watcher:127.0.0.1:13994/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 682779 T1185 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 682780 T1185 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 682795 T1218 oasha.CollectionsHandler.handleCreateAction Creating Collection : numShards=2&maxShardsPerNode=1&name=awholynewcollection_0&replicationFactor=2&action=CREATE&wt=javabin&version=2
[junit4:junit4] 2> 682796 T1207 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4:junit4] 2> 682798 T1209 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000002 message:{
[junit4:junit4] 2> "operation":"createcollection",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "maxShardsPerNode":"1",
[junit4:junit4] 2> "createNodeSet":null,
[junit4:junit4] 2> "name":"awholynewcollection_0",
[junit4:junit4] 2> "replicationFactor":"2"}
[junit4:junit4] 2> 682798 T1209 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard1_replica1 as part of slice shard1 of collection awholynewcollection_0 on 127.0.0.1:50547_pm%2Fiv
[junit4:junit4] 2> 682799 T1209 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard1_replica2 as part of slice shard1 of collection awholynewcollection_0 on 127.0.0.1:51984_pm%2Fiv
[junit4:junit4] 2> 682799 T1209 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard2_replica1 as part of slice shard2 of collection awholynewcollection_0 on 127.0.0.1:52966_pm%2Fiv
[junit4:junit4] 2> 682799 T1209 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard2_replica2 as part of slice shard2 of collection awholynewcollection_0 on 127.0.0.1:13870_pm%2Fiv
[junit4:junit4] 2> 682801 T1243 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard2_replica2' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369044960207/awholynewcollection_0_shard2_replica2
[junit4:junit4] 2> 682801 T1257 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard1_replica2' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369044961836/awholynewcollection_0_shard1_replica2
[junit4:junit4] 2> 682801 T1257 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 682801 T1229 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard2_replica1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369044958786/awholynewcollection_0_shard2_replica1
[junit4:junit4] 2> 682802 T1257 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4] 2> 682801 T1216 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard1_replica1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369044957166/awholynewcollection_0_shard1_replica1
[junit4:junit4] 2> 682803 T1216 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 682801 T1243 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 682803 T1257 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 682802 T1229 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 682804 T1243 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4] 2> 682804 T1216 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4] 2> 682805 T1257 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 682805 T1229 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4] 2> 682805 T1243 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 682806 T1229 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 682806 T1257 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4:junit4] 2> 682805 T1216 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 682807 T1243 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 682808 T1229 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 682808 T1243 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4:junit4] 2> 682808 T1216 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 682808 T1229 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4:junit4] 2> 682809 T1257 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 682809 T1216 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4:junit4] 2> 682811 T1243 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 682812 T1257 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369044961836/awholynewcollection_0_shard1_replica2/'
[junit4:junit4] 2> 682819 T1229 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 682820 T1216 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 682821 T1243 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369044960207/awholynewcollection_0_shard2_replica2/'
[junit4:junit4] 2> 682822 T1229 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369044958786/awholynewcollection_0_shard2_replica1/'
[junit4:junit4] 2> 682823 T1216 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369044957166/awholynewcollection_0_shard1_replica1/'
[junit4:junit4] 2> 682908 T1257 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 682908 T1229 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 682909 T1216 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 682908 T1243 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 682981 T1257 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 682981 T1229 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 682983 T1243 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 682983 T1216 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 683084 T1257 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 683084 T1229 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 683085 T1243 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 683086 T1216 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 683091 T1229 oass.IndexSchema.readSchema [awholynewcollection_0_shard2_replica1] Schema name=test
[junit4:junit4] 2> 683091 T1257 oass.IndexSchema.readSchema [awholynewcollection_0_shard1_replica2] Schema name=test
[junit4:junit4] 2> 683093 T1243 oass.IndexSchema.readSchema [awholynewcollection_0_shard2_replica2] Schema name=test
[junit4:junit4] 2> 683093 T1216 oass.IndexSchema.readSchema [awholynewcollection_0_shard1_replica1] Schema name=test
[junit4:junit4] 2> 683762 T1229 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 683772 T1229 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 683775 T1229 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 683788 T1229 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 683792 T1216 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 683792 T1229 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 683796 T1229 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 683797 T1229 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 683797 T1229 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 683798 T1229 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 683799 T1229 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 683799 T1229 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 683799 T1229 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 683800 T1229 oasc.SolrCore.<init> [awholynewcollection_0_shard2_replica1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369044958786/awholynewcollection_0_shard2_replica1/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369044958786/awholynewcollection_0_shard2_replica1/data/
[junit4:junit4] 2> 683800 T1229 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7979a49f
[junit4:junit4] 2> 683801 T1229 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 683801 T1229 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369044958786/awholynewcollection_0_shard2_replica1/data
[junit4:junit4] 2> 683802 T1229 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369044958786/awholynewcollection_0_shard2_replica1/data/index/
[junit4:junit4] 2> 683802 T1229 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard2_replica1] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369044958786/awholynewcollection_0_shard2_replica1/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 683802 T1229 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369044958786/awholynewcollection_0_shard2_replica1/data/index
[junit4:junit4] 2> 683802 T1216 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 683807 T1229 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@61045d19 lockFactory=org.apache.lucene.store.NativeFSLockFactory@616d3343),segFN=segments_1,generation=1}
[junit4:junit4] 2> 683808 T1229 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 683808 T1216 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 683811 T1229 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 683811 T1229 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 683811 T1229 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 683812 T1229 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 683813 T1229 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 683813 T1229 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 683813 T1229 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 683814 T1229 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 683814 T1229 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 683824 T1229 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 683827 T1229 oass.SolrIndexSearcher.<init> Opening Searcher@3248b991 main
[junit4:junit4] 2> 683828 T1229 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369044958786/awholynewcollection_0_shard2_replica1/data/tlog
[junit4:junit4] 2> 683829 T1216 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 683829 T1229 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 683830 T1229 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 683832 T1285 oasc.SolrCore.registerSearcher [awholynewcollection_0_shard2_replica1] Registered new searcher Searcher@3248b991 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 683835 T1229 oasc.ZkController.publish publishing core=awholynewcollection_0_shard2_replica1 state=down
[junit4:junit4] 2> 683845 T1216 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 683850 T1216 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 683852 T1216 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 683852 T1216 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 683853 T1216 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 683854 T1216 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 683854 T1216 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 683855 T1216 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 683855 T1216 oasc.SolrCore.<init> [awholynewcollection_0_shard1_replica1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369044957166/awholynewcollection_0_shard1_replica1/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369044957166/awholynewcollection_0_shard1_replica1/data/
[junit4:junit4] 2> 683856 T1216 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7979a49f
[junit4:junit4] 2> 683856 T1216 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 683857 T1216 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369044957166/awholynewcollection_0_shard1_replica1/data
[junit4:junit4] 2> 683857 T1216 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369044957166/awholynewcollection_0_shard1_replica1/data/index/
[junit4:junit4] 2> 683858 T1216 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard1_replica1] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369044957166/awholynewcollection_0_shard1_replica1/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 683858 T1216 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369044957166/awholynewcollection_0_shard1_replica1/data/index
[junit4:junit4] 2> 683865 T1216 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@29dbe68c lockFactory=org.apache.lucene.store.NativeFSLockFactory@28017a7f),segFN=segments_1,generation=1}
[junit4:junit4] 2> 683865 T1216 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 683869 T1216 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 683870 T1216 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 683870 T1216 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 683871 T1216 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 683872 T1216 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 683872 T1216 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 683873 T1216 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 683873 T1216 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 683874 T1216 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 683875 T1243 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 683875 T1257 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 683888 T1216 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 683891 T1257 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 683891 T1243 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 683892 T1216 oass.SolrIndexSearcher.<init> Opening Searcher@f465981 main
[junit4:junit4] 2> 683892 T1216 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369044957166/awholynewcollection_0_shard1_replica1/data/tlog
[junit4:junit4] 2> 683894 T1216 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 683894 T1257 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 683895 T1216 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 683896 T1243 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 683898 T1286 oasc.SolrCore.registerSearcher [awholynewcollection_0_shard1_replica1] Registered new searcher Searcher@f465981 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 683901 T1216 oasc.ZkController.publish publishing core=awholynewcollection_0_shard1_replica1 state=down
[junit4:junit4] 2> 683910 T1257 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 683912 T1243 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 683922 T1257 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 683922 T1243 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 683926 T1257 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 683927 T1257 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 683927 T1257 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 683927 T1243 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 683928 T1257 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 683929 T1243 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 683929 T1243 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 683929 T1257 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 683930 T1257 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 683930 T1243 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 683930 T1257 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 683931 T1257 oasc.SolrCore.<init> [awholynewcollection_0_shard1_replica2] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369044961836/awholynewcollection_0_shard1_replica2/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369044961836/awholynewcollection_0_shard1_replica2/data/
[junit4:junit4] 2> 683931 T1257 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7979a49f
[junit4:junit4] 2> 683931 T1243 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 683932 T1257 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 683932 T1243 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 683933 T1257 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369044961836/awholynewcollection_0_shard1_replica2/data
[junit4:junit4] 2> 683933 T1243 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 683933 T1257 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369044961836/awholynewcollection_0_shard1_replica2/data/index/
[junit4:junit4] 2> 683934 T1243 oasc.SolrCore.<init> [awholynewcollection_0_shard2_replica2] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369044960207/awholynewcollection_0_shard2_replica2/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369044960207/awholynewcollection_0_shard2_replica2/data/
[junit4:junit4] 2> 683934 T1257 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard1_replica2] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369044961836/awholynewcollection_0_shard1_replica2/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 683934 T1243 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7979a49f
[junit4:junit4] 2> 683935 T1257 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369044961836/awholynewcollection_0_shard1_replica2/data/index
[junit4:junit4] 2> 683935 T1243 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 683936 T1243 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369044960207/awholynewcollection_0_shard2_replica2/data
[junit4:junit4] 2> 683936 T1243 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369044960207/awholynewcollection_0_shard2_replica2/data/index/
[junit4:junit4] 2> 683937 T1243 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard2_replica2] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369044960207/awholynewcollection_0_shard2_replica2/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 683938 T1243 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369044960207/awholynewcollection_0_shard2_replica2/data/index
[junit4:junit4] 2> 683939 T1257 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5121d9e4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@360b1a4),segFN=segments_1,generation=1}
[junit4:junit4] 2> 683939 T1257 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 683942 T1257 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 683942 T1257 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 683947 T1257 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 683947 T1243 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4c7b883f lockFactory=org.apache.lucene.store.NativeFSLockFactory@1314377b),segFN=segments_1,generation=1}
[junit4:junit4] 2> 683948 T1257 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 683948 T1243 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 683948 T1257 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 683949 T1257 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 683949 T1257 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 683950 T1257 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 683950 T1257 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 683952 T1243 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 683952 T1243 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 683953 T1243 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 683954 T1243 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 683955 T1243 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 683955 T1243 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 683955 T1243 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 683956 T1243 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 683957 T1243 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 683958 T1257 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 683959 T1243 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 683966 T1257 oass.SolrIndexSearcher.<init> Opening Searcher@6dbf51e3 main
[junit4:junit4] 2> 683967 T1257 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369044961836/awholynewcollection_0_shard1_replica2/data/tlog
[junit4:junit4] 2> 683967 T1243 oass.SolrIndexSearcher.<init> Opening Searcher@8d01cf main
[junit4:junit4] 2> 683968 T1243 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369044960207/awholynewcollection_0_shard2_replica2/data/tlog
[junit4:junit4] 2> 683968 T1257 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 683969 T1257 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 683969 T1243 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 683970 T1243 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 683971 T1287 oasc.SolrCore.registerSearcher [awholynewcollection_0_shard1_replica2] Registered new searcher Searcher@6dbf51e3 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 683973 T1257 oasc.ZkController.publish publishing core=awholynewcollection_0_shard1_replica2 state=down
[junit4:junit4] 2> 683973 T1288 oasc.SolrCore.registerSearcher [awholynewcollection_0_shard2_replica2] Registered new searcher Searcher@8d01cf main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 683976 T1243 oasc.ZkController.publish publishing core=awholynewcollection_0_shard2_replica2 state=down
[junit4:junit4] 2> 684195 T1208 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 684196 T1208 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:51984_pm%2Fiv_nodes_used_collection_shard1_replica1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"nodes_used_collection_shard1_replica1",
[junit4:junit4] 2> "collection":"nodes_used_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:51984_pm%2Fiv",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:51984/pm/iv"}
[junit4:junit4] 2> 684199 T1208 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:50547_pm%2Fiv_nodes_used_collection_shard2_replica2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"nodes_used_collection_shard2_replica2",
[junit4:junit4] 2> "collection":"nodes_used_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:50547_pm%2Fiv",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:50547/pm/iv"}
[junit4:junit4] 2> 684214 T1208 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:52966_pm%2Fiv_nodes_used_collection_shard1_replica2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"nodes_used_collection_shard1_replica2",
[junit4:junit4] 2> "collection":"nodes_used_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52966_pm%2Fiv",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52966/pm/iv"}
[junit4:junit4] 2> 684224 T1208 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:48169_pm%2Fiv_nodes_used_collection_shard2_replica1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"nodes_used_collection_shard2_replica1",
[junit4:junit4] 2> "collection":"nodes_used_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:48169_pm%2Fiv",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:48169/pm/iv"}
[junit4:junit4] 2> 684229 T1208 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"awholynewcollection_0_shard2_replica1",
[junit4:junit4] 2> "collection":"awholynewcollection_0",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52966_pm%2Fiv",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52966/pm/iv"}
[junit4:junit4] 2> 684229 T1208 oasc.Overseer$ClusterStateUpdater.createCollection Create collection awholynewcollection_0 with numShards 2
[junit4:junit4] 2> 684239 T1208 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"awholynewcollection_0_shard1_replica1",
[junit4:junit4] 2> "collection":"awholynewcollection_0",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:50547_pm%2Fiv",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:50547/pm/iv"}
[junit4:junit4] 2> 684248 T1208 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"awholynewcollection_0_shard1_replica2",
[junit4:junit4] 2> "collection":"awholynewcollection_0",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:51984_pm%2Fiv",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:51984/pm/iv"}
[junit4:junit4] 2> 684252 T1208 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"awholynewcollection_0_shard2_replica2",
[junit4:junit4] 2> "collection":"awholynewcollection_0",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:13870_pm%2Fiv",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:13870/pm/iv"}
[junit4:junit4] 2> 684265 T1207 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 684265 T1253 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 684265 T1212 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 684265 T1225 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 684265 T1267 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 684265 T1284 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 684265 T1239 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 684265 T1282 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 684734 T1198 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:50547_pm%2Fiv_nodes_used_collection_shard2_replica2, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 684734 T1198 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:50547_pm%252Fiv_nodes_used_collection_shard2_replica2&state=recovering&nodeName=127.0.0.1:50547_pm%252Fiv&action=PREPRECOVERY&checkLive=true&core=nodes_used_collection_shard2_replica1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2002
[junit4:junit4] 2> 684735 T1258 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:52966_pm%2Fiv_nodes_used_collection_shard1_replica2, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 684735 T1258 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:52966_pm%252Fiv_nodes_used_collection_shard1_replica2&state=recovering&nodeName=127.0.0.1:52966_pm%252Fiv&action=PREPRECOVERY&checkLive=true&core=nodes_used_collection_shard1_replica1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2003
[junit4:junit4] 2> 684838 T1229 oasc.CoreContainer.registerCore registering core: awholynewcollection_0_shard2_replica1
[junit4:junit4] 2> 684838 T1229 oasc.ZkController.register Register replica - core:awholynewcollection_0_shard2_replica1 address:http://127.0.0.1:52966/pm/iv collection:awholynewcollection_0 shard:shard2
[junit4:junit4] 2> 684839 T1229 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0/leader_elect/shard2/election
[junit4:junit4] 2> 684867 T1229 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 684878 T1229 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=180000
[junit4:junit4] 2> 684904 T1216 oasc.CoreContainer.registerCore registering core: awholynewcollection_0_shard1_replica1
[junit4:junit4] 2> 684904 T1216 oasc.ZkController.register Register replica - core:awholynewcollection_0_shard1_replica1 address:http://127.0.0.1:50547/pm/iv collection:awholynewcollection_0 shard:shard1
[junit4:junit4] 2> 684905 T1216 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0/leader_elect/shard1/election
[junit4:junit4] 2> 684919 T1216 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 684923 T1216 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=179999
[junit4:junit4] 2> 684977 T1257 oasc.CoreContainer.registerCore registering core: awholynewcollection_0_shard1_replica2
[junit4:junit4] 2> 684977 T1257 oasc.ZkController.register Register replica - core:awholynewcollection_0_shard1_replica2 address:http://127.0.0.1:51984/pm/iv collection:awholynewcollection_0 shard:shard1
[junit4:junit4] 2> 684978 T1243 oasc.CoreContainer.registerCore registering core: awholynewcollection_0_shard2_replica2
[junit4:junit4] 2> 684978 T1243 oasc.ZkController.register Register replica - core:awholynewcollection_0_shard2_replica2 address:http://127.0.0.1:13870/pm/iv collection:awholynewcollection_0 shard:shard2
[junit4:junit4] 2> 685380 T1229 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 685381 T1229 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 685381 T1229 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:52966/pm/iv/awholynewcollection_0_shard2_replica1/
[junit4:junit4] 2> 685381 T1229 oasu.PeerSync.sync PeerSync: core=awholynewcollection_0_shard2_replica1 url=http://127.0.0.1:52966/pm/iv START replicas=[http://127.0.0.1:13870/pm/iv/awholynewcollection_0_shard2_replica2/] nUpdates=100
[junit4:junit4] 2> 685382 T1229 oasu.PeerSync.sync PeerSync: core=awholynewcollection_0_shard2_replica1 url=http://127.0.0.1:52966/pm/iv DONE. We have no versions. sync failed.
[junit4:junit4] 2> 685382 T1229 oasc.SyncStrategy.syncReplicas Leader's attempt to sync with shard failed, moving to the next canidate
[junit4:junit4] 2> 685382 T1229 oasc.ShardLeaderElectionContext.runLeaderProcess We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4:junit4] 2> 685383 T1229 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:52966/pm/iv/awholynewcollection_0_shard2_replica1/
[junit4:junit4] 2> 685384 T1229 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0/leaders/shard2
[junit4:junit4] 2> ASYNC NEW_CORE C59 name=awholynewcollection_0_shard2_replica2 org.apache.solr.core.SolrCore@227776f1 url=http://127.0.0.1:13870/pm/iv/awholynewcollection_0_shard2_replica2 node=127.0.0.1:13870_pm%2Fiv C59_STATE=coll:awholynewcollection_0 core:awholynewcollection_0_shard2_replica2 props:{shard=shard2, state=down, core=awholynewcollection_0_shard2_replica2, collection=awholynewcollection_0, node_name=127.0.0.1:13870_pm%2Fiv, base_url=http://127.0.0.1:13870/pm/iv}
[junit4:junit4] 2> 685389 T1244 C59 P13870 oasc.SolrCore.execute [awholynewcollection_0_shard2_replica2] webapp=/pm/iv path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 685424 T1216 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 685424 T1216 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 685425 T1216 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:50547/pm/iv/awholynewcollection_0_shard1_replica1/
[junit4:junit4] 2> 685425 T1216 oasu.PeerSync.sync PeerSync: core=awholynewcollection_0_shard1_replica1 url=http://127.0.0.1:50547/pm/iv START replicas=[http://127.0.0.1:51984/pm/iv/awholynewcollection_0_shard1_replica2/] nUpdates=100
[junit4:junit4] 2> 685425 T1216 oasu.PeerSync.sync PeerSync: core=awholynewcollection_0_shard1_replica1 url=http://127.0.0.1:50547/pm/iv DONE. We have no versions. sync failed.
[junit4:junit4] 2> 685426 T1216 oasc.SyncStrategy.syncReplicas Leader's attempt to sync with shard failed, moving to the next canidate
[junit4:junit4] 2> 685426 T1216 oasc.ShardLeaderElectionContext.runLeaderProcess We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4:junit4] 2> 685426 T1216 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:50547/pm/iv/awholynewcollection_0_shard1_replica1/
[junit4:junit4] 2> 685427 T1216 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0/leaders/shard1
[junit4:junit4] 2> ASYNC NEW_CORE C60 name=awholynewcollection_0_shard1_replica2 org.apache.solr.core.SolrCore@3fab6517 url=http://127.0.0.1:51984/pm/iv/awholynewcollection_0_shard1_replica2 node=127.0.0.1:51984_pm%2Fiv C60_STATE=coll:awholynewcollection_0 core:awholynewcollection_0_shard1_replica2 props:{shard=shard1, state=down, core=awholynewcollection_0_shard1_replica2, collection=awholynewcollection_0, node_name=127.0.0.1:51984_pm%2Fiv, base_url=http://127.0.0.1:51984/pm/iv}
[junit4:junit4] 2> 685431 T1259 C60 P51984 oasc.SolrCore.execute [awholynewcollection_0_shard1_replica2] webapp=/pm/iv path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 685797 T1208 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 685991 T1282 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 685991 T1225 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 685991 T1212 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 685991 T1267 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 685991 T1284 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 685991 T1239 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 685991 T1253 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 685991 T1207 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 686000 T1216 oasc.ZkController.register We are http://127.0.0.1:50547/pm/iv/awholynewcollection_0_shard1_replica1/ and leader is http://127.0.0.1:50547/pm/iv/awholynewcollection_0_shard1_replica1/
[junit4:junit4] 2> 686000 T1216 oasc.ZkController.register No LogReplay needed for core=awholynewcollection_0_shard1_replica1 baseURL=http://127.0.0.1:50547/pm/iv
[junit4:junit4] 2> 686000 T1216 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 686001 T1216 oasc.ZkController.publish publishing core=awholynewcollection_0_shard1_replica1 state=active
[junit4:junit4] 2> 686013 T1229 oasc.ZkController.register We are http://127.0.0.1:52966/pm/iv/awholynewcollection_0_shard2_replica1/ and leader is http://127.0.0.1:52966/pm/iv/awholynewcollection_0_shard2_replica1/
[junit4:junit4] 2> 686013 T1229 oasc.ZkController.register No LogReplay needed for core=awholynewcollection_0_shard2_replica1 baseURL=http://127.0.0.1:52966/pm/iv
[junit4:junit4] 2> 686013 T1229 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 686014 T1229 oasc.ZkController.publish publishing core=awholynewcollection_0_shard2_replica1 state=active
[junit4:junit4] 2> 686028 T1216 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 686028 T1229 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 686035 T1216 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=2&shard=shard1&name=awholynewcollection_0_shard1_replica1&action=CREATE&collection=awholynewcollection_0&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=3234
[junit4:junit4] 2> 686035 T1229 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=2&shard=shard2&name=awholynewcollection_0_shard2_replica1&action=CREATE&collection=awholynewcollection_0&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=3234
[junit4:junit4] 2> 686042 T1257 oasc.ZkController.register We are http://127.0.0.1:51984/pm/iv/awholynewcollection_0_shard1_replica2/ and leader is http://127.0.0.1:50547/pm/iv/awholynewcollection_0_shard1_replica1/
[junit4:junit4] 2> 686042 T1243 oasc.ZkController.register We are http://127.0.0.1:13870/pm/iv/awholynewcollection_0_shard2_replica2/ and leader is http://127.0.0.1:52966/pm/iv/awholynewcollection_0_shard2_replica1/
[junit4:junit4] 2> 686042 T1257 oasc.ZkController.register No LogReplay needed for core=awholynewcollection_0_shard1_replica2 baseURL=http://127.0.0.1:51984/pm/iv
[junit4:junit4] 2> 686043 T1257 oasc.ZkController.checkRecovery Core needs to recover:awholynewcollection_0_shard1_replica2
[junit4:junit4] 2> 686042 T1243 oasc.ZkController.register No LogReplay needed for core=awholynewcollection_0_shard2_replica2 baseURL=http://127.0.0.1:13870/pm/iv
[junit4:junit4] 2> 686043 T1243 oasc.ZkController.checkRecovery Core needs to recover:awholynewcollection_0_shard2_replica2
[junit4:junit4] 2> 686044 T1243 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> 686043 T1257 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> 686044 T1291 C59 P13870 oasc.RecoveryStrategy.run Starting recovery process. core=awholynewcollection_0_shard2_replica2 recoveringAfterStartup=true
[junit4:junit4] 2> 686045 T1292 C60 P51984 oasc.RecoveryStrategy.run Starting recovery process. core=awholynewcollection_0_shard1_replica2 recoveringAfterStartup=true
[junit4:junit4] 2> 686045 T1243 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 686045 T1291 C59 P13870 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 686045 T1292 C60 P51984 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 686045 T1257 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 686047 T1243 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=2&shard=shard2&name=awholynewcollection_0_shard2_replica2&action=CREATE&collection=awholynewcollection_0&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=3246
[junit4:junit4] 2> 686047 T1292 C60 P51984 oasc.ZkController.publish publishing core=awholynewcollection_0_shard1_replica2 state=recovering
[junit4:junit4] 2> 686046 T1291 C59 P13870 oasc.ZkController.publish publishing core=awholynewcollection_0_shard2_replica2 state=recovering
[junit4:junit4] 2> 686048 T1257 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=2&shard=shard1&name=awholynewcollection_0_shard1_replica2&action=CREATE&collection=awholynewcollection_0&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=3247
[junit4:junit4] 2> 686049 T1209 oasc.OverseerCollectionProcessor.createCollection Finished create command on all shards for collection: awholynewcollection_0
[junit4:junit4] 2> 686049 T1292 C60 P51984 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 686050 T1291 C59 P13870 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 686060 T1225 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work/qnr-0000000002 state: SyncConnected type NodeDataChanged
[junit4:junit4] 2> 686062 T1207 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4:junit4] 2> 686062 T1209 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Message id:/overseer/collection-queue-work/qn-0000000002 complete, response:{success={null={responseHeader={status=0,QTime=3234},core=awholynewcollection_0_shard1_replica1},null={responseHeader={status=0,QTime=3234},core=awholynewcollection_0_shard2_replica1},null={responseHeader={status=0,QTime=3246},core=awholynewcollection_0_shard2_replica2},null={responseHeader={status=0,QTime=3247},core=awholynewcollection_0_shard1_replica2}}}
[junit4:junit4] 2> 686076 T1231 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:13870_pm%2Fiv_awholynewcollection_0_shard2_replica2, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 686076 T1219 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:51984_pm%2Fiv_awholynewcollection_0_shard1_replica2, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 686090 T1218 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/collections params={numShards=2&maxShardsPerNode=1&name=awholynewcollection_0&replicationFactor=2&action=CREATE&wt=javabin&version=2} status=0 QTime=3295
[junit4:junit4] 2> 686092 T1185 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 686094 T1185 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 686097 T1294 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@336395be name:ZooKeeperConnection Watcher:127.0.0.1:13994/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 686097 T1185 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 686098 T1185 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 686113 T1220 oasha.CollectionsHandler.handleCreateAction Creating Collection : numShards=4&maxShardsPerNode=2&name=awholynewcollection_1&replicationFactor=2&action=CREATE&wt=javabin&version=2
[junit4:junit4] 2> 686115 T1207 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4:junit4] 2> 686116 T1209 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000004 message:{
[junit4:junit4] 2> "operation":"createcollection",
[junit4:junit4] 2> "numShards":"4",
[junit4:junit4] 2> "maxShardsPerNode":"2",
[junit4:junit4] 2> "createNodeSet":null,
[junit4:junit4] 2> "name":"awholynewcollection_1",
[junit4:junit4] 2> "replicationFactor":"2"}
[junit4:junit4] 2> 686117 T1209 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_1_shard1_replica1 as part of slice shard1 of collection awholynewcollection_1 on 127.0.0.1:13870_pm%2Fiv
[junit4:junit4] 2> 686117 T1209 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_1_shard1_replica2 as part of slice shard1 of collection awholynewcollection_1 on 127.0.0.1:52966_pm%2Fiv
[junit4:junit4] 2> 686117 T1209 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_1_shard2_replica1 as part of slice shard2 of collection awholynewcollection_1 on 127.0.0.1:51984_pm%2Fiv
[junit4:junit4] 2> 686118 T1209 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_1_shard2_replica2 as part of slice shard2 of collection awholynewcollection_1 on 127.0.0.1:48169_pm%2Fiv
[junit4:junit4] 2> 686118 T1209 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_1_shard3_replica1 as part of slice shard3 of collection awholynewcollection_1 on 127.0.0.1:50547_pm%2Fiv
[junit4:junit4] 2> 686118 T1209 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_1_shard3_replica2 as part of slice shard3 of collection awholynewcollection_1 on 127.0.0.1:13870_pm%2Fiv
[junit4:junit4] 2> 686119 T1209 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_1_shard4_replica1 as part of slice shard4 of collection awholynewcollection_1 on 127.0.0.1:52966_pm%2Fiv
[junit4:junit4] 2> 686119 T1209 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_1_shard4_replica2 as part of slice shard4 of collection awholynewcollection_1 on 127.0.0.1:51984_pm%2Fiv
[junit4:junit4] 2> 686119 T1229 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_1_shard1_replica2' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369044958786/awholynewcollection_1_shard1_replica2
[junit4:junit4] 2> 686120 T1229 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_1
[junit4:junit4] 2> 686119 T1243 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_1_shard1_replica1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369044960207/awholynewcollection_1_shard1_replica1
[junit4:junit4] 2> 686121 T1260 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_1_shard4_replica2' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369044961836/awholynewcollection_1_shard4_replica2
[junit4:junit4] 2> 686121 T1216 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_1_shard3_replica1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369044957166/awholynewcollection_1_shard3_replica1
[junit4:junit4] 2> 686120 T1232 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_1_shard4_replica1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369044958786/awholynewcollection_1_shard4_replica1
[junit4:junit4] 2> 686122 T1232 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_1
[junit4:junit4] 2> 686120 T1197 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_1_shard2_replica2' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369044956458/awholynewcollection_1_shard2_replica2
[junit4:junit4] 2> 686120 T1245 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_1_shard3_replica2' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369044960207/awholynewcollection_1_shard3_replica2
[junit4:junit4] 2> 686123 T1245 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_1
[junit4:junit4] 2> 686120 T1257 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_1_shard2_replica1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369044961836/awholynewcollection_1_shard2_replica1
[junit4:junit4] 2> 686124 T1257 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_1
[junit4:junit4] 2> 686123 T1232 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_1
[junit4:junit4] 2> 686123 T1197 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_1
[junit4:junit4] 2> 686122 T1216 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_1
[junit4:junit4] 2> 686121 T1260 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_1
[junit4:junit4] 2> 686121 T1229 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_1
[junit4:junit4] 2> 686121 T1243 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_1
[junit4:junit4] 2> 686126 T1260 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_1
[junit4:junit4] 2> 686126 T1229 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 686126 T1216 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_1
[junit4:junit4] 2> 686126 T1197 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_1
[junit4:junit4] 2> 686125 T1257 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_1
[junit4:junit4] 2> 686125 T1232 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 686124 T1245 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_1
[junit4:junit4] 2> 686129 T1257 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 686128 T1229 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 686128 T1197 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 686128 T1216 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 686127 T1243 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_1
[junit4:junit4] 2> 686127 T1260 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 686131 T1197 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 686131 T1243 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 686132 T1260 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 686131 T1257 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 686130 T1229 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_1
[junit4:junit4] 2> 686130 T1232 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 686129 T1245 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 686134 T1232 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_1
[junit4:junit4] 2> 686133 T1243 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 686133 T1257 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_1
[junit4:junit4] 2> 686133 T1260 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_1
[junit4:junit4] 2> 686132 T1197 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_1
[junit4:junit4] 2> 686132 T1216 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 686136 T1229 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_1
[junit4:junit4] 2> 686136 T1245 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 686135 T1243 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_1
[junit4:junit4] 2> 686138 T1245 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_1
[junit4:junit4] 2> 686137 T1232 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_1
[junit4:junit4] 2> 686137 T1216 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_1
[junit4:junit4] 2> 686147 T1257 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_1
[junit4:junit4] 2> 686147 T1260 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_1
[junit4:junit4] 2> 686148 T1197 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_1
[junit4:junit4] 2> 686149 T1229 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369044958786/awholynewcollection_1_shard1_replica2/'
[junit4:junit4] 2> 686150 T1232 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369044958786/awholynewcollection_1_shard4_replica1/'
[junit4:junit4] 2> 686150 T1257 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369044961836/awholynewcollection_1_shard2_replica1/'
[junit4:junit4] 2> 686155 T1243 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_1
[junit4:junit4] 2> 686156 T1216 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_1
[junit4:junit4] 2> 686156 T1245 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_1
[junit4:junit4] 2> 686158 T1197 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369044956458/awholynewcollection_1_shard2_replica2/'
[junit4:junit4] 2> 686158 T1260 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369044961836/awholynewcollection_1_shard4_replica2/'
[junit4:junit4] 2> 686158 T1243 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369044960207/awholynewcollection_1_shard1_replica1/'
[junit4:junit4] 2> 686159 T1216 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369044957166/awholynewcollection_1_shard3_replica1/'
[junit4:junit4] 2> 686160 T1245 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369044960207/awholynewcollection_1_shard3_replica2/'
[junit4:junit4] 2> 686248 T1229 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 686249 T1260 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 686253 T1216 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 686255 T1232 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 686257 T1197 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 686268 T1257 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 686282 T1245 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 686291 T1243 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 686357 T1260 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 686358 T1229 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 686360 T1260 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 686360 T1229 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 686364 T1232 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 686365 T1197 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 686366 T1232 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 686367 T1197 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 686369 T1229 oass.IndexSchema.readSchema [awholynewcollection_1_shard1_replica2] Schema name=test
[junit4:junit4] 2> 686370 T1216 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 686371 T1260 oass.IndexSchema.readSchema [awholynewcollection_1_shard4_replica2] Schema name=test
[junit4:junit4] 2> 686372 T1216 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 686376 T1197 oass.IndexSchema.readSchema [awholynewcollection_1_shard2_replica2] Schema name=test
[junit4:junit4] 2> 686378 T1232 oass.IndexSchema.readSchema [awholynewcollection_1_shard4_replica1] Schema name=test
[junit4:junit4] 2> 686383 T1245 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 686384 T1216 oass.IndexSchema.readSchema [awholynewcollection_1_shard3_replica1] Schema name=test
[junit4:junit4] 2> 686385 T1257 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 686386 T1245 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 686387 T1257 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 686394 T1245 oass.IndexSchema.readSchema [awholynewcollection_1_shard3_replica2] Schema name=test
[junit4:junit4] 2> 686395 T1243 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 686397 T1243 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 686398 T1257 oass.IndexSchema.readSchema [awholynewcollection_1_shard2_replica1] Schema name=test
[junit4:junit4] 2> 686407 T1243 oass.IndexSchema.readSchema [awholynewcollection_1_shard1_replica1] Schema name=test
[junit4:junit4] 2> C57_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica2 props:{shard=shard2, state=recovering, core=nodes_used_collection_shard2_replica2, collection=nodes_used_collection, node_name=127.0.0.1:50547_pm%2Fiv, base_url=http://127.0.0.1:50547/pm/iv}
[junit4:junit4] 2> 686736 T1279 C57 P50547 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:48169/pm/iv/nodes_used_collection_shard2_replica1/ core=nodes_used_collection_shard2_replica2 - recoveringAfterStartup=true
[junit4:junit4] 2> 686736 T1279 C57 P50547 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard2_replica2 url=http://127.0.0.1:50547/pm/iv START replicas=[http://127.0.0.1:48169/pm/iv/nodes_used_collection_shard2_replica1/] nUpdates=100
[junit4:junit4] 2> 686737 T1279 C57 P50547 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 686737 T1279 C57 P50547 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=nodes_used_collection_shard2_replica2
[junit4:junit4] 2> C58_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica2 props:{shard=shard1, state=recovering, core=nodes_used_collection_shard1_replica2, collection=nodes_used_collection, node_name=127.0.0.1:52966_pm%2Fiv, base_url=http://127.0.0.1:52966/pm/iv}
[junit4:junit4]
[...truncated too long message...]
6)
[junit4:junit4] 2> at org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:127)
[junit4:junit4] 2> at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:180)
[junit4:junit4] 2> at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:294)
[junit4:junit4] 2> at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:645)
[junit4:junit4] 2> at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:480)
[junit4:junit4] 2> at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:906)
[junit4:junit4] 2> at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:805)
[junit4:junit4] 2> at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:784)
[junit4:junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:365)
[junit4:junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
[junit4:junit4] 2> at org.apache.solr.cloud.SyncStrategy$1.run(SyncStrategy.java:298)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:679)
[junit4:junit4] 2> NOTE: test params are: codec=Asserting, sim=DefaultSimilarity, locale=es_UY, timezone=America/Indiana/Winamac
[junit4:junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Sun Microsystems Inc. 1.6.0_32 (64-bit)/cpus=16,threads=2,free=106954112,total=532348928
[junit4:junit4] 2> NOTE: All tests run in this JVM: [DocumentAnalysisRequestHandlerTest, SolrRequestParserTest, FieldAnalysisRequestHandlerTest, TestFieldTypeResource, CurrencyFieldOpenExchangeTest, DirectSolrSpellCheckerTest, TestDistributedGrouping, HighlighterConfigTest, TimeZoneUtilsTest, HardAutoCommitTest, ChaosMonkeyShardSplitTest, TestCoreDiscovery, TestFoldingMultitermQuery, SolrIndexConfigTest, ZkSolrClientTest, TestPostingsSolrHighlighter, TestUpdate, TestShardHandlerFactory, TestMaxScoreQueryParser, SampleTest, TestZkChroot, TestBM25SimilarityFactory, NoCacheHeaderTest, SolrCmdDistributorTest, TestRandomFaceting, TestPropInject, TestSolrXMLSerializer, IndexBasedSpellCheckerTest, RequiredFieldsTest, TestStressReorder, SpellCheckCollatorTest, TestNumberUtils, TestIndexingPerformance, TestAddFieldRealTimeGet, NumericFieldsTest, TestDistributedSearch, TestRTGBase, TestArbitraryIndexDir, CoreContainerCoreInitFailuresTest, TestIndexSearcher, TestJmxMonitoredMap, UpdateParamsTest, TestLuceneMatchVersion, TestFastOutputStream, BasicZkTest, TestSuggestSpellingConverter, DOMUtilTest, TestSchemaSimilarityResource, SuggesterWFSTTest, TestUtils, IndexReaderFactoryTest, CollectionsAPIDistributedZkTest]
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=CollectionsAPIDistributedZkTest -Dtests.seed=5C2F5BDC8F93160 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=es_UY -Dtests.timezone=America/Indiana/Winamac -Dtests.file.encoding=UTF-8
[junit4:junit4] ERROR 0.00s J1 | CollectionsAPIDistributedZkTest (suite) <<<
[junit4:junit4] > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.CollectionsAPIDistributedZkTest:
[junit4:junit4] > 1) Thread[id=1381, name=recoveryCmdExecutor-586-thread-1, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4:junit4] > at java.net.PlainSocketImpl.socketConnect(Native Method)
[junit4:junit4] > at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:327)
[junit4:junit4] > at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:193)
[junit4:junit4] > at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:180)
[junit4:junit4] > at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:384)
[junit4:junit4] > at java.net.Socket.connect(Socket.java:546)
[junit4:junit4] > at org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:127)
[junit4:junit4] > at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:180)
[junit4:junit4] > at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:294)
[junit4:junit4] > at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:645)
[junit4:junit4] > at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:480)
[junit4:junit4] > at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:906)
[junit4:junit4] > at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:805)
[junit4:junit4] > at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:784)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:365)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
[junit4:junit4] > at org.apache.solr.cloud.SyncStrategy$1.run(SyncStrategy.java:298)
[junit4:junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
[junit4:junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:679)
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([5C2F5BDC8F93160]:0)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
[junit4:junit4] > 1) Thread[id=1381, name=recoveryCmdExecutor-586-thread-1, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4:junit4] > at java.net.PlainSocketImpl.socketConnect(Native Method)
[junit4:junit4] > at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:327)
[junit4:junit4] > at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:193)
[junit4:junit4] > at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:180)
[junit4:junit4] > at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:384)
[junit4:junit4] > at java.net.Socket.connect(Socket.java:546)
[junit4:junit4] > at org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:127)
[junit4:junit4] > at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:180)
[junit4:junit4] > at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:294)
[junit4:junit4] > at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:645)
[junit4:junit4] > at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:480)
[junit4:junit4] > at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:906)
[junit4:junit4] > at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:805)
[junit4:junit4] > at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:784)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:365)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
[junit4:junit4] > at org.apache.solr.cloud.SyncStrategy$1.run(SyncStrategy.java:298)
[junit4:junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
[junit4:junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:679)
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([5C2F5BDC8F93160]:0)
[junit4:junit4] Completed on J1 in 345.96s, 1 test, 1 failure, 2 errors <<< FAILURES!
[...truncated 537 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/build.xml:383: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/build.xml:363: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build.xml:181: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/common-build.xml:437: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/common-build.xml:1243: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/common-build.xml:887: There were test failures: 296 suites, 1234 tests, 2 suite-level errors, 1 failure, 715 ignored (3 assumptions)
Total time: 43 minutes 0 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-Tests-4.x-Java6 - Build # 1637 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java6/1637/
1 tests failed.
REGRESSION: org.apache.solr.cloud.ShardSplitTest.testDistribSearch
Error Message:
Server at http://127.0.0.1:52460 returned non ok status:500, message:Server Error
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:52460 returned non ok status:500, message:Server Error
at __randomizedtesting.SeedInfo.seed([E87D1E45DE4E8FBD:699B905DA911EF81]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:208)
at org.apache.solr.cloud.ShardSplitTest.doTest(ShardSplitTest.java:133)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:679)
Build Log:
[...truncated 8741 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.ShardSplitTest
[junit4:junit4] 2> 103482 T394 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4] 2> 103488 T394 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./solrtest-ShardSplitTest-1369023796084
[junit4:junit4] 2> 103490 T394 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 103491 T395 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 103591 T394 oasc.ZkTestServer.run start zk server on port:52453
[junit4:junit4] 2> 103592 T394 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 103596 T401 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7927bd04 name:ZooKeeperConnection Watcher:127.0.0.1:52453 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 103596 T394 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 103597 T394 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 103607 T394 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 103614 T403 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5ff3cd32 name:ZooKeeperConnection Watcher:127.0.0.1:52453/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 103615 T394 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 103615 T394 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 103675 T394 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 103678 T394 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 103695 T394 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 103735 T394 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 103736 T394 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 103763 T394 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 103764 T394 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 103872 T394 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 103873 T394 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 103884 T394 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 103885 T394 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 103888 T394 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 103889 T394 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 103893 T394 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 103894 T394 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 103898 T394 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 103899 T394 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 103902 T394 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 103903 T394 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 103907 T394 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 103908 T394 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 104164 T394 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 104169 T394 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:52456
[junit4:junit4] 2> 104170 T394 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 104171 T394 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 104171 T394 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1369023796508
[junit4:junit4] 2> 104172 T394 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1369023796508/solr.xml
[junit4:junit4] 2> 104172 T394 oasc.CoreContainer.<init> New CoreContainer 559676069
[junit4:junit4] 2> 104173 T394 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1369023796508/'
[junit4:junit4] 2> 104173 T394 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1369023796508/'
[junit4:junit4] 2> 104285 T394 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 104286 T394 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 104287 T394 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 104288 T394 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 104288 T394 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 104289 T394 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 104289 T394 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 104290 T394 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 104290 T394 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 104291 T394 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 104307 T394 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 104308 T394 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52453/solr
[junit4:junit4] 2> 104309 T394 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 104310 T394 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 104313 T414 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@609fc98 name:ZooKeeperConnection Watcher:127.0.0.1:52453 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 104314 T394 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 104316 T394 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 104327 T394 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 104330 T416 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@322424ee name:ZooKeeperConnection Watcher:127.0.0.1:52453/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 104330 T394 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 104333 T394 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 104342 T394 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 104346 T394 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 104353 T394 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52456_
[junit4:junit4] 2> 104355 T394 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52456_
[junit4:junit4] 2> 104359 T394 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 104376 T394 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 104383 T394 oasc.Overseer.start Overseer (id=89720343500619779-127.0.0.1:52456_-n_0000000000) starting
[junit4:junit4] 2> 104389 T394 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 104402 T418 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 104403 T394 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 104406 T394 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 104408 T394 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 104412 T417 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 104415 T419 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1369023796508/collection1
[junit4:junit4] 2> 104416 T419 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 104416 T419 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 104417 T419 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 104419 T419 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1369023796508/collection1/'
[junit4:junit4] 2> 104420 T419 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-controljetty-1369023796508/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 104421 T419 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-controljetty-1369023796508/collection1/lib/README' to classloader
[junit4:junit4] 2> 104470 T419 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 104527 T419 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 104629 T419 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 104635 T419 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 105185 T419 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 105189 T419 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 105191 T419 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 105197 T419 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 105232 T419 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 105233 T419 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1369023796508/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1369023796084/control/data/
[junit4:junit4] 2> 105233 T419 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5809fdee
[junit4:junit4] 2> 105234 T419 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 105235 T419 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369023796084/control/data
[junit4:junit4] 2> 105235 T419 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1369023796084/control/data/index/
[junit4:junit4] 2> 105235 T419 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1369023796084/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 105236 T419 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369023796084/control/data/index
[junit4:junit4] 2> 105241 T419 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@528c40ee lockFactory=org.apache.lucene.store.NativeFSLockFactory@1d04966e),segFN=segments_1,generation=1}
[junit4:junit4] 2> 105241 T419 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 105244 T419 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 105245 T419 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 105245 T419 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 105246 T419 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 105247 T419 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 105247 T419 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 105247 T419 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 105248 T419 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 105249 T419 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 105258 T419 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 105266 T419 oass.SolrIndexSearcher.<init> Opening Searcher@2b76be4 main
[junit4:junit4] 2> 105266 T419 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1369023796084/control/data/tlog
[junit4:junit4] 2> 105267 T419 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 105268 T419 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 105272 T420 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2b76be4 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 105273 T419 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 105274 T419 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 105916 T417 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 105917 T417 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52456_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52456"}
[junit4:junit4] 2> 105917 T417 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 105917 T417 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 105955 T416 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 106277 T419 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 106277 T419 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:52456 collection:control_collection shard:shard1
[junit4:junit4] 2> 106278 T419 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 106296 T419 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 106308 T419 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 106308 T419 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 106309 T419 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:52456/collection1/
[junit4:junit4] 2> 106309 T419 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 106309 T419 oasc.SyncStrategy.syncToMe http://127.0.0.1:52456/collection1/ has no replicas
[junit4:junit4] 2> 106310 T419 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:52456/collection1/
[junit4:junit4] 2> 106310 T419 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 107461 T417 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 107487 T416 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 107542 T419 oasc.ZkController.register We are http://127.0.0.1:52456/collection1/ and leader is http://127.0.0.1:52456/collection1/
[junit4:junit4] 2> 107542 T419 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:52456
[junit4:junit4] 2> 107542 T419 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 107543 T419 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 107543 T419 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 107545 T419 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 107546 T394 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0
[junit4:junit4] 2> 107547 T394 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 107547 T394 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 107564 T394 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 107566 T394 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 107568 T423 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4b7504fb name:ZooKeeperConnection Watcher:127.0.0.1:52453/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 107568 T394 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 107570 T394 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 107573 T394 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 107826 T394 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 107829 T394 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:52460
[junit4:junit4] 2> 107830 T394 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 107830 T394 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 107831 T394 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1369023800168
[junit4:junit4] 2> 107831 T394 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1369023800168/solr.xml
[junit4:junit4] 2> 107832 T394 oasc.CoreContainer.<init> New CoreContainer 1269051511
[junit4:junit4] 2> 107833 T394 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1369023800168/'
[junit4:junit4] 2> 107833 T394 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1369023800168/'
[junit4:junit4] 2> 107941 T394 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 107942 T394 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 107943 T394 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 107943 T394 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 107944 T394 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 107944 T394 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 107945 T394 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 107945 T394 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 107946 T394 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 107947 T394 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 107964 T394 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 107965 T394 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52453/solr
[junit4:junit4] 2> 107965 T394 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 107967 T394 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 107970 T434 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@65f9b56b name:ZooKeeperConnection Watcher:127.0.0.1:52453 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 107970 T394 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 107984 T394 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 107997 T394 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 107999 T436 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5d4f38ff name:ZooKeeperConnection Watcher:127.0.0.1:52453/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 108000 T394 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 108006 T394 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 108995 T417 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 108996 T417 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:52456__collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52456_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52456"}
[junit4:junit4] 2> 109015 T436 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 109015 T394 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52460_
[junit4:junit4] 2> 109015 T423 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 109015 T416 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 109018 T394 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52460_
[junit4:junit4] 2> 109029 T416 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 109029 T423 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 109029 T436 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 109029 T423 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 109030 T436 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 109031 T416 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 109037 T437 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1369023800168/collection1
[junit4:junit4] 2> 109037 T437 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 109038 T437 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 109038 T437 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 109040 T437 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1369023800168/collection1/'
[junit4:junit4] 2> 109041 T437 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty1-1369023800168/collection1/lib/README' to classloader
[junit4:junit4] 2> 109042 T437 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty1-1369023800168/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 109092 T437 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 109149 T437 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 109253 T437 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 109259 T437 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 109807 T437 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 109811 T437 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 109814 T437 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 109819 T437 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 109851 T437 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 109851 T437 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1369023800168/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1369023796084/jetty1/
[junit4:junit4] 2> 109852 T437 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5809fdee
[junit4:junit4] 2> 109852 T437 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 109853 T437 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369023796084/jetty1
[junit4:junit4] 2> 109853 T437 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1369023796084/jetty1/index/
[junit4:junit4] 2> 109854 T437 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1369023796084/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 109854 T437 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369023796084/jetty1/index
[junit4:junit4] 2> 109858 T437 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@674009d2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1f039b5b),segFN=segments_1,generation=1}
[junit4:junit4] 2> 109859 T437 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 109862 T437 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 109862 T437 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 109863 T437 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 109864 T437 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 109865 T437 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 109865 T437 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 109866 T437 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 109866 T437 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 109867 T437 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 109877 T437 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 109884 T437 oass.SolrIndexSearcher.<init> Opening Searcher@49427381 main
[junit4:junit4] 2> 109884 T437 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1369023796084/jetty1/tlog
[junit4:junit4] 2> 109885 T437 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 109886 T437 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 109892 T438 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@49427381 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 109895 T437 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 109895 T437 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 110521 T417 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 110522 T417 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52460_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52460"}
[junit4:junit4] 2> 110522 T417 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 110523 T417 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 110563 T423 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 110563 T416 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 110563 T436 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 110898 T437 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 110898 T437 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:52460 collection:collection1 shard:shard1
[junit4:junit4] 2> 110899 T437 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 110916 T437 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 110927 T437 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 110928 T437 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 110928 T437 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:52460/collection1/
[junit4:junit4] 2> 110928 T437 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 110929 T437 oasc.SyncStrategy.syncToMe http://127.0.0.1:52460/collection1/ has no replicas
[junit4:junit4] 2> 110929 T437 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:52460/collection1/
[junit4:junit4] 2> 110929 T437 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 112069 T417 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 112089 T436 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 112089 T416 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 112089 T423 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 112117 T437 oasc.ZkController.register We are http://127.0.0.1:52460/collection1/ and leader is http://127.0.0.1:52460/collection1/
[junit4:junit4] 2> 112117 T437 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:52460
[junit4:junit4] 2> 112117 T437 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 112118 T437 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 112118 T437 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 112120 T437 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 112121 T394 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0
[junit4:junit4] 2> 112122 T394 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 112123 T394 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 112395 T394 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 112398 T394 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:52465
[junit4:junit4] 2> 112399 T394 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 112400 T394 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 112400 T394 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1369023804734
[junit4:junit4] 2> 112401 T394 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1369023804734/solr.xml
[junit4:junit4] 2> 112401 T394 oasc.CoreContainer.<init> New CoreContainer 1988820325
[junit4:junit4] 2> 112402 T394 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1369023804734/'
[junit4:junit4] 2> 112402 T394 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1369023804734/'
[junit4:junit4] 2> 112511 T394 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 112512 T394 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 112513 T394 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 112513 T394 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 112514 T394 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 112515 T394 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 112515 T394 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 112516 T394 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 112516 T394 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 112517 T394 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 112533 T394 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 112534 T394 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52453/solr
[junit4:junit4] 2> 112534 T394 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 112535 T394 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 112539 T450 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@eb0b978 name:ZooKeeperConnection Watcher:127.0.0.1:52453 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 112539 T394 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 112542 T394 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 112557 T394 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 112560 T452 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7dd7b855 name:ZooKeeperConnection Watcher:127.0.0.1:52453/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 112560 T394 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 112566 T394 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 113570 T394 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52465_
[junit4:junit4] 2> 113573 T394 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52465_
[junit4:junit4] 2> 113576 T416 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 113576 T423 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 113577 T452 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 113577 T423 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 113577 T436 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 113578 T436 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 113578 T416 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 113590 T453 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1369023804734/collection1
[junit4:junit4] 2> 113590 T453 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 113591 T453 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 113591 T453 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 113593 T453 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1369023804734/collection1/'
[junit4:junit4] 2> 113594 T453 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty2-1369023804734/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 113595 T453 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty2-1369023804734/collection1/lib/README' to classloader
[junit4:junit4] 2> 113602 T417 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 113603 T417 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:52460__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52460_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52460"}
[junit4:junit4] 2> 113615 T436 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 113615 T416 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 113615 T423 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 113617 T452 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 113650 T453 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 113707 T453 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 113809 T453 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 113816 T453 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 114367 T453 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 114371 T453 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 114373 T453 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 114379 T453 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 114411 T453 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 114411 T453 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1369023804734/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1369023796084/jetty2/
[junit4:junit4] 2> 114412 T453 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5809fdee
[junit4:junit4] 2> 114412 T453 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 114413 T453 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369023796084/jetty2
[junit4:junit4] 2> 114413 T453 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1369023796084/jetty2/index/
[junit4:junit4] 2> 114414 T453 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1369023796084/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 114414 T453 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369023796084/jetty2/index
[junit4:junit4] 2> 114418 T453 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@65010ce3 lockFactory=org.apache.lucene.store.NativeFSLockFactory@752329fa),segFN=segments_1,generation=1}
[junit4:junit4] 2> 114419 T453 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 114422 T453 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 114422 T453 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 114423 T453 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 114424 T453 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 114425 T453 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 114425 T453 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 114426 T453 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 114426 T453 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 114427 T453 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 114436 T453 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 114444 T453 oass.SolrIndexSearcher.<init> Opening Searcher@29928b7c main
[junit4:junit4] 2> 114444 T453 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1369023796084/jetty2/tlog
[junit4:junit4] 2> 114445 T453 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 114446 T453 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 114451 T454 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@29928b7c main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 114454 T453 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 114455 T453 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 115126 T417 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 115127 T417 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52465_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52465"}
[junit4:junit4] 2> 115127 T417 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 115128 T417 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 115141 T436 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 115141 T423 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 115141 T416 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 115141 T452 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 115458 T453 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 115458 T453 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:52465 collection:collection1 shard:shard2
[junit4:junit4] 2> 115459 T453 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 115476 T453 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 115487 T453 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 115488 T453 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 115488 T453 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:52465/collection1/
[junit4:junit4] 2> 115488 T453 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 115488 T453 oasc.SyncStrategy.syncToMe http://127.0.0.1:52465/collection1/ has no replicas
[junit4:junit4] 2> 115489 T453 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:52465/collection1/
[junit4:junit4] 2> 115489 T453 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 116647 T417 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 116664 T436 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 116664 T416 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 116664 T452 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 116664 T423 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 116678 T453 oasc.ZkController.register We are http://127.0.0.1:52465/collection1/ and leader is http://127.0.0.1:52465/collection1/
[junit4:junit4] 2> 116678 T453 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:52465
[junit4:junit4] 2> 116678 T453 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 116679 T453 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 116679 T453 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 116681 T453 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 116682 T394 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0
[junit4:junit4] 2> 116683 T394 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 116684 T394 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 116952 T394 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 116955 T394 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:52469
[junit4:junit4] 2> 116956 T394 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 116956 T394 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 116957 T394 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1369023809295
[junit4:junit4] 2> 116958 T394 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1369023809295/solr.xml
[junit4:junit4] 2> 116958 T394 oasc.CoreContainer.<init> New CoreContainer 1072120762
[junit4:junit4] 2> 116959 T394 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1369023809295/'
[junit4:junit4] 2> 116959 T394 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1369023809295/'
[junit4:junit4] 2> 117067 T394 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 117068 T394 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 117069 T394 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 117069 T394 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 117070 T394 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 117070 T394 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 117071 T394 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 117071 T394 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 117072 T394 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 117073 T394 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 117090 T394 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 117091 T394 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52453/solr
[junit4:junit4] 2> 117092 T394 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 117093 T394 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 117096 T466 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@53f2c2a3 name:ZooKeeperConnection Watcher:127.0.0.1:52453 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 117096 T394 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 117099 T394 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 117112 T394 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 117114 T468 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@747c4004 name:ZooKeeperConnection Watcher:127.0.0.1:52453/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 117114 T394 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 117120 T394 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 118124 T394 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52469_
[junit4:junit4] 2> 118127 T394 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52469_
[junit4:junit4] 2> 118130 T416 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 118130 T468 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 118131 T423 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 118131 T436 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 118131 T452 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 118131 T436 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 118131 T423 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 118132 T452 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 118132 T416 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 118139 T469 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1369023809295/collection1
[junit4:junit4] 2> 118139 T469 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 118140 T469 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 118140 T469 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 118142 T469 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1369023809295/collection1/'
[junit4:junit4] 2> 118143 T469 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty3-1369023809295/collection1/lib/README' to classloader
[junit4:junit4] 2> 118144 T469 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty3-1369023809295/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 118178 T417 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 118179 T417 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:52465__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52465_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52465"}
[junit4:junit4] 2> 118185 T468 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 118185 T423 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 118185 T416 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 118185 T452 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 118185 T436 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 118195 T469 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 118255 T469 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 118357 T469 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 118364 T469 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 118917 T469 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 118921 T469 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 118924 T469 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 118929 T469 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 118963 T469 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 118964 T469 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1369023809295/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1369023796084/jetty3/
[junit4:junit4] 2> 118964 T469 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5809fdee
[junit4:junit4] 2> 118965 T469 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 118965 T469 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369023796084/jetty3
[junit4:junit4] 2> 118966 T469 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1369023796084/jetty3/index/
[junit4:junit4] 2> 118966 T469 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1369023796084/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 118967 T469 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369023796084/jetty3/index
[junit4:junit4] 2> 118971 T469 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1cd6758a lockFactory=org.apache.lucene.store.NativeFSLockFactory@643293ae),segFN=segments_1,generation=1}
[junit4:junit4] 2> 118971 T469 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 118974 T469 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 118975 T469 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 118976 T469 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 118976 T469 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 118977 T469 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 118978 T469 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 118978 T469 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 118979 T469 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 118980 T469 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 118989 T469 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 118997 T469 oass.SolrIndexSearcher.<init> Opening Searcher@1226ad0a main
[junit4:junit4] 2> 118997 T469 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1369023796084/jetty3/tlog
[junit4:junit4] 2> 118998 T469 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 118999 T469 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 119005 T470 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1226ad0a main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 119008 T469 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 119008 T469 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 119691 T417 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 119692 T417 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52469_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52469"}
[junit4:junit4] 2> 119692 T417 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 119693 T417 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 119734 T468 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 119734 T452 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 119734 T416 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 119734 T436 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 119734 T423 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 120015 T469 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 120015 T469 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:52469 collection:collection1 shard:shard1
[junit4:junit4] 2> 120019 T469 oasc.ZkController.register We are http://127.0.0.1:52469/collection1/ and leader is http://127.0.0.1:52460/collection1/
[junit4:junit4] 2> 120019 T469 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:52469
[junit4:junit4] 2> 120019 T469 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 120020 T469 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C25 name=collection1 org.apache.solr.core.SolrCore@2eced8c6 url=http://127.0.0.1:52469/collection1 node=127.0.0.1:52469_ C25_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:52469_, base_url=http://127.0.0.1:52469}
[junit4:junit4] 2> 120020 T471 C25 P52469 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 120020 T469 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 120021 T471 C25 P52469 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 120021 T471 C25 P52469 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 120022 T471 C25 P52469 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 120022 T394 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0
[junit4:junit4] 2> 120023 T394 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 120023 T394 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 120023 T471 C25 P52469 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 120041 T426 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:52469__collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 120218 T394 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 120220 T394 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:52473
[junit4:junit4] 2> 120220 T394 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 120221 T394 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 120221 T394 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1369023812633
[junit4:junit4] 2> 120222 T394 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1369023812633/solr.xml
[junit4:junit4] 2> 120222 T394 oasc.CoreContainer.<init> New CoreContainer 90706399
[junit4:junit4] 2> 120222 T394 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1369023812633/'
[junit4:junit4] 2> 120223 T394 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1369023812633/'
[junit4:junit4] 2> 120299 T394 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 120300 T394 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 120300 T394 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 120300 T394 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 120301 T394 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 120301 T394 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 120302 T394 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 120302 T394 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 120302 T394 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 120303 T394 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 120314 T394 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 120315 T394 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52453/solr
[junit4:junit4] 2> 120315 T394 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 120316 T394 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 120318 T483 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@c2567a6 name:ZooKeeperConnection Watcher:127.0.0.1:52453 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 120319 T394 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 120321 T394 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 120329 T394 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 120331 T485 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3324298d name:ZooKeeperConnection Watcher:127.0.0.1:52453/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 120331 T394 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 120339 T394 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 121240 T417 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 121241 T417 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:52469__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52469_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52469"}
[junit4:junit4] 2> 121255 T468 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 121255 T485 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 121255 T416 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 121255 T452 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 121255 T436 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 121255 T423 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 121344 T394 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52473_
[junit4:junit4] 2> 121346 T394 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52473_
[junit4:junit4] 2> 121349 T416 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 121349 T485 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 121349 T423 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 121349 T468 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 121350 T423 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 121350 T436 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 121349 T452 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 121351 T416 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 121351 T485 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 121351 T436 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 121350 T468 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 121351 T452 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 121363 T486 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1369023812633/collection1
[junit4:junit4] 2> 121363 T486 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 121364 T486 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 121364 T486 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 121366 T486 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1369023812633/collection1/'
[junit4:junit4] 2> 121368 T486 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty4-1369023812633/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 121368 T486 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty4-1369023812633/collection1/lib/README' to classloader
[junit4:junit4] 2> 121423 T486 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 121492 T486 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 121594 T486 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 121600 T486 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 122044 T426 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:52469__collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 122044 T426 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:52469__collection1&state=recovering&nodeName=127.0.0.1:52469_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2003
[junit4:junit4] 2> 122124 T486 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 122127 T486 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 122129 T486 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 122133 T486 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 122159 T486 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 122159 T486 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1369023812633/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1369023796084/jetty4/
[junit4:junit4] 2> 122159 T486 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5809fdee
[junit4:junit4] 2> 122160 T486 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 122160 T486 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369023796084/jetty4
[junit4:junit4] 2> 122161 T486 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1369023796084/jetty4/index/
[junit4:junit4] 2> 122161 T486 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1369023796084/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 122161 T486 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369023796084/jetty4/index
[junit4:junit4] 2> 122164 T486 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@18feb66a lockFactory=org.apache.lucene.store.NativeFSLockFactory@b20be93),segFN=segments_1,generation=1}
[junit4:junit4] 2> 122164 T486 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 122166 T486 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 122167 T486 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 122167 T486 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 122168 T486 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 122168 T486 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 122169 T486 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 122169 T486 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 122170 T486 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 122170 T486 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 122176 T486 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 122181 T486 oass.SolrIndexSearcher.<init> Opening Searcher@65c44935 main
[junit4:junit4] 2> 122181 T486 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1369023796084/jetty4/tlog
[junit4:junit4] 2> 122182 T486 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 122182 T486 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 122187 T487 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@65c44935 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 122189 T486 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 122189 T486 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 122761 T417 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 122762 T417 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52473_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52473"}
[junit4:junit4] 2> 122762 T417 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 122762 T417 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 122776 T423 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 122776 T416 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 122776 T485 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 122776 T468 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 122776 T452 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 122776 T436 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 123192 T486 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 123192 T486 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:52473 collection:collection1 shard:shard2
[junit4:junit4] 2> 123196 T486 oasc.ZkController.register We are http://127.0.0.1:52473/collection1/ and leader is http://127.0.0.1:52465/collection1/
[junit4:junit4] 2> 123196 T486 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:52473
[junit4:junit4] 2> 123197 T486 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 123197 T486 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C26 name=collection1 org.apache.solr.core.SolrCore@7dac14dd url=http://127.0.0.1:52473/collection1 node=127.0.0.1:52473_ C26_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:52473_, base_url=http://127.0.0.1:52473}
[junit4:junit4] 2> 123197 T488 C26 P52473 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 123198 T486 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 123198 T488 C26 P52473 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 123199 T488 C26 P52473 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 123199 T488 C26 P52473 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 123199 T394 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0
[junit4:junit4] 2> 123200 T394 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 123200 T488 C26 P52473 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 123201 T394 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 123220 T394 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 123221 T442 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:52473__collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 123222 T394 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 2> 123222 T394 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 2> 123223 T394 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C25_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:52469_, base_url=http://127.0.0.1:52469}
[junit4:junit4] 2> 124046 T471 C25 P52469 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:52460/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 124046 T471 C25 P52469 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:52469 START replicas=[http://127.0.0.1:52460/collection1/] nUpdates=100
[junit4:junit4] 2> 124047 T471 C25 P52469 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 124048 T471 C25 P52469 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 124048 T471 C25 P52469 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 124048 T471 C25 P52469 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 124048 T471 C25 P52469 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 124049 T471 C25 P52469 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:52460/collection1/. core=collection1
[junit4:junit4] 2> 124049 T471 C25 P52469 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C27 name=collection1 org.apache.solr.core.SolrCore@31651361 url=http://127.0.0.1:52460/collection1 node=127.0.0.1:52460_ C27_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:52460_, base_url=http://127.0.0.1:52460, leader=true}
[junit4:junit4] 2> 124057 T427 C27 P52460 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 124064 T428 C27 P52460 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 124067 T428 C27 P52460 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@674009d2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1f039b5b),segFN=segments_1,generation=1}
[junit4:junit4] 2> 124068 T428 C27 P52460 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 124069 T428 C27 P52460 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@674009d2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1f039b5b),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@674009d2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1f039b5b),segFN=segments_2,generation=2}
[junit4:junit4] 2> 124069 T428 C27 P52460 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 124070 T428 C27 P52460 oass.SolrIndexSearcher.<init> Opening Searcher@671bbdbb realtime
[junit4:junit4] 2> 124070 T428 C27 P52460 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 124071 T428 C27 P52460 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 124072 T471 C25 P52469 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 124072 T471 C25 P52469 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 124075 T429 C27 P52460 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 124075 T429 C27 P52460 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 124076 T471 C25 P52469 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 124077 T471 C25 P52469 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 124077 T471 C25 P52469 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 124080 T429 C27 P52460 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=1
[junit4:junit4] 2> 124081 T471 C25 P52469 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 124082 T471 C25 P52469 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369023796084/jetty3/index.20130520072336676
[junit4:junit4] 2> 124082 T471 C25 P52469 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@ed03465 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5114ae94) fullCopy=false
[junit4:junit4] 2> 124085 T429 C27 P52460 oasc.SolrCore.execute [collection1] webapp= path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 124087 T471 C25 P52469 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 124088 T471 C25 P52469 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 124088 T471 C25 P52469 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 124091 T471 C25 P52469 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1cd6758a lockFactory=org.apache.lucene.store.NativeFSLockFactory@643293ae),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1cd6758a lockFactory=org.apache.lucene.store.NativeFSLockFactory@643293ae),segFN=segments_2,generation=2}
[junit4:junit4] 2> 124091 T471 C25 P52469 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 124092 T471 C25 P52469 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 124092 T471 C25 P52469 oass.SolrIndexSearcher.<init> Opening Searcher@6caa5123 main
[junit4:junit4] 2> 124094 T470 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6caa5123 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 124094 T471 C25 P52469 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1369023796084/jetty3/index.20130520072336676 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1369023796084/jetty3/index.20130520072336676;done=true>>]
[junit4:junit4] 2> 124095 T471 C25 P52469 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1369023796084/jetty3/index.20130520072336676
[junit4:junit4] 2> 124095 T471 C25 P52469 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ShardSplitTest-1369023796084/jetty3/index.20130520072336676
[junit4:junit4] 2> 124095 T471 C25 P52469 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 124096 T471 C25 P52469 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 124096 T471 C25 P52469 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 124096 T471 C25 P52469 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 124100 T471 C25 P52469 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 124225 T394 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 124282 T417 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 124283 T417 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:52473__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52473_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52473"}
[junit4:junit4] 2> 124287 T417 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:52469__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52469_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52469"}
[junit4:junit4] 2> 124304 T436 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 124304 T485 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 124304 T416 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 124304 T452 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 124304 T468 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 124304 T423 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 125224 T442 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:52473__collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 125224 T442 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:52473__collection1&state=recovering&nodeName=127.0.0.1:52473_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2003
[junit4:junit4] 2> 125227 T394 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 126230 T394 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C26_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:52473_, base_url=http://127.0.0.1:52473}
[junit4:junit4] 2> 127226 T488 C26 P52473 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:52465/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 127226 T488 C26 P52473 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:52473 START replicas=[http://127.0.0.1:52465/collection1/] nUpdates=100
[junit4:junit4] 2> 127227 T488 C26 P52473 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 127227 T488 C26 P52473 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 127227 T488 C26 P52473 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 127228 T488 C26 P52473 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 127228 T488 C26 P52473 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 127228 T488 C26 P52473 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:52465/collection1/. core=collection1
[junit4:junit4] 2> 127229 T488 C26 P52473 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 127233 T394 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> ASYNC NEW_CORE C28 name=collection1 org.apache.solr.core.SolrCore@599ab0d6 url=http://127.0.0.1:52465/collection1 node=127.0.0.1:52465_ C28_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:52465_, base_url=http://127.0.0.1:52465, leader=true}
[junit4:junit4] 2> 127237 T443 C28 P52465 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 127245 T444 C28 P52465 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 127248 T444 C28 P52465 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@65010ce3 lockFactory=org.apache.lucene.store.NativeFSLockFactory@752329fa),segFN=segments_1,generation=1}
[junit4:junit4] 2> 127249 T444 C28 P52465 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 127250 T444 C28 P52465 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@65010ce3 lockFactory=org.apache.lucene.store.NativeFSLockFactory@752329fa),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@65010ce3 lockFactory=org.apache.lucene.store.NativeFSLockFactory@752329fa),segFN=segments_2,generation=2}
[junit4:junit4] 2> 127250 T444 C28 P52465 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 127251 T444 C28 P52465 oass.SolrIndexSearcher.<init> Opening Searcher@5f96c1d2 realtime
[junit4:junit4] 2> 127251 T444 C28 P52465 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 127252 T444 C28 P52465 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 127253 T488 C26 P52473 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 127253 T488 C26 P52473 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 127256 T445 C28 P52465 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 127256 T445 C28 P52465 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 127257 T488 C26 P52473 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 127258 T488 C26 P52473 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 127258 T488 C26 P52473 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 127261 T445 C28 P52465 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=1
[junit4:junit4] 2> 127262 T488 C26 P52473 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 127263 T488 C26 P52473 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369023796084/jetty4/index.20130520072339857
[junit4:junit4] 2> 127263 T488 C26 P52473 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@434c5ac0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6acbc2da) fullCopy=false
[junit4:junit4] 2> 127267 T445 C28 P52465 oasc.SolrCore.execute [collection1] webapp= path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=1
[junit4:junit4] 2> 127268 T488 C26 P52473 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 127269 T488 C26 P52473 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 127269 T488 C26 P52473 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 127271 T488 C26 P52473 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@18feb66a lockFactory=org.apache.lucene.store.NativeFSLockFactory@b20be93),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@18feb66a lockFactory=org.apache.lucene.store.NativeFSLockFactory@b20be93),segFN=segments_2,generation=2}
[junit4:junit4] 2> 127272 T488 C26 P52473 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 127272 T488 C26 P52473 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 127273 T488 C26 P52473 oass.SolrIndexSearcher.<init> Opening Searcher@30a16748 main
[junit4:junit4] 2> 127274 T487 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@30a16748 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 127275 T488 C26 P52473 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1369023796084/jetty4/index.20130520072339857 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1369023796084/jetty4/index.20130520072339857;done=true>>]
[junit4:junit4] 2> 127275 T488 C26 P52473 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1369023796084/jetty4/index.20130520072339857
[junit4:junit4] 2> 127276 T488 C26 P52473 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ShardSplitTest-1369023796084/jetty4/index.20130520072339857
[junit4:junit4] 2> 127276 T488 C26 P52473 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 127276 T488 C26 P52473 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 127276 T488 C26 P52473 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 127277 T488 C26 P52473 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 127279 T488 C26 P52473 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 127320 T417 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 127321 T417 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:52473__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52473_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52473"}
[junit4:junit4] 2> 127334 T436 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 127334 T485 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 127334 T416 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 127334 T452 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 127334 T468 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 127334 T423 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 128236 T394 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 128238 T394 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> ASYNC NEW_CORE C29 name=collection1 org.apache.solr.core.SolrCore@4a41e2a3 url=http://127.0.0.1:52456/collection1 node=127.0.0.1:52456_ C29_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:52456_, base_url=http://127.0.0.1:52456, leader=true}
[junit4:junit4] 2> 128247 T406 C29 P52456 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 128250 T406 C29 P52456 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@528c40ee lockFactory=org.apache.lucene.store.NativeFSLockFactory@1d04966e),segFN=segments_1,generation=1}
[junit4:junit4] 2> 128251 T406 C29 P52456 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 128252 T406 C29 P52456 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@528c40ee lockFactory=org.apache.lucene.store.NativeFSLockFactory@1d04966e),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@528c40ee lockFactory=org.apache.lucene.store.NativeFSLockFactory@1d04966e),segFN=segments_2,generation=2}
[junit4:junit4] 2> 128252 T406 C29 P52456 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 128253 T406 C29 P52456 oass.SolrIndexSearcher.<init> Opening Searcher@505e9087 main
[junit4:junit4] 2> 128254 T406 C29 P52456 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 128255 T420 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@505e9087 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 128255 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 8
[junit4:junit4] 2> 128270 T446 C28 P52465 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 128271 T446 C28 P52465 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@65010ce3 lockFactory=org.apache.lucene.store.NativeFSLockFactory@752329fa),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@65010ce3 lockFactory=org.apache.lucene.store.NativeFSLockFactory@752329fa),segFN=segments_3,generation=3}
[junit4:junit4] 2> 128272 T446 C28 P52465 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 128272 T446 C28 P52465 oass.SolrIndexSearcher.<init> Opening Searcher@3f625b8c main
[junit4:junit4] 2> 128273 T446 C28 P52465 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 128274 T454 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3f625b8c main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 128291 T446 C28 P52465 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:52460/collection1/, StdNode: http://127.0.0.1:52469/collection1/, StdNode: http://127.0.0.1:52473/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 128300 T430 C27 P52460 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 128301 T430 C27 P52460 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@674009d2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1f039b5b),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@674009d2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1f039b5b),segFN=segments_3,generation=3}
[junit4:junit4] 2> 128302 T430 C27 P52460 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 128303 T430 C27 P52460 oass.SolrIndexSearcher.<init> Opening Searcher@20c78046 main
[junit4:junit4] 2> 128303 T430 C27 P52460 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 128304 T438 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@20c78046 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 128305 T430 C27 P52460 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 5
[junit4:junit4] 2> C25_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:52469_, base_url=http://127.0.0.1:52469}
[junit4:junit4] 2> 128308 T458 C25 P52469 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> C26_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:52473_, base_url=http://127.0.0.1:52473}
[junit4:junit4] 2> 128308 T475 C26 P52473 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 128309 T458 C25 P52469 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1cd6758a lockFactory=org.apache.lucene.store.NativeFSLockFactory@643293ae),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1cd6758a lockFactory=org.apache.lucene.store.NativeFSLockFactory@643293ae),segFN=segments_3,generation=3}
[junit4:junit4] 2> 128310 T475 C26 P52473 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@18feb66a lockFactory=org.apache.lucene.store.NativeFSLockFactory@b20be93),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@18feb66a lockFactory=org.apache.lucene.store.NativeFSLockFactory@b20be93),segFN=segments_3,generation=3}
[junit4:junit4] 2> 128310 T458 C25 P52469 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 128311 T475 C26 P52473 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 128311 T458 C25 P52469 oass.SolrIndexSearcher.<init> Opening Searcher@70ec0faf main
[junit4:junit4] 2> 128312 T475 C26 P52473 oass.SolrIndexSearcher.<init> Opening Searcher@64ecea5e main
[junit4:junit4] 2> 128312 T458 C25 P52469 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 128313 T475 C26 P52473 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 128313 T470 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@70ec0faf main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 128314 T487 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@64ecea5e main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 128314 T458 C25 P52469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> 128315 T475 C26 P52473 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 128316 T446 C28 P52465 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 46
[junit4:junit4] 2> 128317 T394 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 128321 T431 C27 P52460 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 128324 T459 C25 P52469 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 128327 T447 C28 P52465 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 128330 T476 C26 P52473 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 130399 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1435525524158939136)} 0 64
[junit4:junit4] 2> 130416 T475 C26 P52473 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=FROMLEADER&_version_=-1435525524223950848&update.from=http://127.0.0.1:52465/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1435525524223950848)} 0 2
[junit4:junit4] 2> 130423 T460 C25 P52469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=FROMLEADER&_version_=-1435525524235485184&update.from=http://127.0.0.1:52460/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1435525524235485184)} 0 1
[junit4:junit4] 2> 130424 T430 C27 P52460 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=TOLEADER&wt=javabin&version=2} {deleteByQuery=*:* (-1435525524235485184)} 0 11
[junit4:junit4] 2> 130425 T446 C28 P52465 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1435525524223950848)} 0 23
[junit4:junit4] 2> 130436 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!0 (1435525524257505280)]} 0 8
[junit4:junit4] 2> 130463 T475 C26 P52473 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52465/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!0 (1435525524281622528)]} 0 1
[junit4:junit4] 2> 130464 T448 C28 P52465 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52460/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[a!0 (1435525524281622528)]} 0 6
[junit4:junit4] 2> 130465 T432 C27 P52460 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!0]} 0 27
[junit4:junit4] 2> 130470 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!1 (1435525524294205440)]} 0 1
[junit4:junit4] 2> 130478 T460 C25 P52469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52460/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!1 (1435525524297351168)]} 0 1
[junit4:junit4] 2> 130479 T432 C27 P52460 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!1 (1435525524297351168)]} 0 6
[junit4:junit4] 2> 130483 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!2 (1435525524307836928)]} 0 1
[junit4:junit4] 2> 130490 T460 C25 P52469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52460/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!2 (1435525524312031232)]} 0 1
[junit4:junit4] 2> 130491 T432 C27 P52460 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!2 (1435525524312031232)]} 0 5
[junit4:junit4] 2> 130495 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!3 (1435525524320419840)]} 0 1
[junit4:junit4] 2> 130502 T475 C26 P52473 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52465/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!3 (1435525524323565568)]} 0 1
[junit4:junit4] 2> 130503 T446 C28 P52465 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!3 (1435525524323565568)]} 0 5
[junit4:junit4] 2> 130507 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!4 (1435525524331954176)]} 0 1
[junit4:junit4] 2> 130514 T475 C26 P52473 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52465/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!4 (1435525524336148480)]} 0 1
[junit4:junit4] 2> 130515 T446 C28 P52465 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!4 (1435525524336148480)]} 0 5
[junit4:junit4] 2> 130519 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!5 (1435525524344537088)]} 0 1
[junit4:junit4] 2> 130526 T475 C26 P52473 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52465/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!5 (1435525524348731392)]} 0 1
[junit4:junit4] 2> 130527 T446 C28 P52465 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!5 (1435525524348731392)]} 0 5
[junit4:junit4] 2> 130531 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!6 (1435525524357120000)]} 0 1
[junit4:junit4] 2> 130541 T460 C25 P52469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52460/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!6 (1435525524365508608)]} 0 1
[junit4:junit4] 2> 130542 T430 C27 P52460 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52465/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[g!6 (1435525524365508608)]} 0 5
[junit4:junit4] 2> 130543 T446 C28 P52465 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!6]} 0 9
[junit4:junit4] 2> 130547 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!7 (1435525524373897216)]} 0 1
[junit4:junit4] 2> 130554 T460 C25 P52469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52460/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!7 (1435525524378091520)]} 0 1
[junit4:junit4] 2> 130555 T432 C27 P52460 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!7 (1435525524378091520)]} 0 5
[junit4:junit4] 2> 130559 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!8 (1435525524386480128)]} 0 1
[junit4:junit4] 2> 130566 T460 C25 P52469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52460/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!8 (1435525524390674432)]} 0 1
[junit4:junit4] 2> 130567 T432 C27 P52460 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!8 (1435525524390674432)]} 0 5
[junit4:junit4] 2> 130571 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!9 (1435525524399063040)]} 0 1
[junit4:junit4] 2> 130578 T460 C25 P52469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52460/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!9 (1435525524403257344)]} 0 1
[junit4:junit4] 2> 130579 T432 C27 P52460 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!9 (1435525524403257344)]} 0 5
[junit4:junit4] 2> 130583 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!10 (1435525524411645952)]} 0 1
[junit4:junit4] 2> 130593 T460 C25 P52469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52460/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[k!10 (1435525524420034560)]} 0 1
[junit4:junit4] 2> 130597 T430 C27 P52460 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52465/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[k!10 (1435525524420034560)]} 0 8
[junit4:junit4] 2> 130598 T446 C28 P52465 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!10]} 0 12
[junit4:junit4] 2> 130603 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!11 (1435525524433666048)]} 0 1
[junit4:junit4] 2> 130613 T475 C26 P52473 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52465/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[l!11 (1435525524441006080)]} 0 1
[junit4:junit4] 2> 130614 T448 C28 P52465 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52460/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[l!11 (1435525524441006080)]} 0 5
[junit4:junit4] 2> 130615 T432 C27 P52460 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!11]} 0 9
[junit4:junit4] 2> 130619 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!12 (1435525524449394688)]} 0 1
[junit4:junit4] 2> 130626 T475 C26 P52473 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52465/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[m!12 (1435525524454637568)]} 0 1
[junit4:junit4] 2> 130627 T446 C28 P52465 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!12 (1435525524454637568)]} 0 5
[junit4:junit4] 2> 130631 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!13 (1435525524461977600)]} 0 1
[junit4:junit4] 2> 130641 T460 C25 P52469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52460/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[n!13 (1435525524470366208)]} 0 1
[junit4:junit4] 2> 130642 T430 C27 P52460 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52465/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[n!13 (1435525524470366208)]} 0 5
[junit4:junit4] 2> 130643 T446 C28 P52465 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!13]} 0 9
[junit4:junit4] 2> 130647 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!14 (1435525524478754816)]} 0 1
[junit4:junit4] 2> 130654 T475 C26 P52473 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52465/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[o!14 (1435525524482949120)]} 0 1
[junit4:junit4] 2> 130655 T446 C28 P52465 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!14 (1435525524482949120)]} 0 5
[junit4:junit4] 2> 130659 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!15 (1435525524491337728)]} 0 1
[junit4:junit4] 2> 130669 T460 C25 P52469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52460/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[p!15 (1435525524499726336)]} 0 1
[junit4:junit4] 2> 130670 T430 C27 P52460 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52465/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[p!15 (1435525524499726336)]} 0 5
[junit4:junit4] 2> 130671 T446 C28 P52465 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!15]} 0 9
[junit4:junit4] 2> 130675 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!16 (1435525524508114944)]} 0 1
[junit4:junit4] 2> 130682 T460 C25 P52469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52460/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[q!16 (1435525524513357824)]} 0 1
[junit4:junit4] 2> 130683 T432 C27 P52460 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!16 (1435525524513357824)]} 0 5
[junit4:junit4] 2> 130687 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!17 (1435525524520697856)]} 0 1
[junit4:junit4] 2> 130694 T475 C26 P52473 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52465/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[r!17 (1435525524524892160)]} 0 1
[junit4:junit4] 2> 130695 T446 C28 P52465 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!17 (1435525524524892160)]} 0 5
[junit4:junit4] 2> 130699 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!18 (1435525524533280768)]} 0 1
[junit4:junit4] 2> 130709 T460 C25 P52469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52460/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[s!18 (1435525524541669376)]} 0 1
[junit4:junit4] 2> 130710 T430 C27 P52460 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52465/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[s!18 (1435525524541669376)]} 0 5
[junit4:junit4] 2> 130711 T446 C28 P52465 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!18]} 0 9
[junit4:junit4] 2> 130715 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!19 (1435525524550057984)]} 0 1
[junit4:junit4] 2> 130722 T460 C25 P52469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52460/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[t!19 (1435525524554252288)]} 0 1
[junit4:junit4] 2> 130723 T432 C27 P52460 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!19 (1435525524554252288)]} 0 5
[junit4:junit4] 2> 130727 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!20 (1435525524562640896)]} 0 1
[junit4:junit4] 2> 130737 T475 C26 P52473 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52465/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[u!20 (1435525524571029504)]} 0 1
[junit4:junit4] 2> 130738 T448 C28 P52465 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52460/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[u!20 (1435525524571029504)]} 0 5
[junit4:junit4] 2> 130739 T432 C27 P52460 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!20]} 0 9
[junit4:junit4] 2> 130742 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[v!21 (1435525524578369536)]} 0 1
[junit4:junit4] 2> 130749 T460 C25 P52469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52460/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[v!21 (1435525524583612416)]} 0 1
[junit4:junit4] 2> 130750 T432 C27 P52460 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[v!21 (1435525524583612416)]} 0 5
[junit4:junit4] 2> 130754 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[w!22 (1435525524590952448)]} 0 1
[junit4:junit4] 2> 130764 T460 C25 P52469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52460/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[w!22 (1435525524599341056)]} 0 1
[junit4:junit4] 2> 130765 T430 C27 P52460 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52465/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[w!22 (1435525524599341056)]} 0 5
[junit4:junit4] 2> 130766 T446 C28 P52465 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[w!22]} 0 9
[junit4:junit4] 2> 130770 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[x!23 (1435525524607729664)]} 0 1
[junit4:junit4] 2> 130777 T475 C26 P52473 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52465/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[x!23 (1435525524612972544)]} 0 1
[junit4:junit4] 2> 130778 T446 C28 P52465 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[x!23 (1435525524612972544)]} 0 5
[junit4:junit4] 2> 130782 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[y!24 (1435525524620312576)]} 0 1
[junit4:junit4] 2> 130793 T475 C26 P52473 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52465/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[y!24 (1435525524628701184)]} 0 1
[junit4:junit4] 2> 130794 T448 C28 P52465 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52460/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[y!24 (1435525524628701184)]} 0 5
[junit4:junit4] 2> 130795 T432 C27 P52460 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[y!24]} 0 10
[junit4:junit4] 2> 130799 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[z!25 (1435525524639186944)]} 0 1
[junit4:junit4] 2> 130806 T460 C25 P52469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52460/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[z!25 (1435525524642332672)]} 0 1
[junit4:junit4] 2> 130807 T432 C27 P52460 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[z!25 (1435525524642332672)]} 0 5
[junit4:junit4] 2> 130811 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!26 (1435525524650721280)]} 0 1
[junit4:junit4] 2> 130818 T475 C26 P52473 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52465/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!26 (1435525524654915584)]} 0 1
[junit4:junit4] 2> 130819 T446 C28 P52465 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!26 (1435525524654915584)]} 0 5
[junit4:junit4] 2> 130823 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!27 (1435525524663304192)]} 0 1
[junit4:junit4] 2> 130830 T460 C25 P52469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52460/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!27 (1435525524667498496)]} 0 1
[junit4:junit4] 2> 130831 T432 C27 P52460 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!27 (1435525524667498496)]} 0 5
[junit4:junit4] 2> 130835 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!28 (1435525524675887104)]} 0 1
[junit4:junit4] 2> 130845 T460 C25 P52469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52460/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!28 (1435525524684275712)]} 0 1
[junit4:junit4] 2> 130846 T430 C27 P52460 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52465/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[c!28 (1435525524684275712)]} 0 5
[junit4:junit4] 2> 130847 T446 C28 P52465 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!28]} 0 9
[junit4:junit4] 2> 130851 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!29 (1435525524692664320)]} 0 1
[junit4:junit4] 2> 130861 T475 C26 P52473 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52465/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!29 (1435525524700004352)]} 0 1
[junit4:junit4] 2> 130862 T448 C28 P52465 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52460/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[d!29 (1435525524700004352)]} 0 5
[junit4:junit4] 2> 130863 T432 C27 P52460 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!29]} 0 9
[junit4:junit4] 2> 130866 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!30 (1435525524708392960)]} 0 1
[junit4:junit4] 2> 130876 T475 C26 P52473 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52465/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!30 (1435525524715732992)]} 0 1
[junit4:junit4] 2> 130877 T448 C28 P52465 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52460/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[e!30 (1435525524715732992)]} 0 5
[junit4:junit4] 2> 130878 T432 C27 P52460 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!30]} 0 9
[junit4:junit4] 2> 130881 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!31 (1435525524724121600)]} 0 1
[junit4:junit4] 2> 130888 T475 C26 P52473 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52465/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!31 (1435525524728315904)]} 0 1
[junit4:junit4] 2> 130889 T446 C28 P52465 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!31 (1435525524728315904)]} 0 5
[junit4:junit4] 2> 130893 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!32 (1435525524736704512)]} 0 1
[junit4:junit4] 2> 130900 T460 C25 P52469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52460/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!32 (1435525524740898816)]} 0 1
[junit4:junit4] 2> 130901 T432 C27 P52460 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!32 (1435525524740898816)]} 0 5
[junit4:junit4] 2> 130905 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!33 (1435525524749287424)]} 0 1
[junit4:junit4] 2> 130915 T460 C25 P52469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52460/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!33 (1435525524756627456)]} 0 1
[junit4:junit4] 2> 130916 T430 C27 P52460 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52465/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[h!33 (1435525524756627456)]} 0 5
[junit4:junit4] 2> 130917 T446 C28 P52465 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!33]} 0 9
[junit4:junit4] 2> 130921 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!34 (1435525524766064640)]} 0 1
[junit4:junit4] 2> 130928 T460 C25 P52469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52460/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!34 (1435525524770258944)]} 0 1
[junit4:junit4] 2> 130929 T432 C27 P52460 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!34 (1435525524770258944)]} 0 5
[junit4:junit4] 2> 130933 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!35 (1435525524778647552)]} 0 1
[junit4:junit4] 2> 130943 T460 C25 P52469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52460/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!35 (1435525524785987584)]} 0 1
[junit4:junit4] 2> 130944 T430 C27 P52460 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52465/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[j!35 (1435525524785987584)]} 0 5
[junit4:junit4] 2> 130944 T446 C28 P52465 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!35]} 0 8
[junit4:junit4] 2> 130948 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!36 (1435525524794376192)]} 0 1
[junit4:junit4] 2> 130955 T460 C25 P52469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52460/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[k!36 (1435525524798570496)]} 0 1
[junit4:junit4] 2> 130956 T432 C27 P52460 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!36 (1435525524798570496)]} 0 5
[junit4:junit4] 2> 130960 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!37 (1435525524806959104)]} 0 1
[junit4:junit4] 2> 130967 T475 C26 P52473 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52465/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[l!37 (1435525524811153408)]} 0 1
[junit4:junit4] 2> 130968 T446 C28 P52465 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!37 (1435525524811153408)]} 0 5
[junit4:junit4] 2> 130972 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!38 (1435525524819542016)]} 0 1
[junit4:junit4] 2> 130979 T475 C26 P52473 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52465/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[m!38 (1435525524823736320)]} 0 1
[junit4:junit4] 2> 130980 T446 C28 P52465 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!38 (1435525524823736320)]} 0 5
[junit4:junit4] 2> 130984 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!39 (1435525524832124928)]} 0 1
[junit4:junit4] 2> 130991 T460 C25 P52469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52460/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[n!39 (1435525524836319232)]} 0 1
[junit4:junit4] 2> 130992 T432 C27 P52460 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!39 (1435525524836319232)]} 0 5
[junit4:junit4] 2> 130996 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!40 (1435525524844707840)]} 0 1
[junit4:junit4] 2> 131006 T475 C26 P52473 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52465/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[o!40 (1435525524852047872)]} 0 1
[junit4:junit4] 2> 131007 T448 C28 P52465 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52460/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[o!40 (1435525524852047872)]} 0 5
[junit4:junit4] 2> 131007 T432 C27 P52460 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!40]} 0 8
[junit4:junit4] 2> 131011 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!41 (1435525524860436480)]} 0 1
[junit4:junit4] 2> 131021 T460 C25 P52469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52460/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[p!41 (1435525524867776512)]} 0 1
[junit4:junit4] 2> 131022 T430 C27 P52460 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52465/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[p!41 (1435525524867776512)]} 0 5
[junit4:junit4] 2> 131022 T446 C28 P52465 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!41]} 0 8
[junit4:junit4] 2> 131026 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!42 (1435525524876165120)]} 0 1
[junit4:junit4] 2> 131033 T460 C25 P52469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52460/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[q!42 (1435525524880359424)]} 0 1
[junit4:junit4] 2> 131034 T432 C27 P52460 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!42 (1435525524880359424)]} 0 5
[junit4:junit4] 2> 131037 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!43 (1435525524887699456)]} 0 1
[junit4:junit4] 2> 131044 T475 C26 P52473 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52465/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[r!43 (1435525524891893760)]} 0 1
[junit4:junit4] 2> 131045 T446 C28 P52465 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!43 (1435525524891893760)]} 0 5
[junit4:junit4] 2> 131048 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!44 (1435525524899233792)]} 0 1
[junit4:junit4] 2> 131058 T460 C25 P52469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52460/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[s!44 (1435525524906573824)]} 0 1
[junit4:junit4] 2> 131059 T430 C27 P52460 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52465/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[s!44 (1435525524906573824)]} 0 5
[junit4:junit4] 2> 131060 T446 C28 P52465 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!44]} 0 8
[junit4:junit4] 2> 131063 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!45 (1435525524914962432)]} 0 1
[junit4:junit4] 2> 131073 T460 C25 P52469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52460/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[t!45 (1435525524922302464)]} 0 1
[junit4:junit4] 2> 131074 T430 C27 P52460 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52465/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[t!45 (1435525524922302464)]} 0 5
[junit4:junit4] 2> 131075 T446 C28 P52465 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!45]} 0 9
[junit4:junit4] 2> 131078 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!46 (1435525524930691072)]} 0 1
[junit4:junit4] 2> 131088 T475 C26 P52473 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52465/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[u!46 (1435525524938031104)]} 0 1
[junit4:junit4] 2> 131089 T448 C28 P52465 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52460/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[u!46 (1435525524938031104)]} 0 5
[junit4:junit4] 2> 131089 T432 C27 P52460 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!46]} 0 8
[junit4:junit4] 2> 131093 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[v!47 (1435525524946419712)]} 0 1
[junit4:junit4] 2> 131103 T460 C25 P52469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52460/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[v!47 (1435525524953759744)]} 0 1
[junit4:junit4] 2> 131104 T430 C27 P52460 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52465/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[v!47 (1435525524953759744)]} 0 5
[junit4:junit4] 2> 131104 T446 C28 P52465 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[v!47]} 0 8
[junit4:junit4] 2> 131108 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[w!48 (1435525524962148352)]} 0 1
[junit4:junit4] 2> 131115 T460 C25 P52469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52460/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[w!48 (1435525524966342656)]} 0 1
[junit4:junit4] 2> 131116 T432 C27 P52460 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[w!48 (1435525524966342656)]} 0 5
[junit4:junit4] 2> 131120 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[x!49 (1435525524974731264)]} 0 1
[junit4:junit4] 2> 131130 T475 C26 P52473 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52465/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[x!49 (1435525524982071296)]} 0 1
[junit4:junit4] 2> 131131 T448 C28 P52465 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52460/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[x!49 (1435525524982071296)]} 0 5
[junit4:junit4] 2> 131131 T432 C27 P52460 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[x!49]} 0 8
[junit4:junit4] 2> 131135 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[y!50 (1435525524990459904)]} 0 1
[junit4:junit4] 2> 131145 T475 C26 P52473 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52465/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[y!50 (1435525524997799936)]} 0 1
[junit4:junit4] 2> 131146 T448 C28 P52465 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52460/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[y!50 (1435525524997799936)]} 0 5
[junit4:junit4] 2> 131147 T432 C27 P52460 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[y!50]} 0 9
[junit4:junit4] 2> 131151 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[z!51 (1435525525007237120)]} 0 1
[junit4:junit4] 2> 131158 T460 C25 P52469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52460/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[z!51 (1435525525011431424)]} 0 1
[junit4:junit4] 2> 131159 T432 C27 P52460 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[z!51 (1435525525011431424)]} 0 5
[junit4:junit4] 2> 131163 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!52 (1435525525019820032)]} 0 1
[junit4:junit4] 2> 131173 T475 C26 P52473 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52465/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!52 (1435525525028208640)]} 0 1
[junit4:junit4] 2> 131174 T448 C28 P52465 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52460/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[a!52 (1435525525028208640)]} 0 5
[junit4:junit4] 2> 131175 T432 C27 P52460 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!52]} 0 9
[junit4:junit4] 2> 131179 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!53 (1435525525036597248)]} 0 1
[junit4:junit4] 2> 131186 T460 C25 P52469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52460/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!53 (1435525525040791552)]} 0 1
[junit4:junit4] 2> 131187 T432 C27 P52460 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!53 (1435525525040791552)]} 0 5
[junit4:junit4] 2> 131191 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!54 (1435525525049180160)]} 0 1
[junit4:junit4] 2> 131201 T460 C25 P52469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52460/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!54 (1435525525056520192)]} 0 1
[junit4:junit4] 2> 131202 T430 C27 P52460 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52465/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[c!54 (1435525525056520192)]} 0 5
[junit4:junit4] 2> 131202 T446 C28 P52465 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!54]} 0 8
[junit4:junit4] 2> 131206 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!55 (1435525525064908800)]} 0 1
[junit4:junit4] 2> 131213 T475 C26 P52473 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52465/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!55 (1435525525069103104)]} 0 1
[junit4:junit4] 2> 131214 T446 C28 P52465 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!55 (1435525525069103104)]} 0 5
[junit4:junit4] 2> 131218 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!56 (1435525525077491712)]} 0 1
[junit4:junit4] 2> 131228 T475 C26 P52473 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52465/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!56 (1435525525084831744)]} 0 1
[junit4:junit4] 2> 131229 T448 C28 P52465 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52460/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[e!56 (1435525525084831744)]} 0 5
[junit4:junit4] 2> 131229 T432 C27 P52460 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!56]} 0 8
[junit4:junit4] 2> 131233 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!57 (1435525525093220352)]} 0 1
[junit4:junit4] 2> 131240 T475 C26 P52473 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52465/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!57 (1435525525097414656)]} 0 1
[junit4:junit4] 2> 131241 T446 C28 P52465 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!57 (1435525525097414656)]} 0 5
[junit4:junit4] 2> 131245 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!58 (1435525525105803264)]} 0 1
[junit4:junit4] 2> 131255 T460 C25 P52469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52460/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!58 (1435525525113143296)]} 0 1
[junit4:junit4] 2> 131256 T430 C27 P52460 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52465/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[g!58 (1435525525113143296)]} 0 5
[junit4:junit4] 2> 131257 T446 C28 P52465 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!58]} 0 8
[junit4:junit4] 2> 131260 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!59 (1435525525121531904)]} 0 1
[junit4:junit4] 2> 131270 T460 C25 P52469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52460/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!59 (1435525525128871936)]} 0 1
[junit4:junit4] 2> 131271 T430 C27 P52460 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52465/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[h!59 (1435525525128871936)]} 0 5
[junit4:junit4] 2> 131272 T446 C28 P52465 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!59]} 0 9
[junit4:junit4] 2> 131275 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!60 (1435525525137260544)]} 0 1
[junit4:junit4] 2> 131285 T460 C25 P52469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52460/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!60 (1435525525144600576)]} 0 1
[junit4:junit4] 2> 131286 T430 C27 P52460 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52465/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[i!60 (1435525525144600576)]} 0 5
[junit4:junit4] 2> 131286 T446 C28 P52465 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!60]} 0 8
[junit4:junit4] 2> 131290 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!61 (1435525525152989184)]} 0 1
[junit4:junit4] 2> 131300 T460 C25 P52469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52460/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!61 (1435525525160329216)]} 0 1
[junit4:junit4] 2> 131301 T430 C27 P52460 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52465/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[j!61 (1435525525160329216)]} 0 5
[junit4:junit4] 2> 131302 T446 C28 P52465 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!61]} 0 9
[junit4:junit4] 2> 131305 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!62 (1435525525168717824)]} 0 1
[junit4:junit4] 2> 131316 T460 C25 P52469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52460/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[k!62 (1435525525177106432)]} 0 1
[junit4:junit4] 2> 131317 T430 C27 P52460 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52465/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[k!62 (1435525525177106432)]} 0 6
[junit4:junit4] 2> 131318 T446 C28 P52465 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!62]} 0 10
[junit4:junit4] 2> 131322 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!63 (1435525525186543616)]} 0 1
[junit4:junit4] 2> 131329 T475 C26 P52473 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52465/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[l!63 (1435525525191786496)]} 0 1
[junit4:junit4] 2> 131330 T446 C28 P52465 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!63 (1435525525191786496)]} 0 5
[junit4:junit4] 2> 131334 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!64 (1435525525200175104)]} 0 1
[junit4:junit4] 2> 131344 T475 C26 P52473 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52465/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[m!64 (1435525525206466560)]} 0 1
[junit4:junit4] 2> 131345 T448 C28 P52465 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52460/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[m!64 (1435525525206466560)]} 0 5
[junit4:junit4] 2> 131346 T432 C27 P52460 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!64]} 0 9
[junit4:junit4] 2> 131349 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!65 (1435525525214855168)]} 0 1
[junit4:junit4] 2> 131356 T460 C25 P52469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52460/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[n!65 (1435525525219049472)]} 0 1
[junit4:junit4] 2> 131357 T432 C27 P52460 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!65 (1435525525219049472)]} 0 5
[junit4:junit4] 2> 131361 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!66 (1435525525227438080)]} 0 1
[junit4:junit4] 2> 131371 T475 C26 P52473 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52465/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[o!66 (1435525525234778112)]} 0 1
[junit4:junit4] 2> 131372 T448 C28 P52465 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52460/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[o!66 (1435525525234778112)]} 0 5
[junit4:junit4] 2> 131372 T432 C27 P52460 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!66]} 0 8
[junit4:junit4] 2> 131376 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!67 (1435525525243166720)]} 0 1
[junit4:junit4] 2> 131386 T460 C25 P52469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52460/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[p!67 (1435525525250506752)]} 0 1
[junit4:junit4] 2> 131387 T430 C27 P52460 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52465/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[p!67 (1435525525250506752)]} 0 5
[junit4:junit4] 2> 131387 T446 C28 P52465 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!67]} 0 8
[junit4:junit4] 2> 131391 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!68 (1435525525258895360)]} 0 1
[junit4:junit4] 2> 131398 T460 C25 P52469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52460/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[q!68 (1435525525263089664)]} 0 1
[junit4:junit4] 2> 131399 T432 C27 P52460 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!68 (1435525525263089664)]} 0 5
[junit4:junit4] 2> 131403 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!69 (1435525525271478272)]} 0 1
[junit4:junit4] 2> 131413 T475 C26 P52473 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52465/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[r!69 (1435525525279866880)]} 0 1
[junit4:junit4] 2> 131414 T448 C28 P52465 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52460/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[r!69 (1435525525279866880)]} 0 5
[junit4:junit4] 2> 131415 T432 C27 P52460 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!69]} 0 9
[junit4:junit4] 2> 131419 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!70 (1435525525288255488)]} 0 1
[junit4:junit4] 2> 131429 T460 C25 P52469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52460/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[s!70 (1435525525295595520)]} 0 1
[junit4:junit4] 2> 131430 T430 C27 P52460 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52465/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[s!70 (1435525525295595520)]} 0 5
[junit4:junit4] 2> 131431 T446 C28 P52465 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!70]} 0 9
[junit4:junit4] 2> 131435 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!71 (1435525525305032704)]} 0 1
[junit4:junit4] 2> 131446 T460 C25 P52469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52460/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[t!71 (1435525525312372736)]} 0 0
[junit4:junit4] 2> 131447 T430 C27 P52460 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52465/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[t!71 (1435525525312372736)]} 0 6
[junit4:junit4] 2> 131448 T446 C28 P52465 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!71]} 0 10
[junit4:junit4] 2> 131452 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!72 (1435525525322858496)]} 0 1
[junit4:junit4] 2> 131462 T475 C26 P52473 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52465/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[u!72 (1435525525330198528)]} 0 1
[junit4:junit4] 2> 131463 T448 C28 P52465 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:52460/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[u!72 (1435525525330198528)]} 0 5
[junit4:junit4] 2> 131464 T432 C27 P52460 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!72]} 0 9
[junit4:junit4] 2> 131468 T406 C29 P52456 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[v!73 (1435525525339635712)]} 0 1
[junit4:junit4] 2> 131478 T460 C25 P52469
[...truncated too long message...]
s WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 140856 T468 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 140856 T468 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 140858 T394 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 52456
[junit4:junit4] 2> !!!! WARNING: best effort to remove /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-1369023796084 FAILED !!!!!
[junit4:junit4] 2> 140859 T394 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4] 2> 140859 T394 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:52453 52453
[junit4:junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ShardSplitTest -Dtests.method=testDistribSearch -Dtests.seed=E87D1E45DE4E8FBD -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=be_BY -Dtests.timezone=Europe/Kaliningrad -Dtests.file.encoding=UTF-8
[junit4:junit4] ERROR 37.4s J0 | ShardSplitTest.testDistribSearch <<<
[junit4:junit4] > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:52460 returned non ok status:500, message:Server Error
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([E87D1E45DE4E8FBD:699B905DA911EF81]:0)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
[junit4:junit4] > at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:208)
[junit4:junit4] > at org.apache.solr.cloud.ShardSplitTest.doTest(ShardSplitTest.java:133)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:679)
[junit4:junit4] 2> 140882 T394 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 168355 T485 oasu.PeerSync.handleResponse WARN PeerSync: core=collection1 url=http://127.0.0.1:52473 couldn't connect to http://127.0.0.1:52465/collection1/, counting as success
[junit4:junit4] 2> 168356 T485 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:52473 DONE. sync succeeded
[junit4:junit4] 2> 168356 T485 oasc.SyncStrategy.syncReplicas We have been closed, won't attempt to sync replicas back to leader
[junit4:junit4] 2> 168357 T485 oasc.ShardLeaderElectionContext.rejoinLeaderElection Not rejoining election because CoreContainer is shutdown
[junit4:junit4] 2> 168357 T485 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@7dac14dd
[junit4:junit4] 2> 168366 T485 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=2,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=10,adds=10,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=52,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0}
[junit4:junit4] 2> 168367 T485 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 168367 T485 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 168367 T485 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 168370 T485 C26 P52473 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@18feb66a lockFactory=org.apache.lucene.store.NativeFSLockFactory@b20be93),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@18feb66a lockFactory=org.apache.lucene.store.NativeFSLockFactory@b20be93),segFN=segments_5,generation=5}
[junit4:junit4] 2> 168371 T485 C26 P52473 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 5
[junit4:junit4] 2> 168374 T485 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 168374 T485 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 168375 T485 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1369023796084/jetty4/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1369023796084/jetty4/index;done=false>>]
[junit4:junit4] 2> 168375 T485 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1369023796084/jetty4/index
[junit4:junit4] 2> 168375 T485 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1369023796084/jetty4 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1369023796084/jetty4;done=false>>]
[junit4:junit4] 2> 168376 T485 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1369023796084/jetty4
[junit4:junit4] 2> 168376 T485 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 168376 T485 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 168376 T485 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 168377 T485 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 168377 T485 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 168377 T485 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:235)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:232)
[junit4:junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:232)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:84)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4] 2>
[junit4:junit4] 2> NOTE: test params are: codec=Asserting, sim=RandomSimilarityProvider(queryNorm=false,coord=no): {}, locale=be_BY, timezone=Europe/Kaliningrad
[junit4:junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Sun Microsystems Inc. 1.6.0_32 (64-bit)/cpus=16,threads=2,free=266194456,total=468254720
[junit4:junit4] 2> NOTE: All tests run in this JVM: [TestSolrIndexConfig, TestLRUCache, DateFieldTest, TestFaceting, ResponseLogComponentTest, TestTrie, AlternateDirectoryTest, TestSolrQueryParser, TestSearchPerf, MoreLikeThisHandlerTest, TermsComponentTest, TestFieldTypeCollectionResource, ChaosMonkeyNothingIsSafeTest, ExternalFileFieldSortTest, TestLMDirichletSimilarityFactory, TestSolrCoreProperties, JsonLoaderTest, ZkControllerTest, UUIDFieldTest, TestCharFilters, TestSerializedLuceneMatchVersion, TestValueSourceCache, MinimalSchemaTest, TestCloudManagedSchema, SystemInfoHandlerTest, LegacyHTMLStripCharFilterTest, TestLFUCache, DistributedQueryElevationComponentTest, TestExtendedDismaxParser, PrimUtilsTest, PrimitiveFieldTypeTest, TestSolrDeletionPolicy1, TestFieldResource, SOLR749Test, ShardSplitTest]
[junit4:junit4] Completed on J0 in 65.46s, 1 test, 1 error <<< FAILURES!
[...truncated 767 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/build.xml:383: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/build.xml:363: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build.xml:181: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/common-build.xml:437: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/common-build.xml:1243: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/common-build.xml:887: There were test failures: 296 suites, 1234 tests, 1 error, 27 ignored (8 assumptions)
Total time: 46 minutes 25 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-Tests-4.x-Java6 - Build # 1636 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java6/1636/
1 tests failed.
FAILED: org.apache.solr.cloud.SyncSliceTest.testDistribSearch
Error Message:
shard1 is not consistent. Got 305 from http://127.0.0.1:29092/collection1lastClient and got 5 from http://127.0.0.1:29096/collection1
Stack Trace:
java.lang.AssertionError: shard1 is not consistent. Got 305 from http://127.0.0.1:29092/collection1lastClient and got 5 from http://127.0.0.1:29096/collection1
at __randomizedtesting.SeedInfo.seed([7767B2B23AE7829D:F6813CAA4DB8E2A1]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:963)
at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:238)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:679)
Build Log:
[...truncated 9032 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.SyncSliceTest
[junit4:junit4] 2> 556909 T1666 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4] 2> 556915 T1666 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./solrtest-SyncSliceTest-1368998928210
[junit4:junit4] 2> 556917 T1666 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 556917 T1667 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 557018 T1666 oasc.ZkTestServer.run start zk server on port:55724
[junit4:junit4] 2> 557018 T1666 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 557026 T1673 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@17d24aa8 name:ZooKeeperConnection Watcher:127.0.0.1:55724 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 557027 T1666 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 557027 T1666 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 557038 T1666 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 557040 T1675 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@168310c1 name:ZooKeeperConnection Watcher:127.0.0.1:55724/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 557040 T1666 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 557040 T1666 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 557051 T1666 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 557053 T1666 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 557056 T1666 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 557065 T1666 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 557065 T1666 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 557070 T1666 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 557071 T1666 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 557175 T1666 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 557176 T1666 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 557179 T1666 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 557180 T1666 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 557183 T1666 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 557184 T1666 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 557187 T1666 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 557188 T1666 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 557191 T1666 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 557191 T1666 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 557199 T1666 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 557199 T1666 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 557202 T1666 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 557203 T1666 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 557465 T1666 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 557468 T1666 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:23198
[junit4:junit4] 2> 557469 T1666 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 557470 T1666 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 557470 T1666 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1368998928507
[junit4:junit4] 2> 557470 T1666 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1368998928507/solr.xml
[junit4:junit4] 2> 557471 T1666 oasc.CoreContainer.<init> New CoreContainer 1671668840
[junit4:junit4] 2> 557471 T1666 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1368998928507/'
[junit4:junit4] 2> 557472 T1666 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1368998928507/'
[junit4:junit4] 2> 557580 T1666 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 557581 T1666 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 557581 T1666 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 557582 T1666 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 557582 T1666 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 557583 T1666 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 557583 T1666 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 557583 T1666 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 557584 T1666 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 557584 T1666 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 557602 T1666 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 557602 T1666 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55724/solr
[junit4:junit4] 2> 557603 T1666 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 557604 T1666 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 557606 T1686 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5c588ded name:ZooKeeperConnection Watcher:127.0.0.1:55724 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 557607 T1666 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 557620 T1666 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 557632 T1666 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 557634 T1688 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ed9999 name:ZooKeeperConnection Watcher:127.0.0.1:55724/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 557634 T1666 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 557641 T1666 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 557646 T1666 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 557649 T1666 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 557657 T1666 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:23198_
[junit4:junit4] 2> 557659 T1666 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:23198_
[junit4:junit4] 2> 557662 T1666 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 557678 T1666 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 557681 T1666 oasc.Overseer.start Overseer (id=89718713759629315-127.0.0.1:23198_-n_0000000000) starting
[junit4:junit4] 2> 557691 T1666 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 557702 T1690 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 557703 T1666 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 557706 T1666 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 557712 T1666 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 557715 T1689 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 557719 T1691 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1368998928507/collection1
[junit4:junit4] 2> 557719 T1691 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 557720 T1691 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 557720 T1691 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 557722 T1691 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1368998928507/collection1/'
[junit4:junit4] 2> 557723 T1691 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1368998928507/collection1/lib/README' to classloader
[junit4:junit4] 2> 557723 T1691 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1368998928507/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 557768 T1691 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 557820 T1691 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 557922 T1691 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 557927 T1691 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 558508 T1691 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 558520 T1691 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 558525 T1691 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 558539 T1691 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 558544 T1691 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 558548 T1691 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 558549 T1691 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 558550 T1691 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 558550 T1691 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 558551 T1691 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 558551 T1691 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 558551 T1691 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 558552 T1691 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1368998928507/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1368998928209/control/data/
[junit4:junit4] 2> 558552 T1691 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4ab34646
[junit4:junit4] 2> 558552 T1691 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 558554 T1691 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/control/data
[junit4:junit4] 2> 558555 T1691 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1368998928209/control/data/index/
[junit4:junit4] 2> 558556 T1691 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1368998928209/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 558557 T1691 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/control/data/index
[junit4:junit4] 2> 558573 T1691 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@37e02801; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 558574 T1691 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 558576 T1691 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 558577 T1691 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 558577 T1691 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 558578 T1691 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 558578 T1691 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 558579 T1691 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 558579 T1691 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 558579 T1691 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 558580 T1691 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 558589 T1691 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 558598 T1691 oass.SolrIndexSearcher.<init> Opening Searcher@1aea0a92 main
[junit4:junit4] 2> 558600 T1691 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 558600 T1691 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 558603 T1692 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1aea0a92 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 558605 T1691 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 558605 T1691 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 559219 T1689 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 559220 T1689 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:23198_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:23198"}
[junit4:junit4] 2> 559220 T1689 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 559221 T1689 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 559269 T1688 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 559608 T1691 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 559608 T1691 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:23198 collection:control_collection shard:shard1
[junit4:junit4] 2> 559609 T1691 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 559627 T1691 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 559637 T1691 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 559637 T1691 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 559637 T1691 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:23198/collection1/
[junit4:junit4] 2> 559638 T1691 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 559638 T1691 oasc.SyncStrategy.syncToMe http://127.0.0.1:23198/collection1/ has no replicas
[junit4:junit4] 2> 559638 T1691 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:23198/collection1/
[junit4:junit4] 2> 559638 T1691 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 560774 T1689 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 560794 T1688 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 560829 T1691 oasc.ZkController.register We are http://127.0.0.1:23198/collection1/ and leader is http://127.0.0.1:23198/collection1/
[junit4:junit4] 2> 560829 T1691 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:23198
[junit4:junit4] 2> 560829 T1691 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 560829 T1691 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 560830 T1691 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 560832 T1691 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 560833 T1666 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0
[junit4:junit4] 2> 560834 T1666 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 560834 T1666 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 560850 T1666 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 560851 T1666 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 560853 T1695 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7d3f8882 name:ZooKeeperConnection Watcher:127.0.0.1:55724/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 560854 T1666 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 560855 T1666 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 560857 T1666 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 561114 T1666 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 561117 T1666 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:29060
[junit4:junit4] 2> 561117 T1666 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 561118 T1666 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 561118 T1666 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1368998932152
[junit4:junit4] 2> 561119 T1666 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1368998932152/solr.xml
[junit4:junit4] 2> 561119 T1666 oasc.CoreContainer.<init> New CoreContainer 182863996
[junit4:junit4] 2> 561120 T1666 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1368998932152/'
[junit4:junit4] 2> 561120 T1666 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1368998932152/'
[junit4:junit4] 2> 561231 T1666 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 561232 T1666 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 561232 T1666 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 561232 T1666 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 561233 T1666 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 561233 T1666 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 561234 T1666 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 561234 T1666 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 561235 T1666 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 561235 T1666 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 561250 T1666 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 561251 T1666 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55724/solr
[junit4:junit4] 2> 561251 T1666 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 561252 T1666 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 561255 T1706 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@482c1da name:ZooKeeperConnection Watcher:127.0.0.1:55724 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 561255 T1666 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 561257 T1666 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 561268 T1666 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 561270 T1708 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@70ce2e32 name:ZooKeeperConnection Watcher:127.0.0.1:55724/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 561271 T1666 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 561283 T1666 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 562287 T1666 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:29060_
[junit4:junit4] 2> 562290 T1666 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:29060_
[junit4:junit4] 2> 562293 T1695 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 562293 T1688 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 562293 T1708 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 562294 T1688 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 562306 T1689 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 562307 T1709 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1368998932152/collection1
[junit4:junit4] 2> 562307 T1689 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:23198__collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:23198_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:23198"}
[junit4:junit4] 2> 562308 T1709 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 562309 T1709 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 562310 T1709 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 562312 T1709 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1368998932152/collection1/'
[junit4:junit4] 2> 562313 T1709 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty1-1368998932152/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 562314 T1709 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty1-1368998932152/collection1/lib/README' to classloader
[junit4:junit4] 2> 562319 T1708 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 562319 T1688 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 562319 T1695 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 562363 T1709 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 562419 T1709 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 562520 T1709 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 562526 T1709 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 563126 T1709 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 563139 T1709 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 563143 T1709 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 563157 T1709 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 563160 T1709 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 563164 T1709 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 563165 T1709 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 563166 T1709 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 563166 T1709 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 563167 T1709 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 563167 T1709 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 563167 T1709 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 563168 T1709 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1368998932152/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty1/
[junit4:junit4] 2> 563168 T1709 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4ab34646
[junit4:junit4] 2> 563168 T1709 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 563169 T1709 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty1
[junit4:junit4] 2> 563169 T1709 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty1/index/
[junit4:junit4] 2> 563170 T1709 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 563170 T1709 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty1/index
[junit4:junit4] 2> 563176 T1709 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@d574714; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 563176 T1709 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 563178 T1709 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 563178 T1709 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 563179 T1709 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 563179 T1709 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 563180 T1709 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 563180 T1709 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 563180 T1709 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 563180 T1709 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 563181 T1709 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 563187 T1709 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 563193 T1709 oass.SolrIndexSearcher.<init> Opening Searcher@41a4ed5e main
[junit4:junit4] 2> 563194 T1709 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 563194 T1709 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 563198 T1710 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@41a4ed5e main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 563199 T1709 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 563199 T1709 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 563825 T1689 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 563826 T1689 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:29060_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:29060"}
[junit4:junit4] 2> 563827 T1689 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 1
[junit4:junit4] 2> 563827 T1689 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 563841 T1708 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 563841 T1695 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 563841 T1688 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 564203 T1709 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 564203 T1709 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:29060 collection:collection1 shard:shard1
[junit4:junit4] 2> 564204 T1709 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 564228 T1709 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 564231 T1709 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 564232 T1709 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 564232 T1709 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:29060/collection1/
[junit4:junit4] 2> 564232 T1709 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 564232 T1709 oasc.SyncStrategy.syncToMe http://127.0.0.1:29060/collection1/ has no replicas
[junit4:junit4] 2> 564233 T1709 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:29060/collection1/
[junit4:junit4] 2> 564233 T1709 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 565347 T1689 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 565390 T1695 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 565390 T1708 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 565390 T1688 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 565422 T1709 oasc.ZkController.register We are http://127.0.0.1:29060/collection1/ and leader is http://127.0.0.1:29060/collection1/
[junit4:junit4] 2> 565422 T1709 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:29060
[junit4:junit4] 2> 565422 T1709 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 565422 T1709 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 565422 T1709 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 565424 T1709 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 565425 T1666 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0
[junit4:junit4] 2> 565426 T1666 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 565426 T1666 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 565692 T1666 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 565695 T1666 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:29086
[junit4:junit4] 2> 565695 T1666 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 565696 T1666 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 565696 T1666 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1368998936736
[junit4:junit4] 2> 565697 T1666 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1368998936736/solr.xml
[junit4:junit4] 2> 565697 T1666 oasc.CoreContainer.<init> New CoreContainer 588784149
[junit4:junit4] 2> 565698 T1666 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1368998936736/'
[junit4:junit4] 2> 565698 T1666 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1368998936736/'
[junit4:junit4] 2> 565804 T1666 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 565805 T1666 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 565805 T1666 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 565806 T1666 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 565806 T1666 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 565807 T1666 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 565807 T1666 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 565808 T1666 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 565808 T1666 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 565808 T1666 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 565825 T1666 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 565826 T1666 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55724/solr
[junit4:junit4] 2> 565826 T1666 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 565827 T1666 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 565830 T1722 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@539c9889 name:ZooKeeperConnection Watcher:127.0.0.1:55724 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 565830 T1666 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 565844 T1666 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 565856 T1666 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 565858 T1724 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2ad42380 name:ZooKeeperConnection Watcher:127.0.0.1:55724/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 565858 T1666 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 565868 T1666 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 566872 T1666 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:29086_
[junit4:junit4] 2> 566874 T1666 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:29086_
[junit4:junit4] 2> 566878 T1695 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 566878 T1688 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 566878 T1695 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 566878 T1724 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 566878 T1708 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 566878 T1688 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 566879 T1708 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 566894 T1725 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1368998936736/collection1
[junit4:junit4] 2> 566894 T1725 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 566895 T1725 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 566895 T1725 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 566897 T1725 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1368998936736/collection1/'
[junit4:junit4] 2> 566898 T1725 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty2-1368998936736/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 566899 T1725 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty2-1368998936736/collection1/lib/README' to classloader
[junit4:junit4] 2> 566903 T1689 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 566904 T1689 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:29060__collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:29060_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:29060"}
[junit4:junit4] 2> 566916 T1695 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 566916 T1724 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 566916 T1708 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 566916 T1688 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 566947 T1725 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 567003 T1725 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 567104 T1725 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 567110 T1725 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 567688 T1725 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 567696 T1725 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 567699 T1725 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 567711 T1725 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 567715 T1725 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 567718 T1725 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 567719 T1725 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 567719 T1725 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 567719 T1725 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 567720 T1725 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 567720 T1725 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 567720 T1725 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 567721 T1725 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1368998936736/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty2/
[junit4:junit4] 2> 567721 T1725 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4ab34646
[junit4:junit4] 2> 567721 T1725 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 567722 T1725 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty2
[junit4:junit4] 2> 567722 T1725 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty2/index/
[junit4:junit4] 2> 567723 T1725 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 567723 T1725 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty2/index
[junit4:junit4] 2> 567757 T1725 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@7d455745; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 567758 T1725 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 567760 T1725 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 567761 T1725 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 567761 T1725 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 567762 T1725 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 567763 T1725 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 567763 T1725 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 567763 T1725 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 567764 T1725 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 567764 T1725 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 567774 T1725 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 567783 T1725 oass.SolrIndexSearcher.<init> Opening Searcher@33834ff1 main
[junit4:junit4] 2> 567784 T1725 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 567784 T1725 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 567788 T1726 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@33834ff1 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 567790 T1725 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 567790 T1725 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 568420 T1689 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 568421 T1689 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:29086_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:29086"}
[junit4:junit4] 2> 568421 T1689 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 568421 T1689 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 568437 T1695 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 568437 T1724 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 568437 T1688 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 568437 T1708 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 568794 T1725 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 568794 T1725 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:29086 collection:collection1 shard:shard1
[junit4:junit4] 2> 568797 T1725 oasc.ZkController.register We are http://127.0.0.1:29086/collection1/ and leader is http://127.0.0.1:29060/collection1/
[junit4:junit4] 2> 568797 T1725 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:29086
[junit4:junit4] 2> 568797 T1725 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 568798 T1725 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C104 name=collection1 org.apache.solr.core.SolrCore@4bd5e61d url=http://127.0.0.1:29086/collection1 node=127.0.0.1:29086_ C104_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:29086_, base_url=http://127.0.0.1:29086}
[junit4:junit4] 2> 568798 T1727 C104 P29086 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 568799 T1727 C104 P29086 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 568799 T1725 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 568799 T1727 C104 P29086 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 568800 T1727 C104 P29086 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 568800 T1666 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0
[junit4:junit4] 2> 568801 T1666 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 568801 T1727 C104 P29086 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 568801 T1666 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 568825 T1698 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:29086__collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 569075 T1666 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 569078 T1666 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:29092
[junit4:junit4] 2> 569078 T1666 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 569079 T1666 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 569079 T1666 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1368998940118
[junit4:junit4] 2> 569080 T1666 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1368998940118/solr.xml
[junit4:junit4] 2> 569080 T1666 oasc.CoreContainer.<init> New CoreContainer 155854634
[junit4:junit4] 2> 569081 T1666 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1368998940118/'
[junit4:junit4] 2> 569081 T1666 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1368998940118/'
[junit4:junit4] 2> 569187 T1666 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 569188 T1666 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 569188 T1666 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 569189 T1666 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 569189 T1666 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 569190 T1666 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 569190 T1666 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 569191 T1666 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 569191 T1666 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 569192 T1666 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 569207 T1666 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 569207 T1666 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55724/solr
[junit4:junit4] 2> 569208 T1666 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 569209 T1666 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 569214 T1739 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6a0333af name:ZooKeeperConnection Watcher:127.0.0.1:55724 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 569214 T1666 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 569217 T1666 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 569227 T1666 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 569229 T1741 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@767437bf name:ZooKeeperConnection Watcher:127.0.0.1:55724/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 569230 T1666 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 569242 T1666 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 569944 T1689 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 569945 T1689 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:29086__collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:29086_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:29086"}
[junit4:junit4] 2> 569966 T1695 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 569966 T1708 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 569966 T1741 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 569966 T1724 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 569966 T1688 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 570247 T1666 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:29092_
[junit4:junit4] 2> 570249 T1666 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:29092_
[junit4:junit4] 2> 570252 T1724 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 570252 T1741 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 570252 T1695 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 570252 T1708 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 570252 T1688 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 570252 T1708 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 570252 T1695 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 570253 T1688 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 570253 T1724 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 570254 T1741 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 570272 T1742 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1368998940118/collection1
[junit4:junit4] 2> 570272 T1742 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 570273 T1742 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 570273 T1742 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 570275 T1742 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1368998940118/collection1/'
[junit4:junit4] 2> 570276 T1742 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty3-1368998940118/collection1/lib/README' to classloader
[junit4:junit4] 2> 570277 T1742 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty3-1368998940118/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 570325 T1742 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 570381 T1742 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 570483 T1742 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 570489 T1742 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 570828 T1698 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:29086__collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 570828 T1698 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:29086__collection1&state=recovering&nodeName=127.0.0.1:29086_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2003
[junit4:junit4] 2> 571084 T1742 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 571096 T1742 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 571101 T1742 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 571115 T1742 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 571120 T1742 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 571124 T1742 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 571125 T1742 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 571125 T1742 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 571126 T1742 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 571127 T1742 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 571127 T1742 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 571127 T1742 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 571128 T1742 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1368998940118/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty3/
[junit4:junit4] 2> 571128 T1742 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4ab34646
[junit4:junit4] 2> 571128 T1742 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 571129 T1742 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty3
[junit4:junit4] 2> 571130 T1742 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty3/index/
[junit4:junit4] 2> 571131 T1742 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 571132 T1742 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty3/index
[junit4:junit4] 2> 571139 T1742 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@61d59f38; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 571139 T1742 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 571142 T1742 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 571142 T1742 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 571143 T1742 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 571144 T1742 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 571144 T1742 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 571144 T1742 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 571145 T1742 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 571145 T1742 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 571146 T1742 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 571155 T1742 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 571163 T1742 oass.SolrIndexSearcher.<init> Opening Searcher@270fbadc main
[junit4:junit4] 2> 571164 T1742 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 571164 T1742 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 571168 T1743 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@270fbadc main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 571170 T1742 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 571170 T1742 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 571498 T1689 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 571498 T1689 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:29092_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:29092"}
[junit4:junit4] 2> 571499 T1689 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 571499 T1689 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 571514 T1695 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 571514 T1708 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 571514 T1741 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 571514 T1724 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 571514 T1688 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 572174 T1742 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 572174 T1742 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:29092 collection:collection1 shard:shard1
[junit4:junit4] 2> 572181 T1742 oasc.ZkController.register We are http://127.0.0.1:29092/collection1/ and leader is http://127.0.0.1:29060/collection1/
[junit4:junit4] 2> 572181 T1742 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:29092
[junit4:junit4] 2> 572181 T1742 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 572181 T1742 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C105 name=collection1 org.apache.solr.core.SolrCore@7fd1091b url=http://127.0.0.1:29092/collection1 node=127.0.0.1:29092_ C105_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:29092_, base_url=http://127.0.0.1:29092}
[junit4:junit4] 2> 572182 T1744 C105 P29092 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 572182 T1744 C105 P29092 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 572182 T1742 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 572183 T1744 C105 P29092 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 572183 T1744 C105 P29092 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 572184 T1666 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0
[junit4:junit4] 2> 572184 T1666 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 572184 T1744 C105 P29092 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 572185 T1666 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 572208 T1699 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:29092__collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 572458 T1666 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 572461 T1666 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:29096
[junit4:junit4] 2> 572462 T1666 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 572462 T1666 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 572463 T1666 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1368998943501
[junit4:junit4] 2> 572463 T1666 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1368998943501/solr.xml
[junit4:junit4] 2> 572463 T1666 oasc.CoreContainer.<init> New CoreContainer 1660468460
[junit4:junit4] 2> 572464 T1666 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1368998943501/'
[junit4:junit4] 2> 572464 T1666 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1368998943501/'
[junit4:junit4] 2> 572571 T1666 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 572571 T1666 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 572572 T1666 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 572572 T1666 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 572573 T1666 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 572573 T1666 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 572573 T1666 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 572574 T1666 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 572574 T1666 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 572575 T1666 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 572592 T1666 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 572592 T1666 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55724/solr
[junit4:junit4] 2> 572593 T1666 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 572594 T1666 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 572597 T1756 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@41440f38 name:ZooKeeperConnection Watcher:127.0.0.1:55724 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 572597 T1666 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 572611 T1666 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 572622 T1666 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 572624 T1758 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@218fd30 name:ZooKeeperConnection Watcher:127.0.0.1:55724/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 572625 T1666 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 572635 T1666 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> C104_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:29086_, base_url=http://127.0.0.1:29086}
[junit4:junit4] 2> 572830 T1727 C104 P29086 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:29060/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 572830 T1727 C104 P29086 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:29086 START replicas=[http://127.0.0.1:29060/collection1/] nUpdates=100
[junit4:junit4] 2> 572830 T1727 C104 P29086 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 572831 T1727 C104 P29086 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 572831 T1727 C104 P29086 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 572831 T1727 C104 P29086 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 572831 T1727 C104 P29086 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 572832 T1727 C104 P29086 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:29060/collection1/. core=collection1
[junit4:junit4] 2> 572832 T1727 C104 P29086 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C106 name=collection1 org.apache.solr.core.SolrCore@4bfd1647 url=http://127.0.0.1:29060/collection1 node=127.0.0.1:29060_ C106_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:29060_, base_url=http://127.0.0.1:29060, leader=true}
[junit4:junit4] 2> 572838 T1700 C106 P29060 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 572844 T1701 C106 P29060 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 572849 T1701 C106 P29060 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@d574714; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 572850 T1701 C106 P29060 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 572854 T1701 C106 P29060 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@d574714; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@d574714; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> 572855 T1701 C106 P29060 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 572856 T1701 C106 P29060 oass.SolrIndexSearcher.<init> Opening Searcher@2a69a449 realtime
[junit4:junit4] 2> 572857 T1701 C106 P29060 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 572857 T1701 C106 P29060 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 13
[junit4:junit4] 2> 572858 T1727 C104 P29086 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 572858 T1727 C104 P29086 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 572860 T1702 C106 P29060 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 572860 T1702 C106 P29060 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 572861 T1727 C104 P29086 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 572861 T1727 C104 P29086 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 572861 T1727 C104 P29086 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 572864 T1702 C106 P29060 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=1
[junit4:junit4] 2> 572864 T1727 C104 P29086 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 572866 T1727 C104 P29086 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty2/index.20130519122904159
[junit4:junit4] 2> 572867 T1727 C104 P29086 oash.SnapPuller.fetchLatestIndex Starting download to NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty2/index.20130519122904159 lockFactory=org.apache.lucene.store.NativeFSLockFactory@63af701e; maxCacheMB=48.0 maxMergeSizeMB=4.0) fullCopy=false
[junit4:junit4] 2> 572870 T1702 C106 P29060 oasc.SolrCore.execute [collection1] webapp= path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 572871 T1727 C104 P29086 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 572874 T1727 C104 P29086 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 572874 T1727 C104 P29086 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 572878 T1727 C104 P29086 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@7d455745; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@7d455745; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> 572879 T1727 C104 P29086 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 572879 T1727 C104 P29086 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 572880 T1727 C104 P29086 oass.SolrIndexSearcher.<init> Opening Searcher@2b164cdf main
[junit4:junit4] 2> 572881 T1726 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2b164cdf main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 572882 T1727 C104 P29086 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty2/index.20130519122904159 [CachedDir<<refCount=0;path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty2/index.20130519122904159;done=true>>]
[junit4:junit4] 2> 572882 T1727 C104 P29086 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty2/index.20130519122904159
[junit4:junit4] 2> 572882 T1727 C104 P29086 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty2/index.20130519122904159
[junit4:junit4] 2> 572883 T1727 C104 P29086 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 572884 T1727 C104 P29086 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 572884 T1727 C104 P29086 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 572884 T1727 C104 P29086 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 572885 T1727 C104 P29086 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 573019 T1689 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 573020 T1689 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:29092__collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:29092_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:29092"}
[junit4:junit4] 2> 573024 T1689 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:29086__collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:29086_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:29086"}
[junit4:junit4] 2> 573041 T1695 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 573041 T1741 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 573041 T1708 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 573041 T1724 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 573041 T1758 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 573041 T1688 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 573210 T1699 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:29092__collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 573210 T1699 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:29092__collection1&state=recovering&nodeName=127.0.0.1:29092_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1002
[junit4:junit4] 2> 573639 T1666 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:29096_
[junit4:junit4] 2> 573641 T1666 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:29096_
[junit4:junit4] 2> 573643 T1758 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 573643 T1741 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 573644 T1688 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 573643 T1724 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 573644 T1688 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 573644 T1708 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 573644 T1695 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 573645 T1708 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 573645 T1695 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 573645 T1758 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 573646 T1741 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 573655 T1724 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 573665 T1761 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1368998943501/collection1
[junit4:junit4] 2> 573665 T1761 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 573666 T1761 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 573666 T1761 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 573668 T1761 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1368998943501/collection1/'
[junit4:junit4] 2> 573669 T1761 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty4-1368998943501/collection1/lib/README' to classloader
[junit4:junit4] 2> 573669 T1761 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty4-1368998943501/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 573744 T1761 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 573800 T1761 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 573901 T1761 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 573907 T1761 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 574502 T1761 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 574515 T1761 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 574519 T1761 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 574534 T1761 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 574539 T1761 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 574543 T1761 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 574544 T1761 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 574545 T1761 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 574545 T1761 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 574546 T1761 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 574546 T1761 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 574547 T1761 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 574547 T1761 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1368998943501/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty4/
[junit4:junit4] 2> 574547 T1761 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4ab34646
[junit4:junit4] 2> 574548 T1761 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 574549 T1761 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty4
[junit4:junit4] 2> 574550 T1761 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty4/index/
[junit4:junit4] 2> 574551 T1761 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 574551 T1761 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty4/index
[junit4:junit4] 2> 574558 T1761 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3c546362; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 574558 T1761 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 574561 T1761 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 574561 T1761 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 574562 T1761 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 574563 T1761 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 574563 T1761 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 574564 T1761 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 574564 T1761 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 574564 T1761 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 574565 T1761 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 574574 T1761 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 574583 T1761 oass.SolrIndexSearcher.<init> Opening Searcher@681b2f05 main
[junit4:junit4] 2> 574585 T1761 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 574585 T1761 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 574589 T1762 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@681b2f05 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 574591 T1761 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 574592 T1761 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> C105_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:29092_, base_url=http://127.0.0.1:29092}
[junit4:junit4] 2> 575212 T1744 C105 P29092 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:29060/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 575212 T1744 C105 P29092 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:29092 START replicas=[http://127.0.0.1:29060/collection1/] nUpdates=100
[junit4:junit4] 2> 575213 T1744 C105 P29092 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 575213 T1744 C105 P29092 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 575213 T1744 C105 P29092 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 575213 T1744 C105 P29092 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 575213 T1744 C105 P29092 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 575213 T1744 C105 P29092 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:29060/collection1/. core=collection1
[junit4:junit4] 2> 575214 T1744 C105 P29092 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 575215 T1700 C106 P29060 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 575230 T1703 C106 P29060 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 575242 T1703 C106 P29060 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@d574714; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@d574714; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> 575242 T1703 C106 P29060 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 575243 T1703 C106 P29060 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 575244 T1703 C106 P29060 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 14
[junit4:junit4] 2> 575244 T1744 C105 P29092 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 575245 T1744 C105 P29092 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 575247 T1702 C106 P29060 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4] 2> 575248 T1744 C105 P29092 oash.SnapPuller.fetchLatestIndex Master's generation: 3
[junit4:junit4] 2> 575248 T1744 C105 P29092 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 575248 T1744 C105 P29092 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 575251 T1702 C106 P29060 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=3&version=2} status=0 QTime=1
[junit4:junit4] 2> 575251 T1744 C105 P29092 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 575253 T1744 C105 P29092 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty3/index.20130519122906546
[junit4:junit4] 2> 575254 T1744 C105 P29092 oash.SnapPuller.fetchLatestIndex Starting download to NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty3/index.20130519122906546 lockFactory=org.apache.lucene.store.NativeFSLockFactory@461706bc; maxCacheMB=48.0 maxMergeSizeMB=4.0) fullCopy=false
[junit4:junit4] 2> 575257 T1702 C106 P29060 oasc.SolrCore.execute [collection1] webapp= path=/replication params={file=segments_3&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=3} status=0 QTime=0
[junit4:junit4] 2> 575258 T1744 C105 P29092 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 575261 T1744 C105 P29092 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 575261 T1744 C105 P29092 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 575266 T1744 C105 P29092 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@61d59f38; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@61d59f38; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> 575266 T1744 C105 P29092 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 575266 T1744 C105 P29092 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 575267 T1744 C105 P29092 oass.SolrIndexSearcher.<init> Opening Searcher@6cd54458 main
[junit4:junit4] 2> 575268 T1743 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6cd54458 main{StandardDirectoryReader(segments_3:1:nrt)}
[junit4:junit4] 2> 575269 T1744 C105 P29092 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty3/index.20130519122906546 [CachedDir<<refCount=0;path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty3/index.20130519122906546;done=true>>]
[junit4:junit4] 2> 575269 T1744 C105 P29092 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty3/index.20130519122906546
[junit4:junit4] 2> 575269 T1744 C105 P29092 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty3/index.20130519122906546
[junit4:junit4] 2> 575270 T1744 C105 P29092 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 575271 T1744 C105 P29092 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 575271 T1744 C105 P29092 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 575271 T1744 C105 P29092 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 575272 T1744 C105 P29092 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 576052 T1689 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 576053 T1689 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:29096_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:29096"}
[junit4:junit4] 2> 576053 T1689 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 576054 T1689 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 576063 T1689 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:29092__collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:29092_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:29092"}
[junit4:junit4] 2> 576080 T1695 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 576080 T1724 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 576080 T1708 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 576080 T1741 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 576080 T1758 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 576080 T1688 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 576597 T1761 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 576597 T1761 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:29096 collection:collection1 shard:shard1
[junit4:junit4] 2> 576601 T1761 oasc.ZkController.register We are http://127.0.0.1:29096/collection1/ and leader is http://127.0.0.1:29060/collection1/
[junit4:junit4] 2> 576601 T1761 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:29096
[junit4:junit4] 2> 576601 T1761 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 576601 T1761 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C107 name=collection1 org.apache.solr.core.SolrCore@7661e50f url=http://127.0.0.1:29096/collection1 node=127.0.0.1:29096_ C107_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:29096_, base_url=http://127.0.0.1:29096}
[junit4:junit4] 2> 576602 T1765 C107 P29096 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 576602 T1761 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 576603 T1765 C107 P29096 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 576603 T1765 C107 P29096 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 576603 T1765 C107 P29096 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 576604 T1666 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0
[junit4:junit4] 2> 576604 T1666 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 576605 T1765 C107 P29096 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 576605 T1666 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 576623 T1666 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 576623 T1704 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:29096__collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 576624 T1666 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 2> 576624 T1666 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 2> 576625 T1666 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 577591 T1689 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 577592 T1689 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:29096__collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:29096_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:29096"}
[junit4:junit4] 2> 577606 T1695 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 577607 T1741 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 577607 T1708 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 577607 T1758 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 577607 T1724 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 577607 T1688 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 577625 T1704 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:29096__collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 577625 T1704 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:29096__collection1&state=recovering&nodeName=127.0.0.1:29096_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1002
[junit4:junit4] 2> 577627 T1666 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 578630 T1666 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C107_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:29096_, base_url=http://127.0.0.1:29096}
[junit4:junit4] 2> 579627 T1765 C107 P29096 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:29060/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 579627 T1765 C107 P29096 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:29096 START replicas=[http://127.0.0.1:29060/collection1/] nUpdates=100
[junit4:junit4] 2> 579628 T1765 C107 P29096 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 579628 T1765 C107 P29096 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 579628 T1765 C107 P29096 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 579628 T1765 C107 P29096 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 579628 T1765 C107 P29096 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 579628 T1765 C107 P29096 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:29060/collection1/. core=collection1
[junit4:junit4] 2> 579629 T1765 C107 P29096 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 579630 T1700 C106 P29060 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 579632 T1666 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 579639 T1698 C106 P29060 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 579644 T1698 C106 P29060 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=3
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@d574714; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@d574714; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@d574714; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> 579644 T1698 C106 P29060 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4:junit4] 2> 579645 T1698 C106 P29060 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 579646 T1698 C106 P29060 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 579647 T1765 C107 P29096 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 579647 T1765 C107 P29096 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 579649 T1702 C106 P29060 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4] 2> 579650 T1765 C107 P29096 oash.SnapPuller.fetchLatestIndex Master's generation: 4
[junit4:junit4] 2> 579650 T1765 C107 P29096 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 579650 T1765 C107 P29096 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 579653 T1702 C106 P29060 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=4&version=2} status=0 QTime=1
[junit4:junit4] 2> 579657 T1765 C107 P29096 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 579659 T1765 C107 P29096 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty4/index.20130519122910951
[junit4:junit4] 2> 579660 T1765 C107 P29096 oash.SnapPuller.fetchLatestIndex Starting download to NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty4/index.20130519122910951 lockFactory=org.apache.lucene.store.NativeFSLockFactory@21841c36; maxCacheMB=48.0 maxMergeSizeMB=4.0) fullCopy=false
[junit4:junit4] 2> 579663 T1702 C106 P29060 oasc.SolrCore.execute [collection1] webapp= path=/replication params={file=segments_4&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=4} status=0 QTime=0
[junit4:junit4] 2> 579665 T1765 C107 P29096 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 579667 T1765 C107 P29096 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 579667 T1765 C107 P29096 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 579672 T1765 C107 P29096 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3c546362; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3c546362; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> 579672 T1765 C107 P29096 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4:junit4] 2> 579673 T1765 C107 P29096 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 579674 T1765 C107 P29096 oass.SolrIndexSearcher.<init> Opening Searcher@45722108 main
[junit4:junit4] 2> 579675 T1762 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@45722108 main{StandardDirectoryReader(segments_4:1:nrt)}
[junit4:junit4] 2> 579675 T1765 C107 P29096 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty4/index.20130519122910951 [CachedDir<<refCount=0;path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty4/index.20130519122910951;done=true>>]
[junit4:junit4] 2> 579676 T1765 C107 P29096 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty4/index.20130519122910951
[junit4:junit4] 2> 579676 T1765 C107 P29096 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty4/index.20130519122910951
[junit4:junit4] 2> 579677 T1765 C107 P29096 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 579677 T1765 C107 P29096 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 579677 T1765 C107 P29096 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 579677 T1765 C107 P29096 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 579679 T1765 C107 P29096 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 580614 T1689 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 580615 T1689 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:29096__collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:29096_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:29096"}
[junit4:junit4] 2> 580631 T1688 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 580631 T1758 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 580631 T1708 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 580631 T1741 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 580631 T1724 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 580631 T1695 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 580634 T1666 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 580635 T1666 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> ASYNC NEW_CORE C108 name=collection1 org.apache.solr.core.SolrCore@707065d1 url=http://127.0.0.1:23198/collection1 node=127.0.0.1:23198_ C108_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:23198_, base_url=http://127.0.0.1:23198, leader=true}
[junit4:junit4] 2> 580647 T1678 C108 P23198 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 580653 T1678 C108 P23198 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@37e02801; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 580654 T1678 C108 P23198 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 580659 T1678 C108 P23198 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@37e02801; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@37e02801; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> 580659 T1678 C108 P23198 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 580661 T1678 C108 P23198 oass.SolrIndexSearcher.<init> Opening Searcher@55b2ffbc main
[junit4:junit4] 2> 580661 T1678 C108 P23198 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 580662 T1692 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@55b2ffbc main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 580663 T1678 C108 P23198 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 16
[junit4:junit4] 2> 580674 T1701 C106 P29060 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 580678 T1701 C106 P29060 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=4
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@d574714; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@d574714; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@d574714; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@d574714; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5}
[junit4:junit4] 2> 580679 T1701 C106 P29060 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 5
[junit4:junit4] 2> 580680 T1701 C106 P29060 oass.SolrIndexSearcher.<init> Opening Searcher@a59a2b7 main
[junit4:junit4] 2> 580681 T1701 C106 P29060 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 580681 T1710 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@a59a2b7 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 580682 T1701 C106 P29060 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:29086/collection1/, StdNode: http://127.0.0.1:29092/collection1/, StdNode: http://127.0.0.1:29096/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> C107_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:29096_, base_url=http://127.0.0.1:29096}
[junit4:junit4] 2> 580699 T1748 C107 P29096 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> C105_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:29092_, base_url=http://127.0.0.1:29092}
[junit4:junit4] 2> 580699 T1731 C105 P29092 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> C104_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:29086_, base_url=http://127.0.0.1:29086}
[junit4:junit4] 2> 580699 T1714 C104 P29086 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 580713 T1748 C107 P29096 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3c546362; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3c546362; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5}
[junit4:junit4] 2> 580714 T1748 C107 P29096 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 5
[junit4:junit4] 2> 580716 T1748 C107 P29096 oass.SolrIndexSearcher.<init> Opening Searcher@1b15d566 main
[junit4:junit4] 2> 580716 T1748 C107 P29096 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 580717 T1762 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1b15d566 main{StandardDirectoryReader(segments_4:1:nrt)}
[junit4:junit4] 2> 580717 T1748 C107 P29096 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 19
[junit4:junit4] 2> 580720 T1731 C105 P29092 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@61d59f38; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@61d59f38; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> 580720 T1714 C104 P29086 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@7d455745; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@7d455745; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> 580720 T1731 C105 P29092 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4:junit4] 2> 580721 T1714 C104 P29086 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 580723 T1731 C105 P29092 oass.SolrIndexSearcher.<init> Opening Searcher@38bb10ac main
[junit4:junit4] 2> 580723 T1714 C104 P29086 oass.SolrIndexSearcher.<init> Opening Searcher@11ffee1 main
[junit4:junit4] 2> 580724 T1731 C105 P29092 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 580724 T1714 C104 P29086 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 580724 T1743 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@38bb10ac main{StandardDirectoryReader(segments_3:1:nrt)}
[junit4:junit4] 2> 580725 T1726 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@11ffee1 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 580725 T1731 C105 P29092 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 26
[junit4:junit4] 2> 580725 T1714 C104 P29086 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 27
[junit4:junit4] 2> 580726 T1701 C106 P29060 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 52
[junit4:junit4] 2> 580727 T1666 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 580730 T1699 C106 P29060 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 580732 T1715 C104 P29086 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 580733 T1732 C105 P29092 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 580735 T1749 C107 P29096 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 582741 T1678 C108 P23198 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1435499447224107008)} 0 3
[junit4:junit4] 2> 582750 T1731 C105 P29092 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=FROMLEADER&_version_=-1435499447229349888&update.from=http://127.0.0.1:29060/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1435499447229349888)} 0 2
[junit4:junit4] 2> 582750 T1714 C104 P29086 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=FROMLEADER&_version_=-1435499447229349888&update.from=http://127.0.0.1:29060/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1435499447229349888)} 0 2
[junit4:junit4] 2> 582750 T1748 C107 P29096 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=FROMLEADER&_version_=-1435499447229349888&update.from=http://127.0.0.1:29060/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1435499447229349888)} 0 2
[junit4:junit4] 2> 582751 T1701 C106 P29060 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1435499447229349888)} 0 7
[junit4:junit4] 2> 582756 T1678 C108 P23198 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[0 (1435499447239835648)]} 0 2
[junit4:junit4] 2> 582765 T1714 C104 P29086 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:29060/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1435499447245078528)]} 0 2
[junit4:junit4] 2> 582766 T1748 C107 P29096 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:29060/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1435499447245078528)]} 0 2
[junit4:junit4] 2> 582765 T1731 C105 P29092 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:29060/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1435499447245078528)]} 0 2
[junit4:junit4] 2> 582767 T1701 C106 P29060 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[0 (1435499447245078528)]} 0 8
[junit4:junit4] 2> 582770 T1678 C108 P23198 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[1 (1435499447255564288)]} 0 1
[junit4:junit4] 2> 582776 T1731 C105 P29092 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:29060/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1435499447258710016)]} 0 1
[junit4:junit4] 2> 582776 T1714 C104 P29086 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:29060/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1435499447258710016)]} 0 1
[junit4:junit4] 2> 582776 T1748 C107 P29096 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:29060/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1435499447258710016)]} 0 1
[junit4:junit4] 2> 582777 T1701 C106 P29060 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[1 (1435499447258710016)]} 0 5
[junit4:junit4] 2> 582781 T1678 C108 P23198 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[2 (1435499447267098624)]} 0 1
[junit4:junit4] 2> 582783 T1701 C106 P29060 oasup.DistributedUpdateProcessor.setupRequest test.distrib.skip.servers was found and contains:[http://127.0.0.1:29086/collection1/]
[junit4:junit4] 2> 582784 T1701 C106 P29060 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:29086/collection1/ against:[http://127.0.0.1:29086/collection1/] result:true
[junit4:junit4] 2> 582784 T1701 C106 P29060 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:29092/collection1/ against:[http://127.0.0.1:29086/collection1/] result:false
[junit4:junit4] 2> 582784 T1701 C106 P29060 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:29096/collection1/ against:[http://127.0.0.1:29086/collection1/] result:false
[junit4:junit4] 2> 582789 T1748 C107 P29096 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:29060/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:29086/collection1/&wt=javabin&version=2} {add=[2 (1435499447272341504)]} 0 1
[junit4:junit4] 2> 582789 T1731 C105 P29092 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:29060/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:29086/collection1/&wt=javabin&version=2} {add=[2 (1435499447272341504)]} 0 1
[junit4:junit4] 2> 582790 T1701 C106 P29060 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={test.distrib.skip.servers=http://127.0.0.1:29086/collection1/&wt=javabin&version=2} {add=[2 (1435499447272341504)]} 0 7
[junit4:junit4] 2> 582794 T1678 C108 P23198 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[3 (1435499447280730112)]} 0 1
[junit4:junit4] 2> 582796 T1701 C106 P29060 oasup.DistributedUpdateProcessor.setupRequest test.distrib.skip.servers was found and contains:[http://127.0.0.1:29092/collection1/, http://127.0.0.1:29086/collection1/]
[junit4:junit4] 2> 582796 T1701 C106 P29060 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:29086/collection1/ against:[http://127.0.0.1:29092/collection1/, http://127.0.0.1:29086/collection1/] result:true
[junit4:junit4] 2> 582797 T1701 C106 P29060 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:29092/collection1/ against:[http://127.0.0.1:29092/collection1/, http://127.0.0.1:29086/collection1/] result:true
[junit4:junit4] 2> 582797 T1701 C106 P29060 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:29096/collection1/ against:[http://127.0.0.1:29092/collection1/, http://127.0.0.1:29086/collection1/] result:false
[junit4:junit4] 2> 582802 T1748 C107 P29096 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:29060/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:29086/collection1/&wt=javabin&version=2} {add=[3 (1435499447284924416)]} 0 1
[junit4:junit4] 2> 582802 T1701 C106 P29060 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={test.distrib.skip.servers=http://127.0.0.1:29086/collection1/&test.distrib.skip.servers=http://127.0.0.1:29092/collection1/&wt=javabin&version=2} {add=[3 (1435499447284924416)]} 0 6
[junit4:junit4] 2> 582805 T1678 C108 P23198 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 582886 T1678 C108 P23198 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@37e02801; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@37e02801; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> 582887 T1678 C108 P23198 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 582893 T1678 C108 P23198 oass.SolrIndexSearcher.<init> Opening Searcher@1f04a728 main
[junit4:junit4] 2> 582893 T1678 C108 P23198 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 582894 T1692 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1f04a728 main{StandardDirectoryReader(segments_3:3:nrt _0(4.4):C4)}
[junit4:junit4] 2> 582895 T1678 C108 P23198 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 90
[junit4:junit4] 2> 582897 T1701 C106 P29060 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 582943 T1701 C106 P29060 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=5
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@d574714; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@d574714; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@d574714; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@d574714; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@d574714; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_6,generation=6}
[junit4:junit4] 2> 582944 T1701 C106 P29060 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 6
[junit4:junit4] 2> 582949 T1701 C106 P29060 oass.SolrIndexSearcher.<init> Opening Searcher@495d6295 main
[junit4:junit4] 2> 582950 T1701 C106 P29060 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 582950 T1710 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@495d6295 main{StandardDirectoryReader(segments_6:3:nrt _0(4.4):C4)}
[junit4:junit4] 2> 582951 T1701 C106 P29060 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:29086/collection1/, StdNode: http://127.0.0.1:29092/collection1/, StdNode: http://127.0.0.1:29096/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 582952 T1731 C105 P29092 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 582954 T1748 C107 P29096 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 582954 T1714 C104 P29086 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 583055 T1731 C105 P29092 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@61d59f38; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@61d59f38; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5}
[junit4:junit4] 2> 583056 T1731 C105 P29092 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 5
[junit4:junit4] 2> 583057 T1748 C107 P29096 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3c546362; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3c546362; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_6,generation=6}
[junit4:junit4] 2> 583057 T1748 C107 P29096 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 6
[junit4:junit4] 2> 583057 T1714 C104 P29086 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@7d455745; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@7d455745; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> 583058 T1714 C104 P29086 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4:junit4] 2> 583063 T1731 C105 P29092 oass.SolrIndexSearcher.<init> Opening Searcher@119d4893 main
[junit4:junit4] 2> 583063 T1731 C105 P29092 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 583064 T1743 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@119d4893 main{StandardDirectoryReader(segments_5:3:nrt _0(4.4):C3)}
[junit4:junit4] 2> 583064 T1731 C105 P29092 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 112
[junit4:junit4] 2> 583065 T1748 C107 P29096 oass.SolrIndexSearcher.<init> Opening Searcher@297985b0 main
[junit4:junit4] 2> 583066 T1714 C104 P29086 oass.SolrIndexSearcher.<init> Opening Searcher@7dfb3a32 main
[junit4:junit4] 2> 583066 T1748 C107 P29096 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 583066 T1714 C104 P29086 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 583066 T1762 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@297985b0 main{StandardDirectoryReader(segments_6:3:nrt _0(4.4):C4)}
[junit4:junit4] 2> 583067 T1726 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7dfb3a32 main{StandardDirectoryReader(segments_4:3:nrt _0(4.4):C2)}
[junit4:junit4] 2> 583067 T1748 C107 P29096 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 113
[junit4:junit4] 2> 583067 T1714 C104 P29086 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 113
[junit4:junit4] 2> 583068 T1701 C106 P29060 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 171
[junit4:junit4] 2> 583069 T1666 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):230
[junit4:junit4] 2> 583070 T1666 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 583071 T1666 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> 583073 T1699 C106 P29060 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=0
[junit4:junit4] 2> 583076 T1715 C104 P29086 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=2 status=0 QTime=0
[junit4:junit4] 2> 583079 T1732 C105 P29092 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=3 status=0 QTime=0
[junit4:junit4] 2> 583082 T1749 C107 P29096 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=0
[junit4:junit4] 2> 583083 T1666 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 583099 T1733 oasha.CollectionsHandler.handleSyncShardAction Syncing shard : shard=shard1&action=SYNCSHARD&collection=collection1&wt=javabin&version=2
[junit4:junit4] 2> 583100 T1733 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 583110 T1703 oasha.CoreAdminHandler.handleRequestSyncAction I have been requested to sync up my shard
[junit4:junit4] 2> 583111 T1703 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:29060/collection1/
[junit4:junit4] 2> 583111 T1703 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:29060 START replicas=[http://127.0.0.1:29086/collection1/, http://127.0.0.1:29092/collection1/, http://127.0.0.1:29096/collection1/] nUpdates=100
[junit4:junit4] 2> 583113 T1716 C104 P29086 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 583113 T1750 C107 P29096 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 583113 T1734 C105 P29092 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 583113 T1703 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:29060 Received 3 versions from 127.0.0.1:29086/collection1/
[junit4:junit4] 2> 583114 T1703 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:29060 Our versions are newer. ourLowThreshold=1435499447229349888 otherHigh=1435499447258710016
[junit4:junit4] 2> 583114 T1703 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:29060 Received 5 versions from 127.0.0.1:29096/collection1/
[junit4:junit4] 2> 583115 T1703 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:29060 Our versions are newer. ourLowThreshold=1435499447229349888 otherHigh=1435499447272341504
[junit4:junit4] 2> 583115 T1703 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:29060 Received 4 versions from 127.0.0.1:29092/collection1/
[junit4:junit4] 2> 583116 T1703 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:29060 Our versions are newer. ourLowThreshold=1435499447229349888 otherHigh=1435499447272341504
[junit4:junit4] 2> 583116 T1703 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:29060 DONE. sync succeeded
[junit4:junit4] 2> 583116 T1703 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 583117 T1703 oasc.SyncStrategy.syncToMe http://127.0.0.1:29060/collection1/: try and ask http://127.0.0.1:29086/collection1/ to sync
[junit4:junit4] 2> 583117 T1703 oasc.SyncStrategy.syncToMe http://127.0.0.1:29060/collection1/: try and ask http://127.0.0.1:29092/collection1/ to sync
[junit4:junit4] 2> 583117 T1703 oasc.SyncStrategy.syncToMe http://127.0.0.1:29060/collection1/: try and ask http://127.0.0.1:29096/collection1/ to sync
[junit4:junit4] 2> 583118 T1717 C104 P29086 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:29086 START replicas=[http://127.0.0.1:29060/collection1/] nUpdates=100
[junit4:junit4] 2> 583118 T1735 C105 P29092 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:29092 START replicas=[http://127.0.0.1:29060/collection1/] nUpdates=100
[junit4:junit4] 2> 583119 T1751 C107 P29096 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:29096 START replicas=[http://127.0.0.1:29060/collection1/] nUpdates=100
[junit4:junit4] 2> 583120 T1704 C106 P29060 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 583120 T1698 C106 P29060 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 583120 T1735 C105 P29092 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:29092 Received 5 versions from 127.0.0.1:29060/collection1/
[junit4:junit4] 2> 583121 T1700 C106 P29060 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 583121 T1735 C105 P29092 oasu.PeerSync.requestUpdates PeerSync: core=collection1 url=http://127.0.0.1:29092 Requesting updates from 127.0.0.1:29060/collection1/n=1 versions=[1435499447284924416]
[junit4:junit4] 2> 583121 T1751 C107 P29096 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:29096 Received 5 versions from 127.0.0.1:29060/collection1/
[junit4:junit4] 2> 583122 T1717 C104 P29086 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:29086 Received 5 versions from 127.0.0.1:29060/collection1/
[junit4:junit4] 2> 583122 T1751 C107 P29096 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:29096 Our versions are newer. ourLowThreshold=1435499447229349888 otherHigh=1435499447272341504
[junit4:junit4] 2> 583123 T1717 C104 P29086 oasu.PeerSync.requestUpdates PeerSync: core=collection1 url=http://127.0.0.1:29086 Requesting updates from 127.0.0.1:29060/collection1/n=2 versions=[1435499447284924416, 1435499447272341504]
[junit4:junit4] 2> 583123 T1700 C106 P29060 oasc.SolrCore.execute [collection1] webapp= path=/get params={distrib=false&getUpdates=1435499447284924416&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 583123 T1751 C107 P29096 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:29096 DONE. sync succeeded
[junit4:junit4] 2> 583124 T1751 C107 P29096 oasc.SolrCore.execute [collection1] webapp= path=/get params={sync=http://127.0.0.1:29060/collection1/&getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=5
[junit4:junit4] 2> 583125 T1703 oasc.SyncStrategy.syncToMe http://127.0.0.1:29060/collection1/: sync completed with http://127.0.0.1:29096/collection1/
[junit4:junit4] 2> 583126 T1698 C106 P29060 oasc.SolrCore.execute [collection1] webapp= path=/get params={distrib=false&getUpdates=1435499447284924416,1435499447272341504&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 583128 T1735 C105 P29092 oasup.LogUpdateProcessor.finish [collection1] {add=[3 (1435499447284924416)]} 0 4
[junit4:junit4] 2> 583129 T1735 C105 P29092 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:29092 DONE. sync succeeded
[junit4:junit4] 2> 583129 T1735 C105 P29092 oasc.SolrCore.execute [collection1] webapp= path=/get params={sync=http://127.0.0.1:29060/collection1/&getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=11
[junit4:junit4] 2> 583129 T1703 oasc.SyncStrategy.syncToMe http://127.0.0.1:29060/collection1/: sync completed with http://127.0.0.1:29092/collection1/
[junit4:junit4] 2> 583131 T1717 C104 P29086 oasup.LogUpdateProcessor.finish [collection1] {add=[2 (1435499447272341504), 3 (1435499447284924416)]} 0 4
[junit4:junit4] 2> 583131 T1717 C104 P29086 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:29086 DONE. sync succeeded
[junit4:junit4] 2> 583131 T1717 C104 P29086 oasc.SolrCore.execute [collection1] webapp= path=/get params={sync=http://127.0.0.1:29060/collection1/&getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=13
[junit4:junit4] 2> 583132 T1703 oasc.SyncStrategy.syncToMe http://127.0.0.1:29060/collection1/: sync completed with http://127.0.0.1:29086/collection1/
[junit4:junit4] 2> 583132 T1703 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={shard=shard1&action=REQUESTSYNCSHARD&core=collection1&collection=collection1&wt=javabin&version=2} status=0 QTime=22
[junit4:junit4] 2> 583133 T1733 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/collections params={shard=shard1&action=SYNCSHARD&collection=collection1&wt=javabin&version=2} status=0 QTime=34
[junit4:junit4] 2> 583133 T1666 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 2> 583134 T1666 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 2> 583135 T1666 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 583136 T1666 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> 583138 T1678 C108 P23198 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 583160 T1678 C108 P23198 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@37e02801; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@37e02801; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> 583160 T1678 C108 P23198 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4:junit4] 2> 583162 T1678 C108 P23198 oass.SolrIndexSearcher.<init> Opening Searcher@3800a4c8 main
[junit4:junit4] 2> 583163 T1678 C108 P23198 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 583164 T1692 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3800a4c8 main{StandardDirectoryReader(segments_3:3:nrt _0(4.4):C4)}
[junit4:junit4] 2> 583164 T1678 C108 P23198 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 26
[junit4:junit4] 2> 583167 T1701 C106 P29060 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 583180 T1701 C106 P29060 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=4
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@d574714; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@d574714; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@d574714; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_6,generation=6}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@d574714; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_7,generation=7}
[junit4:junit4] 2> 583180 T1701 C106 P29060 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 7
[junit4:junit4] 2> 583182 T1701 C106 P29060 oass.SolrIndexSearcher.<init> Opening Searcher@247e3fbe main
[junit4:junit4] 2> 583182 T1701 C106 P29060 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 583183 T1710 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@247e3fbe main{StandardDirectoryReader(segments_6:3:nrt _0(4.4):C4)}
[junit4:junit4] 2> 583184 T1701 C106 P29060 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:29086/collection1/, StdNode: http://127.0.0.1:29092/collection1/, StdNode: http://127.0.0.1:29096/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 583186 T1748 C107 P29096 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 583186 T1731 C105 P29092 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 583186 T1714 C104 P29086 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 583198 T1748 C107 P29096 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3c546362; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_6,generation=6}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3c546362; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_7,generation=7}
[junit4:junit4] 2> 583199 T1748 C107 P29096 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 7
[junit4:junit4] 2> 583201 T1748 C107 P29096 oass.SolrIndexSearcher.<init> Openi
[...truncated too long message...]
tp://127.0.0.1:29096 couldn't connect to http://127.0.0.1:29092/collection1/, counting as success
[junit4:junit4] 2> 1422959 T1758 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:29096 DONE. sync succeeded
[junit4:junit4] 2> 1422959 T1758 oasc.SyncStrategy.syncReplicas We have been closed, won't attempt to sync replicas back to leader
[junit4:junit4] 2> 1422960 T1758 oasc.ShardLeaderElectionContext.runLeaderProcess Sync was not a success but no one else is active! I am the leader
[junit4:junit4] 2> 1422960 T1758 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:29096/collection1/
[junit4:junit4] 2> 1422960 T1758 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@7661e50f
[junit4:junit4] 2> 1422961 T1758 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=51,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=5,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0}
[junit4:junit4] 2> 1422962 T1758 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 1422962 T1758 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 1422962 T1758 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 1422966 T1758 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 1422967 T1758 oasc.CachingDirectoryFactory.close Closing NRTCachingDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 1422967 T1758 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty4/index [CachedDir<<refCount=0;path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty4/index;done=false>>]
[junit4:junit4] 2> 1422967 T1758 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty4/index
[junit4:junit4] 2> 1422967 T1758 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty4 [CachedDir<<refCount=0;path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty4;done=false>>]
[junit4:junit4] 2> 1422968 T1758 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1368998928209/jetty4
[junit4:junit4] 2> 1422968 T1758 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 1422968 T1758 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election/89718713759629324-127.0.0.1:29096__collection1-n_0000000006
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4] 2> at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:152)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:149)
[junit4:junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:149)
[junit4:junit4] 2> at org.apache.solr.cloud.ElectionContext.cancelElection(ElectionContext.java:63)
[junit4:junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:260)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:156)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:100)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4] 2>
[junit4:junit4] 2> 1422969 T1758 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:235)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:232)
[junit4:junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:232)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:84)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4] 2>
[junit4:junit4] 2> 1422970 T1758 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1422970 T1758 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 1422970 T1758 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> NOTE: test params are: codec=Appending, sim=RandomSimilarityProvider(queryNorm=false,coord=no): {}, locale=sr, timezone=Etc/GMT+9
[junit4:junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Sun Microsystems Inc. 1.6.0_32 (64-bit)/cpus=16,threads=4,free=240217240,total=371261440
[junit4:junit4] 2> NOTE: All tests run in this JVM: [TestSolrCoreProperties, PreAnalyzedFieldTest, TestManagedSchemaFieldResource, TestPluginEnable, TestClassNameShortening, TestConfig, PolyFieldTest, LeaderElectionTest, TestStressRecovery, ZkControllerTest, TestPHPSerializedResponseWriter, WordBreakSolrSpellCheckerTest, DistributedQueryElevationComponentTest, SolrInfoMBeanTest, UpdateRequestProcessorFactoryTest, AutoCommitTest, CSVRequestHandlerTest, IndexSchemaTest, ShowFileRequestHandlerTest, TestValueSourceCache, TestBadConfig, TestRealTimeGet, PluginInfoTest, PeerSyncTest, DistributedSpellCheckComponentTest, TestSchemaResource, RAMDirectoryFactoryTest, TestFieldCollectionResource, TestExtendedDismaxParser, SuggesterFSTTest, TestQuerySenderListener, TestJoin, TestSurroundQueryParser, AliasIntegrationTest, PrimUtilsTest, UUIDFieldTest, TestDynamicFieldResource, TestLFUCache, TestPerFieldSimilarity, TestSerializedLuceneMatchVersion, TestGroupingSearch, PrimitiveFieldTypeTest, BadComponentTest, SpatialFilterTest, SchemaVersionSpecificBehaviorTest, BasicDistributedZkTest, TestCharFilters, DirectUpdateHandlerOptimizeTest, TestPhraseSuggestions, DirectSolrConnectionTest, ExternalFileFieldSortTest, TestStressVersions, FileBasedSpellCheckerTest, SuggesterTest, TestLRUCache, TestSolrQueryParser, TestCollationKeyRangeQueries, QueryResultKeyTest, DocumentBuilderTest, QueryElevationComponentTest, LegacyHTMLStripCharFilterTest, SyncSliceTest]
[junit4:junit4] Completed on J0 in 866.87s, 1 test, 1 failure <<< FAILURES!
[...truncated 483 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/build.xml:383: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/build.xml:363: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build.xml:181: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/common-build.xml:437: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/common-build.xml:1243: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/common-build.xml:887: There were test failures: 296 suites, 1234 tests, 1 failure, 27 ignored (8 assumptions)
Total time: 55 minutes 57 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure