You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2013/06/27 01:09:30 UTC
[JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.8.0-ea-b94) - Build #
6325 - Failure!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/6325/
Java: 32bit/jdk1.8.0-ea-b94 -server -XX:+UseSerialGC
3 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.hdfs.HdfsUnloadDistributedZkTest
Error Message:
FIXME: This test fails under Java 8 all the time, see SOLR-4711
Stack Trace:
com.carrotsearch.randomizedtesting.InternalAssumptionViolatedException: FIXME: This test fails under Java 8 all the time, see SOLR-4711
at __randomizedtesting.SeedInfo.seed([7CA5FD4E6AE27A7]:0)
at com.carrotsearch.randomizedtesting.RandomizedTest.assumeTrue(RandomizedTest.java:598)
at com.carrotsearch.randomizedtesting.RandomizedTest.assumeFalse(RandomizedTest.java:606)
at org.apache.lucene.util.LuceneTestCase.assumeFalse(LuceneTestCase.java:672)
at org.apache.solr.cloud.UnloadDistributedZkTest.beforeThisClass3(UnloadDistributedZkTest.java:54)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:491)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:677)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:724)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.hdfs.HdfsUnloadDistributedZkTest
Error Message:
Can't set default locale to NULL
Stack Trace:
java.lang.NullPointerException: Can't set default locale to NULL
at __randomizedtesting.SeedInfo.seed([7CA5FD4E6AE27A7]:0)
at java.util.Locale.setDefault(Locale.java:971)
at java.util.Locale.setDefault(Locale.java:933)
at org.apache.solr.cloud.hdfs.HdfsTestUtil.teardownClass(HdfsTestUtil.java:69)
at org.apache.solr.cloud.hdfs.HdfsUnloadDistributedZkTest.teardownClass(HdfsUnloadDistributedZkTest.java:48)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:491)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:700)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:724)
REGRESSION: org.apache.solr.cloud.SyncSliceTest.testDistribSearch
Error Message:
shard1 is not consistent. Got 305 from http://127.0.0.1:35711/us/dl/collection1lastClient and got 250 from http://127.0.0.1:40897/us/dl/collection1
Stack Trace:
java.lang.AssertionError: shard1 is not consistent. Got 305 from http://127.0.0.1:35711/us/dl/collection1lastClient and got 250 from http://127.0.0.1:40897/us/dl/collection1
at __randomizedtesting.SeedInfo.seed([7CA5FD4E6AE27A7:862CD1CC91F1479B]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1045)
at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:237)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:491)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:724)
Build Log:
[...truncated 9181 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.hdfs.HdfsUnloadDistributedZkTest
[junit4:junit4] 2> log4j:WARN No such property [conversionPattern] in org.apache.solr.util.SolrLogLayout.
[junit4:junit4] 2> 734 T10 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4] 2> 747 T10 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> NOTE: test params are: codec=DummyCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=DUMMY, chunkSize=388), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=DUMMY, chunkSize=388)), sim=DefaultSimilarity, locale=it_CH, timezone=America/Hermosillo
[junit4:junit4] 2> NOTE: Linux 3.2.0-48-generic i386/Oracle Corporation 1.8.0-ea (32-bit)/cpus=8,threads=1,free=56375784,total=64880640
[junit4:junit4] 2> NOTE: All tests run in this JVM: [HdfsUnloadDistributedZkTest]
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=HdfsUnloadDistributedZkTest -Dtests.seed=7CA5FD4E6AE27A7 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=it_CH -Dtests.timezone=America/Hermosillo -Dtests.file.encoding=UTF-8
[junit4:junit4] ERROR 0.00s J0 | HdfsUnloadDistributedZkTest (suite) <<<
[junit4:junit4] > Assumption #1: FIXME: This test fails under Java 8 all the time, see SOLR-4711Throwable #2: java.lang.NullPointerException: Can't set default locale to NULL
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([7CA5FD4E6AE27A7]:0)
[junit4:junit4] > at java.util.Locale.setDefault(Locale.java:971)
[junit4:junit4] > at java.util.Locale.setDefault(Locale.java:933)
[junit4:junit4] > at org.apache.solr.cloud.hdfs.HdfsTestUtil.teardownClass(HdfsTestUtil.java:69)
[junit4:junit4] > at org.apache.solr.cloud.hdfs.HdfsUnloadDistributedZkTest.teardownClass(HdfsUnloadDistributedZkTest.java:48)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:724)
[junit4:junit4] Completed on J0 in 1.07s, 0 tests, 1 error <<< FAILURES!
[...truncated 413 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.SyncSliceTest
[junit4:junit4] 2> 474485 T3373 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /us/dl
[junit4:junit4] 2> 474504 T3373 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-SyncSliceTest-1372287629334
[junit4:junit4] 2> 474505 T3373 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 474505 T3374 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 474605 T3373 oasc.ZkTestServer.run start zk server on port:41964
[junit4:junit4] 2> 474606 T3373 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 474711 T3380 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1573e33 name:ZooKeeperConnection Watcher:127.0.0.1:41964 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 474711 T3373 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 474712 T3373 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 474716 T3373 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 474717 T3382 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@190dae9 name:ZooKeeperConnection Watcher:127.0.0.1:41964/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 474718 T3373 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 474718 T3373 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 474720 T3373 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 474722 T3373 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 474724 T3373 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 474726 T3373 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 474727 T3373 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 474731 T3373 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 474731 T3373 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 474734 T3373 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 474735 T3373 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 474737 T3373 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 474737 T3373 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 474741 T3373 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 474742 T3373 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 474745 T3373 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 474745 T3373 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 474747 T3373 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 474748 T3373 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 474750 T3373 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 474751 T3373 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 474753 T3373 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 474754 T3373 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 474851 T3373 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 474855 T3373 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:45318
[junit4:junit4] 2> 474855 T3373 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 474856 T3373 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 474856 T3373 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1372287629585
[junit4:junit4] 2> 474856 T3373 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1372287629585/solr.xml
[junit4:junit4] 2> 474857 T3373 oasc.CoreContainer.<init> New CoreContainer 31038023
[junit4:junit4] 2> 474857 T3373 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1372287629585/'
[junit4:junit4] 2> 474857 T3373 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1372287629585/'
[junit4:junit4] 2> 474924 T3373 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 474925 T3373 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 474925 T3373 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 474926 T3373 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 474926 T3373 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 474927 T3373 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 474927 T3373 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 474928 T3373 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 474928 T3373 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 474928 T3373 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 474931 T3373 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 474932 T3373 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:41964/solr
[junit4:junit4] 2> 474932 T3373 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 474933 T3373 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 474934 T3393 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6b99d3 name:ZooKeeperConnection Watcher:127.0.0.1:41964 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 474934 T3373 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 474936 T3373 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 474938 T3373 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 474940 T3395 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@179382c name:ZooKeeperConnection Watcher:127.0.0.1:41964/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 474940 T3373 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 474942 T3373 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 474945 T3373 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 474953 T3373 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 474955 T3373 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45318_us%2Fdl
[junit4:junit4] 2> 474956 T3373 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:45318_us%2Fdl
[junit4:junit4] 2> 474958 T3373 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 474963 T3373 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 474970 T3373 oasc.Overseer.start Overseer (id=89934242076164099-127.0.0.1:45318_us%2Fdl-n_0000000000) starting
[junit4:junit4] 2> 474973 T3373 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 474977 T3397 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 474978 T3373 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 474981 T3373 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 474982 T3373 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 474987 T3396 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 474989 T3398 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 474990 T3398 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 474991 T3398 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4:junit4] 2> 476491 T3396 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 476492 T3396 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"core_node1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:45318_us%2Fdl",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:45318/us/dl"}
[junit4:junit4] 2> 476492 T3396 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 476492 T3396 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 476494 T3395 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 476991 T3398 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4:junit4] 2> 476992 T3398 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1372287629585/collection1
[junit4:junit4] 2> 476992 T3398 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 476993 T3398 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 476993 T3398 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 476994 T3398 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1372287629585/collection1/'
[junit4:junit4] 2> 476995 T3398 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1372287629585/collection1/lib/README' to classloader
[junit4:junit4] 2> 476995 T3398 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1372287629585/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 477026 T3398 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 477060 T3398 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 477062 T3398 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 477065 T3398 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 477464 T3398 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 477470 T3398 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 477473 T3398 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 477486 T3398 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 477489 T3398 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 477492 T3398 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 477493 T3398 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 477493 T3398 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 477494 T3398 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 477494 T3398 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 477495 T3398 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 477495 T3398 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 477495 T3398 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1372287629585/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1372287629333/control/data/
[junit4:junit4] 2> 477495 T3398 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6652b6
[junit4:junit4] 2> 477496 T3398 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1372287629333/control/data
[junit4:junit4] 2> 477496 T3398 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1372287629333/control/data/index/
[junit4:junit4] 2> 477496 T3398 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1372287629333/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 477496 T3398 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1372287629333/control/data/index
[junit4:junit4] 2> 477498 T3398 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@87873b lockFactory=org.apache.lucene.store.NativeFSLockFactory@1362817),segFN=segments_1,generation=1}
[junit4:junit4] 2> 477498 T3398 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 477499 T3398 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 477500 T3398 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 477500 T3398 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 477500 T3398 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 477501 T3398 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 477501 T3398 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 477501 T3398 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 477501 T3398 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 477502 T3398 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 477503 T3398 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 477505 T3398 oass.SolrIndexSearcher.<init> Opening Searcher@14fe04d main
[junit4:junit4] 2> 477506 T3398 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 477506 T3398 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 477509 T3399 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@14fe04d main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 477510 T3398 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 477510 T3398 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:45318/us/dl collection:control_collection shard:shard1
[junit4:junit4] 2> 477511 T3398 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 477519 T3398 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4:junit4] 2> 477521 T3398 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 477521 T3398 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 477522 T3398 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:45318/us/dl/collection1/
[junit4:junit4] 2> 477522 T3398 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 477522 T3398 oasc.SyncStrategy.syncToMe http://127.0.0.1:45318/us/dl/collection1/ has no replicas
[junit4:junit4] 2> 477522 T3398 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:45318/us/dl/collection1/ shard1
[junit4:junit4] 2> 477522 T3398 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 477997 T3396 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 478002 T3395 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 478029 T3398 oasc.ZkController.register We are http://127.0.0.1:45318/us/dl/collection1/ and leader is http://127.0.0.1:45318/us/dl/collection1/
[junit4:junit4] 2> 478030 T3398 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:45318/us/dl
[junit4:junit4] 2> 478030 T3398 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 478030 T3398 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 478030 T3398 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 478031 T3398 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 478032 T3373 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 478033 T3373 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 478033 T3373 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 478036 T3373 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 478037 T3373 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 478038 T3402 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f7eb06 name:ZooKeeperConnection Watcher:127.0.0.1:41964/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 478039 T3373 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 478039 T3373 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 478041 T3373 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 478132 T3373 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 478133 T3373 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:35711
[junit4:junit4] 2> 478134 T3373 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 478134 T3373 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 478135 T3373 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1372287632871
[junit4:junit4] 2> 478135 T3373 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1372287632871/solr.xml
[junit4:junit4] 2> 478135 T3373 oasc.CoreContainer.<init> New CoreContainer 20012095
[junit4:junit4] 2> 478136 T3373 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1372287632871/'
[junit4:junit4] 2> 478136 T3373 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1372287632871/'
[junit4:junit4] 2> 478183 T3373 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 478183 T3373 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 478184 T3373 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 478184 T3373 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 478184 T3373 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 478185 T3373 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 478185 T3373 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 478185 T3373 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 478186 T3373 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 478186 T3373 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 478190 T3373 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 478191 T3373 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:41964/solr
[junit4:junit4] 2> 478191 T3373 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 478192 T3373 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 478193 T3413 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6e23da name:ZooKeeperConnection Watcher:127.0.0.1:41964 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 478193 T3373 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 478194 T3373 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 478197 T3373 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 478199 T3415 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@19d6811 name:ZooKeeperConnection Watcher:127.0.0.1:41964/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 478199 T3373 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 478202 T3373 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 479204 T3373 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35711_us%2Fdl
[junit4:junit4] 2> 479206 T3373 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:35711_us%2Fdl
[junit4:junit4] 2> 479208 T3395 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 479208 T3402 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 479208 T3415 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 479209 T3395 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 479213 T3416 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 479213 T3416 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 479214 T3416 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4:junit4] 2> 479507 T3396 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 479508 T3396 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"core_node1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:45318_us%2Fdl",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:45318/us/dl"}
[junit4:junit4] 2> 479510 T3396 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"core_node1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:35711_us%2Fdl",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:35711/us/dl"}
[junit4:junit4] 2> 479510 T3396 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 1
[junit4:junit4] 2> 479511 T3396 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 479514 T3402 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 479514 T3415 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 479514 T3395 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 480214 T3416 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4:junit4] 2> 480215 T3416 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1372287632871/collection1
[junit4:junit4] 2> 480215 T3416 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 480215 T3416 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 480216 T3416 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 480217 T3416 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1372287632871/collection1/'
[junit4:junit4] 2> 480217 T3416 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty1-1372287632871/collection1/lib/README' to classloader
[junit4:junit4] 2> 480218 T3416 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty1-1372287632871/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 480248 T3416 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 480298 T3416 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 480300 T3416 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 480303 T3416 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 480684 T3416 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 480690 T3416 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 480692 T3416 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 480706 T3416 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 480708 T3416 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 480711 T3416 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 480712 T3416 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 480712 T3416 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 480713 T3416 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 480713 T3416 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 480714 T3416 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 480714 T3416 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 480714 T3416 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1372287632871/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1372287629333/jetty1/
[junit4:junit4] 2> 480714 T3416 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6652b6
[junit4:junit4] 2> 480715 T3416 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1372287629333/jetty1
[junit4:junit4] 2> 480715 T3416 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1372287629333/jetty1/index/
[junit4:junit4] 2> 480715 T3416 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1372287629333/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 480716 T3416 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1372287629333/jetty1/index
[junit4:junit4] 2> 480717 T3416 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1377ac4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@122d2d4),segFN=segments_1,generation=1}
[junit4:junit4] 2> 480717 T3416 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 480719 T3416 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 480719 T3416 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 480720 T3416 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 480720 T3416 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 480720 T3416 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 480721 T3416 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 480721 T3416 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 480721 T3416 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 480722 T3416 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 480723 T3416 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 480726 T3416 oass.SolrIndexSearcher.<init> Opening Searcher@2f393d main
[junit4:junit4] 2> 480727 T3416 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 480727 T3416 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 480730 T3417 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2f393d main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 480732 T3416 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 480732 T3416 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:35711/us/dl collection:collection1 shard:shard1
[junit4:junit4] 2> 480733 T3416 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 480737 T3416 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4:junit4] 2> 480739 T3416 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 480739 T3416 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 480739 T3416 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:35711/us/dl/collection1/
[junit4:junit4] 2> 480740 T3416 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 480740 T3416 oasc.SyncStrategy.syncToMe http://127.0.0.1:35711/us/dl/collection1/ has no replicas
[junit4:junit4] 2> 480740 T3416 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:35711/us/dl/collection1/ shard1
[junit4:junit4] 2> 480740 T3416 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 481018 T3396 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 481023 T3395 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 481023 T3415 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 481023 T3402 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 481046 T3416 oasc.ZkController.register We are http://127.0.0.1:35711/us/dl/collection1/ and leader is http://127.0.0.1:35711/us/dl/collection1/
[junit4:junit4] 2> 481046 T3416 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:35711/us/dl
[junit4:junit4] 2> 481046 T3416 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 481046 T3416 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 481047 T3416 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 481048 T3416 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 481049 T3373 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 481049 T3373 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 481050 T3373 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 481119 T3373 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 481120 T3373 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:34479
[junit4:junit4] 2> 481121 T3373 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 481121 T3373 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 481121 T3373 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1372287635882
[junit4:junit4] 2> 481122 T3373 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1372287635882/solr.xml
[junit4:junit4] 2> 481122 T3373 oasc.CoreContainer.<init> New CoreContainer 21929590
[junit4:junit4] 2> 481122 T3373 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1372287635882/'
[junit4:junit4] 2> 481123 T3373 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1372287635882/'
[junit4:junit4] 2> 481173 T3373 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 481173 T3373 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 481174 T3373 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 481174 T3373 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 481174 T3373 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 481175 T3373 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 481175 T3373 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 481175 T3373 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 481175 T3373 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 481176 T3373 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 481179 T3373 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 481179 T3373 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:41964/solr
[junit4:junit4] 2> 481180 T3373 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 481180 T3373 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 481182 T3429 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@106d5f0 name:ZooKeeperConnection Watcher:127.0.0.1:41964 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 481182 T3373 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 481184 T3373 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 481188 T3373 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 481190 T3431 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@afc5a0 name:ZooKeeperConnection Watcher:127.0.0.1:41964/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 481190 T3373 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 481193 T3373 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 482196 T3373 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34479_us%2Fdl
[junit4:junit4] 2> 482197 T3373 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:34479_us%2Fdl
[junit4:junit4] 2> 482199 T3395 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 482199 T3415 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 482200 T3402 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 482200 T3402 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 482201 T3431 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 482202 T3395 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 482202 T3415 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 482205 T3432 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 482205 T3432 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 482206 T3432 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4:junit4] 2> 482527 T3396 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 482528 T3396 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"core_node1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:35711_us%2Fdl",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:35711/us/dl"}
[junit4:junit4] 2> 482531 T3396 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"core_node2",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:34479_us%2Fdl",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:34479/us/dl"}
[junit4:junit4] 2> 482531 T3396 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 482531 T3396 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 482533 T3402 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 482533 T3431 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 482533 T3415 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 482533 T3395 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 483206 T3432 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4:junit4] 2> 483207 T3432 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1372287635882/collection1
[junit4:junit4] 2> 483207 T3432 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 483208 T3432 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 483208 T3432 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 483209 T3432 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1372287635882/collection1/'
[junit4:junit4] 2> 483210 T3432 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty2-1372287635882/collection1/lib/README' to classloader
[junit4:junit4] 2> 483210 T3432 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty2-1372287635882/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 483241 T3432 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 483271 T3432 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 483273 T3432 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 483276 T3432 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 483650 T3432 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 483659 T3432 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 483662 T3432 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 483675 T3432 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 483677 T3432 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 483680 T3432 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 483681 T3432 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 483681 T3432 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 483681 T3432 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 483682 T3432 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 483682 T3432 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 483682 T3432 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 483682 T3432 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1372287635882/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1372287629333/jetty2/
[junit4:junit4] 2> 483683 T3432 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6652b6
[junit4:junit4] 2> 483683 T3432 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1372287629333/jetty2
[junit4:junit4] 2> 483683 T3432 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1372287629333/jetty2/index/
[junit4:junit4] 2> 483684 T3432 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1372287629333/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 483684 T3432 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1372287629333/jetty2/index
[junit4:junit4] 2> 483685 T3432 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1e1c9c1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@846e50),segFN=segments_1,generation=1}
[junit4:junit4] 2> 483685 T3432 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 483687 T3432 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 483687 T3432 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 483688 T3432 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 483688 T3432 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 483688 T3432 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 483689 T3432 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 483689 T3432 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 483689 T3432 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 483690 T3432 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 483691 T3432 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 483693 T3432 oass.SolrIndexSearcher.<init> Opening Searcher@1e7a1f9 main
[junit4:junit4] 2> 483694 T3432 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 483694 T3432 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 483699 T3433 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1e7a1f9 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 483701 T3432 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 483701 T3432 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:34479/us/dl collection:collection1 shard:shard1
[junit4:junit4] 2> 483704 T3432 oasc.ZkController.register We are http://127.0.0.1:34479/us/dl/collection1/ and leader is http://127.0.0.1:35711/us/dl/collection1/
[junit4:junit4] 2> 483704 T3432 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:34479/us/dl
[junit4:junit4] 2> 483704 T3432 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 483704 T3432 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C2622 name=collection1 org.apache.solr.core.SolrCore@f6c3fe url=http://127.0.0.1:34479/us/dl/collection1 node=127.0.0.1:34479_us%2Fdl C2622_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, node_name=127.0.0.1:34479_us%2Fdl, base_url=http://127.0.0.1:34479/us/dl}
[junit4:junit4] 2> 483705 T3434 C2622 P34479 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 483705 T3432 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 483705 T3434 C2622 P34479 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 483706 T3434 C2622 P34479 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 483706 T3434 C2622 P34479 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 483707 T3373 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 483707 T3373 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 483707 T3434 C2622 P34479 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 483708 T3373 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 483713 T3411 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: core_node2, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 483783 T3373 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 483785 T3373 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:40897
[junit4:junit4] 2> 483785 T3373 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 483786 T3373 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 483786 T3373 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1372287638540
[junit4:junit4] 2> 483787 T3373 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1372287638540/solr.xml
[junit4:junit4] 2> 483787 T3373 oasc.CoreContainer.<init> New CoreContainer 6329101
[junit4:junit4] 2> 483788 T3373 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1372287638540/'
[junit4:junit4] 2> 483788 T3373 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1372287638540/'
[junit4:junit4] 2> 483830 T3373 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 483830 T3373 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 483831 T3373 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 483831 T3373 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 483831 T3373 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 483832 T3373 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 483832 T3373 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 483832 T3373 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 483832 T3373 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 483833 T3373 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 483836 T3373 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 483836 T3373 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:41964/solr
[junit4:junit4] 2> 483836 T3373 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 483837 T3373 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 483839 T3446 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b0c5b4 name:ZooKeeperConnection Watcher:127.0.0.1:41964 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 483839 T3373 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 483840 T3373 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 483843 T3373 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 483844 T3448 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f385f2 name:ZooKeeperConnection Watcher:127.0.0.1:41964/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 483844 T3373 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 483850 T3373 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 484038 T3396 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 484039 T3396 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"core_node2",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:34479_us%2Fdl",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:34479/us/dl"}
[junit4:junit4] 2> 484043 T3395 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 484043 T3448 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 484043 T3415 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 484043 T3431 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 484043 T3402 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 484714 T3411 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: core_node2, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 484715 T3411 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=core_node2&state=recovering&nodeName=127.0.0.1:34479_us%252Fdl&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1002
[junit4:junit4] 2> 484853 T3373 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40897_us%2Fdl
[junit4:junit4] 2> 484854 T3373 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:40897_us%2Fdl
[junit4:junit4] 2> 484856 T3395 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 484856 T3431 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 484856 T3415 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 484856 T3448 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 484857 T3448 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 484857 T3402 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 484857 T3402 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 484858 T3415 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 484859 T3395 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 484859 T3431 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 484862 T3449 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 484862 T3449 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 484863 T3449 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4:junit4] 2> 485547 T3396 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 485548 T3396 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"core_node3",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:40897_us%2Fdl",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:40897/us/dl"}
[junit4:junit4] 2> 485548 T3396 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 485548 T3396 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 485552 T3415 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 485552 T3448 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 485552 T3395 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 485552 T3431 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 485552 T3402 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 485863 T3449 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4:junit4] 2> 485864 T3449 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1372287638540/collection1
[junit4:junit4] 2> 485864 T3449 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 485865 T3449 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 485865 T3449 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 485866 T3449 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1372287638540/collection1/'
[junit4:junit4] 2> 485867 T3449 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty3-1372287638540/collection1/lib/README' to classloader
[junit4:junit4] 2> 485867 T3449 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty3-1372287638540/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 485896 T3449 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 485937 T3449 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 485938 T3449 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 485942 T3449 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 486275 T3449 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 486280 T3449 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 486283 T3449 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 486295 T3449 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 486298 T3449 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 486301 T3449 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 486302 T3449 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 486302 T3449 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 486302 T3449 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 486303 T3449 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 486303 T3449 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 486303 T3449 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 486303 T3449 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1372287638540/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1372287629333/jetty3/
[junit4:junit4] 2> 486303 T3449 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6652b6
[junit4:junit4] 2> 486304 T3449 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1372287629333/jetty3
[junit4:junit4] 2> 486304 T3449 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1372287629333/jetty3/index/
[junit4:junit4] 2> 486304 T3449 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1372287629333/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 486305 T3449 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1372287629333/jetty3/index
[junit4:junit4] 2> 486306 T3449 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1e84352 lockFactory=org.apache.lucene.store.NativeFSLockFactory@9388e),segFN=segments_1,generation=1}
[junit4:junit4] 2> 486306 T3449 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 486307 T3449 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 486308 T3449 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 486308 T3449 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 486309 T3449 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 486309 T3449 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 486309 T3449 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 486309 T3449 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 486310 T3449 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 486310 T3449 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 486312 T3449 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 486314 T3449 oass.SolrIndexSearcher.<init> Opening Searcher@3b5a1 main
[junit4:junit4] 2> 486314 T3449 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 486314 T3449 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 486318 T3450 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3b5a1 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 486319 T3449 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 486319 T3449 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:40897/us/dl collection:collection1 shard:shard1
[junit4:junit4] 2> 486323 T3449 oasc.ZkController.register We are http://127.0.0.1:40897/us/dl/collection1/ and leader is http://127.0.0.1:35711/us/dl/collection1/
[junit4:junit4] 2> 486323 T3449 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:40897/us/dl
[junit4:junit4] 2> 486323 T3449 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 486323 T3449 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C2623 name=collection1 org.apache.solr.core.SolrCore@1b84571 url=http://127.0.0.1:40897/us/dl/collection1 node=127.0.0.1:40897_us%2Fdl C2623_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, node_name=127.0.0.1:40897_us%2Fdl, base_url=http://127.0.0.1:40897/us/dl}
[junit4:junit4] 2> 486323 T3451 C2623 P40897 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 486324 T3449 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 486324 T3451 C2623 P40897 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 486324 T3451 C2623 P40897 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 486324 T3451 C2623 P40897 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 486325 T3373 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 486325 T3373 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 486325 T3451 C2623 P40897 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 486326 T3373 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 486329 T3408 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: core_node3, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 486402 T3373 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 486404 T3373 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:35810
[junit4:junit4] 2> 486404 T3373 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 486405 T3373 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 486405 T3373 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1372287641157
[junit4:junit4] 2> 486405 T3373 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1372287641157/solr.xml
[junit4:junit4] 2> 486406 T3373 oasc.CoreContainer.<init> New CoreContainer 24034591
[junit4:junit4] 2> 486406 T3373 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1372287641157/'
[junit4:junit4] 2> 486406 T3373 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1372287641157/'
[junit4:junit4] 2> 486460 T3373 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 486461 T3373 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 486461 T3373 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 486461 T3373 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 486461 T3373 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 486462 T3373 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 486462 T3373 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 486462 T3373 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 486463 T3373 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 486463 T3373 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 486466 T3373 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 486466 T3373 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:41964/solr
[junit4:junit4] 2> 486467 T3373 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 486467 T3373 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 486469 T3463 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b70ed4 name:ZooKeeperConnection Watcher:127.0.0.1:41964 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 486469 T3373 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 486470 T3373 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 486473 T3373 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 486474 T3465 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b30f29 name:ZooKeeperConnection Watcher:127.0.0.1:41964/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 486475 T3373 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 486478 T3373 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> ASYNC NEW_CORE C2624 name=collection1 org.apache.solr.core.SolrCore@f6c3fe url=http://127.0.0.1:34479/us/dl/collection1 node=127.0.0.1:34479_us%2Fdl C2624_STATE=coll:collection1 core:collection1 props:{state=recovering, core=collection1, node_name=127.0.0.1:34479_us%2Fdl, base_url=http://127.0.0.1:34479/us/dl}
[junit4:junit4] 2> 486715 T3434 C2624 P34479 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:35711/us/dl/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 486716 T3434 C2624 P34479 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:34479/us/dl START replicas=[http://127.0.0.1:35711/us/dl/collection1/] nUpdates=100
[junit4:junit4] 2> 486716 T3434 C2624 P34479 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 486716 T3434 C2624 P34479 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 486716 T3434 C2624 P34479 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 486716 T3434 C2624 P34479 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 486716 T3434 C2624 P34479 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 486717 T3434 C2624 P34479 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:35711/us/dl/collection1/. core=collection1
[junit4:junit4] 2> 486717 T3434 C2624 P34479 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C2625 name=collection1 org.apache.solr.core.SolrCore@66be85 url=http://127.0.0.1:35711/us/dl/collection1 node=127.0.0.1:35711_us%2Fdl C2625_STATE=coll:collection1 core:collection1 props:{state=active, core=collection1, node_name=127.0.0.1:35711_us%2Fdl, base_url=http://127.0.0.1:35711/us/dl, leader=true}
[junit4:junit4] 2> 486722 T3409 C2625 P35711 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 486727 T3411 C2625 P35711 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 486778 T3411 C2625 P35711 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1377ac4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@122d2d4),segFN=segments_1,generation=1}
[junit4:junit4] 2> 486779 T3411 C2625 P35711 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 486779 T3411 C2625 P35711 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4] 2> 486780 T3411 C2625 P35711 oass.SolrIndexSearcher.<init> Opening Searcher@10909c1 realtime
[junit4:junit4] 2> 486780 T3411 C2625 P35711 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 486780 T3411 C2625 P35711 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 54
[junit4:junit4] 2> 486781 T3434 C2624 P34479 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 486781 T3434 C2624 P34479 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 486785 T3411 C2625 P35711 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 486786 T3411 C2625 P35711 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=4
[junit4:junit4] 2> 486786 T3434 C2624 P34479 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 486787 T3434 C2624 P34479 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 486787 T3434 C2624 P34479 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 486787 T3434 C2624 P34479 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 486788 T3434 C2624 P34479 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 487056 T3396 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 487057 T3396 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"core_node3",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:40897_us%2Fdl",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:40897/us/dl"}
[junit4:junit4] 2> 487060 T3396 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"core_node2",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:34479_us%2Fdl",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:34479/us/dl"}
[junit4:junit4] 2> 487063 T3465 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 487063 T3402 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 487063 T3431 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 487063 T3415 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 487063 T3448 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 487063 T3395 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 487330 T3408 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: core_node3, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 487330 T3408 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=core_node3&state=recovering&nodeName=127.0.0.1:40897_us%252Fdl&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1001
[junit4:junit4] 2> 487481 T3373 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35810_us%2Fdl
[junit4:junit4] 2> 487482 T3373 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:35810_us%2Fdl
[junit4:junit4] 2> 487485 T3395 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 487485 T3431 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 487485 T3465 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 487485 T3415 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 487486 T3448 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 487485 T3465 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 487486 T3448 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 487486 T3402 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 487487 T3402 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 487487 T3395 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 487488 T3415 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 487488 T3431 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 487492 T3467 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 487492 T3467 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 487494 T3467 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4:junit4] 2> 488569 T3396 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 488570 T3396 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"core_node4",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:35810_us%2Fdl",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:35810/us/dl"}
[junit4:junit4] 2> 488570 T3396 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 488570 T3396 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 488572 T3465 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 488573 T3415 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 488573 T3402 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 488573 T3395 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 488573 T3448 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 488573 T3431 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> ASYNC NEW_CORE C2626 name=collection1 org.apache.solr.core.SolrCore@1b84571 url=http://127.0.0.1:40897/us/dl/collection1 node=127.0.0.1:40897_us%2Fdl C2626_STATE=coll:collection1 core:collection1 props:{state=recovering, core=collection1, node_name=127.0.0.1:40897_us%2Fdl, base_url=http://127.0.0.1:40897/us/dl}
[junit4:junit4] 2> 489331 T3451 C2626 P40897 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:35711/us/dl/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 489331 T3451 C2626 P40897 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:40897/us/dl START replicas=[http://127.0.0.1:35711/us/dl/collection1/] nUpdates=100
[junit4:junit4] 2> 489331 T3451 C2626 P40897 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 489332 T3451 C2626 P40897 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 489332 T3451 C2626 P40897 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 489332 T3451 C2626 P40897 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 489332 T3451 C2626 P40897 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 489332 T3451 C2626 P40897 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:35711/us/dl/collection1/. core=collection1
[junit4:junit4] 2> 489332 T3451 C2626 P40897 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 489333 T3409 C2625 P35711 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 489336 T3410 C2625 P35711 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 489336 T3410 C2625 P35711 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4] 2> 489337 T3410 C2625 P35711 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 489337 T3410 C2625 P35711 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 1
[junit4:junit4] 2> 489338 T3451 C2626 P40897 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 489338 T3451 C2626 P40897 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 489340 T3409 C2625 P35711 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 489340 T3451 C2626 P40897 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 489340 T3451 C2626 P40897 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 489340 T3451 C2626 P40897 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 489341 T3451 C2626 P40897 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 489342 T3451 C2626 P40897 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 489494 T3467 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4:junit4] 2> 489494 T3467 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1372287641157/collection1
[junit4:junit4] 2> 489494 T3467 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 489495 T3467 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 489495 T3467 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 489497 T3467 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1372287641157/collection1/'
[junit4:junit4] 2> 489497 T3467 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty4-1372287641157/collection1/lib/README' to classloader
[junit4:junit4] 2> 489497 T3467 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty4-1372287641157/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 489521 T3467 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 489551 T3467 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 489553 T3467 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 489556 T3467 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 489929 T3467 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 489937 T3467 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 489941 T3467 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 489953 T3467 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 489956 T3467 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 489960 T3467 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 489961 T3467 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 489961 T3467 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 489961 T3467 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 489962 T3467 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 489962 T3467 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 489962 T3467 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 489963 T3467 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1372287641157/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1372287629333/jetty4/
[junit4:junit4] 2> 489963 T3467 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6652b6
[junit4:junit4] 2> 489964 T3467 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1372287629333/jetty4
[junit4:junit4] 2> 489964 T3467 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1372287629333/jetty4/index/
[junit4:junit4] 2> 489964 T3467 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1372287629333/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 489965 T3467 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1372287629333/jetty4/index
[junit4:junit4] 2> 489966 T3467 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@910690 lockFactory=org.apache.lucene.store.NativeFSLockFactory@63a241),segFN=segments_1,generation=1}
[junit4:junit4] 2> 489967 T3467 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 489969 T3467 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 489969 T3467 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 489970 T3467 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 489971 T3467 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 489971 T3467 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 489972 T3467 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 489972 T3467 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 489973 T3467 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 489973 T3467 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 489976 T3467 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 489979 T3467 oass.SolrIndexSearcher.<init> Opening Searcher@9817d main
[junit4:junit4] 2> 489980 T3467 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 489980 T3467 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 489985 T3469 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@9817d main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 489987 T3467 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 489987 T3467 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:35810/us/dl collection:collection1 shard:shard1
[junit4:junit4] 2> 489989 T3467 oasc.ZkController.register We are http://127.0.0.1:35810/us/dl/collection1/ and leader is http://127.0.0.1:35711/us/dl/collection1/
[junit4:junit4] 2> 489990 T3467 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:35810/us/dl
[junit4:junit4] 2> 489990 T3467 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 489990 T3467 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C2627 name=collection1 org.apache.solr.core.SolrCore@1bbb354 url=http://127.0.0.1:35810/us/dl/collection1 node=127.0.0.1:35810_us%2Fdl C2627_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, node_name=127.0.0.1:35810_us%2Fdl, base_url=http://127.0.0.1:35810/us/dl}
[junit4:junit4] 2> 489990 T3470 C2627 P35810 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 489991 T3470 C2627 P35810 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 489991 T3467 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 489992 T3470 C2627 P35810 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 489992 T3470 C2627 P35810 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 489993 T3373 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 489993 T3373 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 489993 T3470 C2627 P35810 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 489994 T3373 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 489998 T3373 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 489998 T3408 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: core_node4, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 489999 T3373 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 30 for each attempt
[junit4:junit4] 2> 489999 T3373 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):30
[junit4:junit4] 2> 490000 T3373 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 490076 T3396 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 490077 T3396 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"core_node3",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:40897_us%2Fdl",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:40897/us/dl"}
[junit4:junit4] 2> 490080 T3396 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"core_node4",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:35810_us%2Fdl",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:35810/us/dl"}
[junit4:junit4] 2> 490083 T3465 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 490084 T3431 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 490084 T3395 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 490083 T3448 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 490083 T3415 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 490083 T3402 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 490999 T3408 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: core_node4, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 490999 T3408 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=core_node4&state=recovering&nodeName=127.0.0.1:35810_us%252Fdl&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1001
[junit4:junit4] 2> 491002 T3373 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 492003 T3373 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C2627_STATE=coll:collection1 core:collection1 props:{state=recovering, core=collection1, node_name=127.0.0.1:35810_us%2Fdl, base_url=http://127.0.0.1:35810/us/dl}
[junit4:junit4] 2> 493000 T3470 C2627 P35810 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:35711/us/dl/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 493001 T3470 C2627 P35810 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:35810/us/dl START replicas=[http://127.0.0.1:35711/us/dl/collection1/] nUpdates=100
[junit4:junit4] 2> 493001 T3470 C2627 P35810 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 493001 T3470 C2627 P35810 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 493002 T3470 C2627 P35810 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 493002 T3470 C2627 P35810 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 493002 T3470 C2627 P35810 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 493002 T3470 C2627 P35810 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:35711/us/dl/collection1/. core=collection1
[junit4:junit4] 2> 493002 T3470 C2627 P35810 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C2628 name=collection1 org.apache.solr.core.SolrCore@66be85 url=http://127.0.0.1:35711/us/dl/collection1 node=127.0.0.1:35711_us%2Fdl C2628_STATE=coll:collection1 core:collection1 props:{state=active, core=collection1, node_name=127.0.0.1:35711_us%2Fdl, base_url=http://127.0.0.1:35711/us/dl, leader=true}
[junit4:junit4] 2> 493003 T3408 C2628 P35711 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 493005 T3373 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 493007 T3409 C2628 P35711 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 493007 T3409 C2628 P35711 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4] 2> 493007 T3409 C2628 P35711 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 493008 T3409 C2628 P35711 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 1
[junit4:junit4] 2> 493008 T3470 C2627 P35810 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 493008 T3470 C2627 P35810 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 493010 T3411 C2628 P35711 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4] 2> 493011 T3470 C2627 P35810 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 493011 T3470 C2627 P35810 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 493011 T3470 C2627 P35810 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 493011 T3470 C2627 P35810 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 493012 T3470 C2627 P35810 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 493091 T3396 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 493092 T3396 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"core_node4",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:35810_us%2Fdl",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:35810/us/dl"}
[junit4:junit4] 2> 493095 T3465 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 493095 T3402 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 493096 T3431 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 493096 T3448 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 493095 T3415 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 493096 T3395 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 494007 T3373 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 494008 T3373 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> ASYNC NEW_CORE C2629 name=collection1 org.apache.solr.core.SolrCore@c9abaa url=http://127.0.0.1:45318/us/dl/collection1 node=127.0.0.1:45318_us%2Fdl C2629_STATE=coll:control_collection core:collection1 props:{state=active, core=collection1, node_name=127.0.0.1:45318_us%2Fdl, base_url=http://127.0.0.1:45318/us/dl, leader=true}
[junit4:junit4] 2> 494015 T3389 C2629 P45318 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 494067 T3389 C2629 P45318 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@87873b lockFactory=org.apache.lucene.store.NativeFSLockFactory@1362817),segFN=segments_1,generation=1}
[junit4:junit4] 2> 494068 T3389 C2629 P45318 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 494068 T3389 C2629 P45318 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4] 2> 494069 T3389 C2629 P45318 oass.SolrIndexSearcher.<init> Opening Searcher@1b6266f main
[junit4:junit4] 2> 494069 T3389 C2629 P45318 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 494070 T3399 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1b6266f main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4:junit4] 2> 494070 T3389 C2629 P45318 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 55
[junit4:junit4] 2> C2627_STATE=coll:collection1 core:collection1 props:{state=active, core=collection1, node_name=127.0.0.1:35810_us%2Fdl, base_url=http://127.0.0.1:35810/us/dl}
[junit4:junit4] 2> 494077 T3459 C2627 P35810 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:35711/us/dl/collection1/, StdNode: http://127.0.0.1:34479/us/dl/collection1/, StdNode: http://127.0.0.1:40897/us/dl/collection1/, StdNode: http://127.0.0.1:35810/us/dl/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 494081 T3458 C2627 P35810 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 494082 T3408 C2628 P35711 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 494082 T3408 C2628 P35711 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4] 2> 494083 T3408 C2628 P35711 oass.SolrIndexSearcher.<init> Opening Searcher@18a7f21 main
[junit4:junit4] 2> 494083 T3408 C2628 P35711 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 494084 T3417 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@18a7f21 main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4:junit4] 2> 494084 T3408 C2628 P35711 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 2
[junit4:junit4] 2> ASYNC NEW_CORE C2630 name=collection1 org.apache.solr.core.SolrCore@1b84571 url=http://127.0.0.1:40897/us/dl/collection1 node=127.0.0.1:40897_us%2Fdl C2630_STATE=coll:collection1 core:collection1 props:{state=active, core=collection1, node_name=127.0.0.1:40897_us%2Fdl, base_url=http://127.0.0.1:40897/us/dl}
[junit4:junit4] 2> 494085 T3442 C2630 P40897 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 494086 T3442 C2630 P40897 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1e84352 lockFactory=org.apache.lucene.store.NativeFSLockFactory@9388e),segFN=segments_1,generation=1}
[junit4:junit4] 2> 494087 T3442 C2630 P40897 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 494088 T3442 C2630 P40897 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4] 2> 494088 T3442 C2630 P40897 oass.SolrIndexSearcher.<init> Opening Searcher@aa0b98 main
[junit4:junit4] 2> 494088 T3442 C2630 P40897 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> ASYNC NEW_CORE C2631 name=collection1 org.apache.solr.core.SolrCore@f6c3fe url=http://127.0.0.1:34479/us/dl/collection1 node=127.0.0.1:34479_us%2Fdl C2631_STATE=coll:collection1 core:collection1 props:{state=active, core=collection1, node_name=127.0.0.1:34479_us%2Fdl, base_url=http://127.0.0.1:34479/us/dl}
[junit4:junit4] 2> 494089 T3427 C2631 P34479 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 494089 T3450 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@aa0b98 main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4:junit4] 2> 494090 T3442 C2630 P40897 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 5
[junit4:junit4] 2> 494133 T3458 C2627 P35810 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@910690 lockFactory=org.apache.lucene.store.NativeFSLockFactory@63a241),segFN=segments_1,generation=1}
[junit4:junit4] 2> 494134 T3458 C2627 P35810 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 494134 T3458 C2627 P35810 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4] 2> 494135 T3458 C2627 P35810 oass.SolrIndexSearcher.<init> Opening Searcher@1faf813 main
[junit4:junit4] 2> 494135 T3458 C2627 P35810 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 494136 T3469 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1faf813 main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4:junit4] 2> 494136 T3458 C2627 P35810 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 55
[junit4:junit4] 2> 494140 T3427 C2631 P34479 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1e1c9c1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@846e50),segFN=segments_1,generation=1}
[junit4:junit4] 2> 494141 T3427 C2631 P34479 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 494142 T3427 C2631 P34479 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4] 2> 494142 T3427 C2631 P34479 oass.SolrIndexSearcher.<init> Opening Searcher@1988262 main
[junit4:junit4] 2> 494143 T3427 C2631 P34479 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 494143 T3433 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1988262 main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4:junit4] 2> 494144 T3427 C2631 P34479 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 56
[junit4:junit4] 2> 494145 T3459 C2627 P35810 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 68
[junit4:junit4] 2> 494145 T3373 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 494147 T3410 C2628 P35711 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 494149 T3426 C2631 P34479 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 494151 T3443 C2630 P40897 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 494152 T3460 C2627 P35810 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 496156 T3389 C2629 P45318 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1438947895918198784)} 0 1
[junit4:junit4] 2> 496163 T3461 C2627 P35810 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={update.distrib=FROMLEADER&_version_=-1438947895922393088&update.from=http://127.0.0.1:35711/us/dl/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1438947895922393088)} 0 1
[junit4:junit4] 2> 496163 T3425 C2631 P34479 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={update.distrib=FROMLEADER&_version_=-1438947895922393088&update.from=http://127.0.0.1:35711/us/dl/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1438947895922393088)} 0 1
[junit4:junit4] 2> 496163 T3443 C2630 P40897 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={update.distrib=FROMLEADER&_version_=-1438947895922393088&update.from=http://127.0.0.1:35711/us/dl/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1438947895922393088)} 0 1
[junit4:junit4] 2> 496164 T3411 C2628 P35711 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={update.distrib=TOLEADER&wt=javabin&version=2} {deleteByQuery=*:* (-1438947895922393088)} 0 5
[junit4:junit4] 2> 496165 T3426 C2631 P34479 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={wt=javabin&version=2} {deleteByQuery=*:*} 0 8
[junit4:junit4] 2> 496168 T3391 C2629 P45318 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={wt=javabin&version=2} {add=[0 (1438947895930781696)]} 0 1
[junit4:junit4] 2> 496173 T3458 C2627 P35810 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={distrib.from=http://127.0.0.1:35711/us/dl/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1438947895933927424)]} 0 1
[junit4:junit4] 2> 496173 T3427 C2631 P34479 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={distrib.from=http://127.0.0.1:35711/us/dl/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1438947895933927424)]} 0 1
[junit4:junit4] 2> 496173 T3441 C2630 P40897 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={distrib.from=http://127.0.0.1:35711/us/dl/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1438947895933927424)]} 0 1
[junit4:junit4] 2> 496174 T3408 C2628 P35711 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={distrib.from=http://127.0.0.1:40897/us/dl/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[0 (1438947895933927424)]} 0 4
[junit4:junit4] 2> 496174 T3442 C2630 P40897 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={wt=javabin&version=2} {add=[0]} 0 5
[junit4:junit4] 2> 496177 T3390 C2629 P45318 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={wt=javabin&version=2} {add=[1 (1438947895940218880)]} 0 1
[junit4:junit4] 2> 496184 T3459 C2627 P35810 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={distrib.from=http://127.0.0.1:35711/us/dl/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1438947895945461760)]} 0 1
[junit4:junit4] 2> 496184 T3424 C2631 P34479 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={distrib.from=http://127.0.0.1:35711/us/dl/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1438947895945461760)]} 0 1
[junit4:junit4] 2> 496184 T3444 C2630 P40897 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={distrib.from=http://127.0.0.1:35711/us/dl/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1438947895945461760)]} 0 1
[junit4:junit4] 2> 496185 T3409 C2628 P35711 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={distrib.from=http://127.0.0.1:40897/us/dl/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[1 (1438947895945461760)]} 0 4
[junit4:junit4] 2> 496185 T3443 C2630 P40897 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={wt=javabin&version=2} {add=[1]} 0 6
[junit4:junit4] 2> 496188 T3388 C2629 P45318 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={wt=javabin&version=2} {add=[2 (1438947895951753216)]} 0 1
[junit4:junit4] 2> 496192 T3410 C2628 P35711 oasup.DistributedUpdateProcessor.setupRequest test.distrib.skip.servers was found and contains:[http://127.0.0.1:34479/us/dl/collection1/]
[junit4:junit4] 2> 496192 T3410 C2628 P35711 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:34479/us/dl/collection1/ against:[http://127.0.0.1:34479/us/dl/collection1/] result:true
[junit4:junit4] 2> 496192 T3410 C2628 P35711 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:40897/us/dl/collection1/ against:[http://127.0.0.1:34479/us/dl/collection1/] result:false
[junit4:junit4] 2> 496193 T3410 C2628 P35711 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:35810/us/dl/collection1/ against:[http://127.0.0.1:34479/us/dl/collection1/] result:false
[junit4:junit4] 2> 496196 T3441 C2630 P40897 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={distrib.from=http://127.0.0.1:35711/us/dl/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:34479/us/dl/collection1/&wt=javabin&version=2} {add=[2 (1438947895958044672)]} 0 1
[junit4:junit4] 2> 496196 T3460 C2627 P35810 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={distrib.from=http://127.0.0.1:35711/us/dl/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:34479/us/dl/collection1/&wt=javabin&version=2} {add=[2 (1438947895958044672)]} 0 1
[junit4:junit4] 2> 496196 T3410 C2628 P35711 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={distrib.from=http://127.0.0.1:34479/us/dl/collection1/&update.distrib=TOLEADER&test.distrib.skip.servers=http://127.0.0.1:34479/us/dl/collection1/&wt=javabin&version=2} {add=[2 (1438947895958044672)]} 0 4
[junit4:junit4] 2> 496197 T3425 C2631 P34479 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={test.distrib.skip.servers=http://127.0.0.1:34479/us/dl/collection1/&wt=javabin&version=2} {add=[2]} 0 7
[junit4:junit4] 2> 496199 T3389 C2629 P45318 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={wt=javabin&version=2} {add=[3 (1438947895964336128)]} 0 0
[junit4:junit4] 2> 496204 T3411 C2628 P35711 oasup.DistributedUpdateProcessor.setupRequest test.distrib.skip.servers was found and contains:[http://127.0.0.1:34479/us/dl/collection1/]
[junit4:junit4] 2> 496204 T3411 C2628 P35711 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:34479/us/dl/collection1/ against:[http://127.0.0.1:34479/us/dl/collection1/] result:true
[junit4:junit4] 2> 496204 T3411 C2628 P35711 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:40897/us/dl/collection1/ against:[http://127.0.0.1:34479/us/dl/collection1/] result:false
[junit4:junit4] 2> 496205 T3411 C2628 P35711 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:35810/us/dl/collection1/ against:[http://127.0.0.1:34479/us/dl/collection1/] result:false
[junit4:junit4] 2> 496208 T3459 C2627 P35810 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={distrib.from=http://127.0.0.1:35711/us/dl/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:34479/us/dl/collection1/&wt=javabin&version=2} {add=[3 (1438947895970627584)]} 0 1
[junit4:junit4] 2> 496208 T3442 C2630 P40897 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={distrib.from=http://127.0.0.1:35711/us/dl/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:34479/us/dl/collection1/&wt=javabin&version=2} {add=[3 (1438947895970627584)]} 0 1
[junit4:junit4] 2> 496209 T3411 C2628 P35711 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={distrib.from=http://127.0.0.1:35810/us/dl/collection1/&update.distrib=TOLEADER&test.distrib.skip.servers=http://127.0.0.1:34479/us/dl/collection1/&wt=javabin&version=2} {add=[3 (1438947895970627584)]} 0 5
[junit4:junit4] 2> 496209 T3461 C2627 P35810 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={test.distrib.skip.servers=http://127.0.0.1:34479/us/dl/collection1/&test.distrib.skip.servers=http://127.0.0.1:40897/us/dl/collection1/&wt=javabin&version=2} {add=[3]} 0 7
[junit4:junit4] 2> 496211 T3391 C2629 P45318 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 496216 T3391 C2629 P45318 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@87873b lockFactory=org.apache.lucene.store.NativeFSLockFactory@1362817),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@87873b lockFactory=org.apache.lucene.store.NativeFSLockFactory@1362817),segFN=segments_2,generation=2}
[junit4:junit4] 2> 496216 T3391 C2629 P45318 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 496222 T3391 C2629 P45318 oass.SolrIndexSearcher.<init> Opening Searcher@16309fb main
[junit4:junit4] 2> 496223 T3391 C2629 P45318 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 496224 T3399 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@16309fb main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):c4)}
[junit4:junit4] 2> 496225 T3391 C2629 P45318 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 14
[junit4:junit4] 2> 496228 T3444 C2630 P40897 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:35711/us/dl/collection1/, StdNode: http://127.0.0.1:34479/us/dl/collection1/, StdNode: http://127.0.0.1:40897/us/dl/collection1/, StdNode: http://127.0.0.1:35810/us/dl/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 496230 T3408 C2628 P35711 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 496231 T3426 C2631 P34479 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 496231 T3458 C2627 P35810 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 496233 T3441 C2630 P40897 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 496233 T3408 C2628 P35711 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1377ac4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@122d2d4),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1377ac4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@122d2d4),segFN=segments_2,generation=2}
[junit4:junit4] 2> 496234 T3408 C2628 P35711 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 496234 T3426 C2631 P34479 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1e1c9c1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@846e50),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1e1c9c1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@846e50),segFN=segments_2,generation=2}
[junit4:junit4] 2> 496234 T3408 C2628 P35711 oass.SolrIndexSearcher.<init> Opening Searcher@16159f9 main
[junit4:junit4] 2> 496235 T3426 C2631 P34479 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 496234 T3458 C2627 P35810 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@910690 lockFactory=org.apache.lucene.store.NativeFSLockFactory@63a241),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@910690 lockFactory=org.apache.lucene.store.NativeFSLockFactory@63a241),segFN=segments_2,generation=2}
[junit4:junit4] 2> 496235 T3417 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@16159f9 main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):c4)}
[junit4:junit4] 2> 496235 T3441 C2630 P40897 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1e84352 lockFactory=org.apache.lucene.store.NativeFSLockFactory@9388e),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1e84352 lockFactory=org.apache.lucene.store.NativeFSLockFactory@9388e),segFN=segments_2,generation=2}
[junit4:junit4] 2> 496236 T3441 C2630 P40897 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 496235 T3408 C2628 P35711 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 496236 T3426 C2631 P34479 oass.SolrIndexSearcher.<init> Opening Searcher@b0167c main
[junit4:junit4] 2> 496235 T3458 C2627 P35810 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 496237 T3426 C2631 P34479 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 496238 T3433 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@b0167c main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):c2)}
[junit4:junit4] 2> 496237 T3441 C2630 P40897 oass.SolrIndexSearcher.<init> Opening Searcher@137690f main
[junit4:junit4] 2> 496237 T3408 C2628 P35711 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 496238 T3441 C2630 P40897 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 496238 T3426 C2631 P34479 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 496238 T3458 C2627 P35810 oass.SolrIndexSearcher.<init> Opening Searcher@1a48514 main
[junit4:junit4] 2> 496239 T3450 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@137690f main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):c4)}
[junit4:junit4] 2> 496239 T3458 C2627 P35810 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 496240 T3441 C2630 P40897 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 496240 T3469 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1a48514 main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):c4)}
[junit4:junit4] 2> 496240 T3458 C2627 P35810 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 9
[junit4:junit4] 2> 496241 T3444 C2630 P40897 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 13
[junit4:junit4] 2> 496241 T3373 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):330
[junit4:junit4] 2> 496242 T3373 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 496243 T3373 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> 496245 T3409 C2628 P35711 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=0
[junit4:junit4] 2> 496247 T3427 C2631 P34479 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=2 status=0 QTime=0
[junit4:junit4] 2> 496249 T3442 C2630 P40897 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=0
[junit4:junit4] 2> 496251 T3459 C2627 P35810 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=0
[junit4:junit4] 2> 496253 T3373 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 496258 T3443 oasha.CollectionsHandler.handleSyncShardAction Syncing shard : shard=shard1&action=SYNCSHARD&collection=collection1&wt=javabin&version=2
[junit4:junit4] 2> 496258 T3443 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 496263 T3410 oasha.CoreAdminHandler.handleRequestSyncAction I have been requested to sync up my shard
[junit4:junit4] 2> 496263 T3410 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:35711/us/dl/collection1/
[junit4:junit4] 2> 496264 T3410 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:35711/us/dl START replicas=[http://127.0.0.1:34479/us/dl/collection1/, http://127.0.0.1:40897/us/dl/collection1/, http://127.0.0.1:35810/us/dl/collection1/] nUpdates=100
[junit4:junit4] 2> 496265 T3424 C2631 P34479 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 496265 T3444 C2630 P40897 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 496265 T3410 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:35711/us/dl Received 3 versions from 127.0.0.1:34479/us/dl/collection1/
[junit4:junit4] 2> 496265 T3460 C2627 P35810 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 496266 T3410 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:35711/us/dl Our versions are newer. ourLowThreshold=1438947895922393088 otherHigh=1438947895945461760
[junit4:junit4] 2> 496266 T3410 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:35711/us/dl Received 5 versions from 127.0.0.1:40897/us/dl/collection1/
[junit4:junit4] 2> 496267 T3410 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:35711/us/dl Our versions are newer. ourLowThreshold=1438947895922393088 otherHigh=1438947895958044672
[junit4:junit4] 2> 496267 T3410 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:35711/us/dl Received 5 versions from 127.0.0.1:35810/us/dl/collection1/
[junit4:junit4] 2> 496267 T3410 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:35711/us/dl Our versions are newer. ourLowThreshold=1438947895922393088 otherHigh=1438947895958044672
[junit4:junit4] 2> 496267 T3410 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:35711/us/dl DONE. sync succeeded
[junit4:junit4] 2> 496267 T3410 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 496268 T3410 oasc.SyncStrategy.syncToMe http://127.0.0.1:35711/us/dl/collection1/: try and ask http://127.0.0.1:34479/us/dl/collection1/ to sync
[junit4:junit4] 2> 496268 T3410 oasc.SyncStrategy.syncToMe http://127.0.0.1:35711/us/dl/collection1/: try and ask http://127.0.0.1:40897/us/dl/collection1/ to sync
[junit4:junit4] 2> 496268 T3410 oasc.SyncStrategy.syncToMe http://127.0.0.1:35711/us/dl/collection1/: try and ask http://127.0.0.1:35810/us/dl/collection1/ to sync
[junit4:junit4] 2> 496269 T3426 C2631 P34479 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:34479/us/dl START replicas=[http://127.0.0.1:35711/us/dl/collection1/] nUpdates=100
[junit4:junit4] 2> 496270 T3442 C2630 P40897 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:40897/us/dl START replicas=[http://127.0.0.1:35711/us/dl/collection1/] nUpdates=100
[junit4:junit4] 2> 496270 T3458 C2627 P35810 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:35810/us/dl START replicas=[http://127.0.0.1:35711/us/dl/collection1/] nUpdates=100
[junit4:junit4] 2> 496271 T3411 C2628 P35711 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 496271 T3408 C2628 P35711 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 496272 T3409 C2628 P35711 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 496272 T3442 C2630 P40897 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:40897/us/dl Received 5 versions from 127.0.0.1:35711/us/dl/collection1/
[junit4:junit4] 2> 496272 T3426 C2631 P34479 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:34479/us/dl Received 5 versions from 127.0.0.1:35711/us/dl/collection1/
[junit4:junit4] 2> 496272 T3458 C2627 P35810 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:35810/us/dl Received 5 versions from 127.0.0.1:35711/us/dl/collection1/
[junit4:junit4] 2> 496272 T3426 C2631 P34479 oasu.PeerSync.requestUpdates PeerSync: core=collection1 url=http://127.0.0.1:34479/us/dl Requesting updates from 127.0.0.1:35711/us/dl/collection1/n=2 versions=[1438947895970627584, 1438947895958044672]
[junit4:junit4] 2> 496272 T3442 C2630 P40897 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:40897/us/dl Our versions are newer. ourLowThreshold=1438947895922393088 otherHigh=1438947895958044672
[junit4:junit4] 2> 496273 T3458 C2627 P35810 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:35810/us/dl Our versions are newer. ourLowThreshold=1438947895922393088 otherHigh=1438947895958044672
[junit4:junit4] 2> 496273 T3442 C2630 P40897 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:40897/us/dl DONE. sync succeeded
[junit4:junit4] 2> 496274 T3458 C2627 P35810 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:35810/us/dl DONE. sync succeeded
[junit4:junit4] 2> 496274 T3442 C2630 P40897 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/get params={sync=http://127.0.0.1:35711/us/dl/collection1/&getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=4
[junit4:junit4] 2> 496274 T3458 C2627 P35810 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/get params={sync=http://127.0.0.1:35711/us/dl/collection1/&getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=4
[junit4:junit4] 2> 496275 T3410 oasc.SyncStrategy.syncToMe http://127.0.0.1:35711/us/dl/collection1/: sync completed with http://127.0.0.1:40897/us/dl/collection1/
[junit4:junit4] 2> 496275 T3411 C2628 P35711 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/get params={distrib=false&getUpdates=1438947895970627584,1438947895958044672&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 496275 T3410 oasc.SyncStrategy.syncToMe http://127.0.0.1:35711/us/dl/collection1/: sync completed with http://127.0.0.1:35810/us/dl/collection1/
[junit4:junit4] 2> 496278 T3426 C2631 P34479 oasup.LogUpdateProcessor.finish [collection1] {add=[2 (1438947895958044672), 3 (1438947895970627584)]} 0 2
[junit4:junit4] 2> 496278 T3426 C2631 P34479 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:34479/us/dl DONE. sync succeeded
[junit4:junit4] 2> 496278 T3426 C2631 P34479 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/get params={sync=http://127.0.0.1:35711/us/dl/collection1/&getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=9
[junit4:junit4] 2> 496279 T3410 oasc.SyncStrategy.syncToMe http://127.0.0.1:35711/us/dl/collection1/: sync completed with http://127.0.0.1:34479/us/dl/collection1/
[junit4:junit4] 2> 496279 T3410 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={shard=shard1&action=REQUESTSYNCSHARD&core=collection1&collection=collection1&wt=javabin&version=2} status=0 QTime=16
[junit4:junit4] 2> 496280 T3443 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/collections params={shard=shard1&action=SYNCSHARD&collection=collection1&wt=javabin&version=2} status=0 QTime=24
[junit4:junit4] 2> 496280 T3373 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 2> 496280 T3373 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 2> 496281 T3373 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 496282 T3373 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> 496284 T3390 C2629 P45318 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 496284 T3390 C2629 P45318 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4] 2> 496285 T3390 C2629 P45318 oass.SolrIndexSearcher.<init> Opening Searcher@fe1fae main
[junit4:junit4] 2> 496285 T3390 C2629 P45318 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 496286 T3399 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@fe1fae main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):c4)}
[junit4:junit4] 2> 496286 T3390 C2629 P45318 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 2
[junit4:junit4] 2> 496288 T3441 C2630 P40897 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:35711/us/dl/collection1/, StdNode: http://127.0.0.1:34479/us/dl/collection1/, StdNode: http://127.0.0.1:40897/us/dl/collection1/, StdNode: http://127.0.0.1:35810/us/dl/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 496290 T3408 C2628 P35711 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 496290 T3408 C2628 P35711 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4] 2> 496290 T3427 C2631 P34479 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 496290 T3459 C2627 P35810 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 496290 T3444 C2630 P40897 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 496291 T3444 C2630 P40897 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4] 2> 496291 T3459 C2627 P35810 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4] 2> 496290 T3408 C2628 P35711 oass.SolrIndexSearcher.<init> Opening Searcher@f9b6e main
[junit4:junit4] 2> 496292 T3459 C2627 P35810 oass.SolrIndexSearcher.<init> Opening Searcher@1696bd main
[junit4:junit4] 2> 496292 T3444 C2630 P40897 oass.SolrIndexSearcher.<init> Opening Searcher@10b75ce main
[junit4:junit4] 2> 496294 T3427 C2631 P34479 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1e1c9c1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@846e50),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1e1c9c1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@846e50),segFN=segments_3,generation=3}
[junit4:junit4] 2> 496295 T3469 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1696bd main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):c4)}
[junit4:junit4] 2> 496295 T3427 C2631 P34479 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 496295 T3444 C2630 P40897 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 496293 T3417 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@f9b6e main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):c4)}
[junit4:junit4] 2> 496293 T3459 C2627 P35810 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 496292 T3408 C2628 P35711 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 496296 T3459 C2627 P35810 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> 496296 T3427 C2631 P34479 oass.SolrIndexSearcher.<init> Opening Searcher@1328fcc main
[junit4:junit4] 2> 496295 T3450 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@10b75ce main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):c4)}
[junit4:junit4] 2> 496298 T3427 C2631 P34479 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 496297 T3408 C2628 P35711 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 496298 T3433 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1328fcc main{StandardDirectoryReader(segments_3:5:nrt _0(5.0):c2 _1(5.0):c2)}
[junit4:junit4] 2> 496298 T3444 C2630 P40897 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 8
[junit4:junit4] 2> 496299 T3427 C2631 P34479 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 9
[junit4:junit4] 2> 496300 T3441 C2630 P40897 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 12
[junit4:junit4] 2> 496301 T3373 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 496304 T3409 C2628 P35711 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=0
[junit4:junit4] 2> 496306 T3424 C2631 P34479 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=0
[junit4:junit4] 2> 496309 T3442 C2630 P40897 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=1
[junit4:junit4] 2> 496311 T3461 C2627 P35810 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=0
[junit4:junit4] 2> 498312 T3373 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> check const of shard1
[junit4:junit4] 2> client0
[junit4:junit4] 2> PROPS:core_node1:{"state":"active","core":"collection1","node_name":"127.0.0.1:35711_us%2Fdl","base_url":"http://127.0.0.1:35711/us/dl","leader":"true"}
[junit4:junit4] 2> 498315 T3408 C2628 P35711 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=0
[junit4:junit4] 2> live:true
[junit4:junit4] 2> num:4
[junit4:junit4] 2>
[junit4:junit4] 2> client1
[junit4:junit4] 2> PROPS:core_node2:{"state":"active","core":"collection1","node_name":"127.0.0.1:34479_us%2Fdl","base_url":"http://127.0.0.1:34479/us/dl"}
[junit4:junit4] 2> 498317 T3427 C2631 P34479 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=0
[junit4:junit4] 2> live:true
[junit4:junit4] 2> num:4
[junit4:junit4] 2>
[junit4:junit4] 2> client2
[junit4:junit4] 2> PROPS:core_node3:{"state":"active","core":"collection1","node_name":"127.0.0.1:40897_us%2Fdl","base_url":"http://127.0.0.1:40897/us/dl"}
[junit4:junit4] 2> 498319 T3441 C2630 P40897 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=0
[junit4:junit4] 2> live:true
[junit4:junit4] 2> num:4
[junit4:junit4] 2>
[junit4:junit4] 2> client3
[junit4:junit4] 2> PROPS:core_node4:{"state":"active","core":"collection1","node_name":"127.0.0.1:35810_us%2Fdl","base_url":"http://127.0.0.1:35810/us/dl"}
[junit4:junit4] 2> 498321 T3459 C2627 P35810 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=0
[junit4:junit4] 2> live:true
[junit4:junit4] 2> num:4
[junit4:junit4] 2>
[junit4:junit4] 2> 498323 T3425 C2631 P34479 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/select params={q=*:*&wt=javabin&version=2} hits=4 status=0 QTime=0
[junit4:junit4] 2> 498329 T3390 C2629 P45318 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={wt=javabin&version=2} {add=[4 (1438947898195705856)]} 0 2
[junit4:junit4] 2> 498332 T3409 C2628 P35711 oasup.DistributedUpdateProcessor.setupRequest test.distrib.skip.servers was found and contains:[http://127.0.0.1:40897/us/dl/collection1/]
[junit4:junit4] 2> 498333 T3409 C2628 P35711 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:34479/us/dl/collection1/ against:[http://127.0.0.1:40897/us/dl/collection1/] result:false
[junit4:junit4] 2> 498333 T3409 C2628 P35711 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:40897/us/dl/collection1/ against:[http://127.0.0.1:40897/us/dl/collection1/] result:true
[junit4:junit4] 2> 498333 T3409 C2628 P35711 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:35810/us/dl/collection1/ against:[http://127.0.0.1:40897/us/dl/collection1/] result:false
[junit4:junit4] 2> 498338 T3458 C2627 P35810 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={distrib.from=http://127.0.0.1:35711/us/dl/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:40897/us/dl/collection1/&wt=javabin&version=2} {add=[4 (1438947898203045888)]} 0 1
[junit4:junit4] 2> 498338 T3424 C2631 P34479 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={distrib.from=http://127.0.0.1:35711/us/dl/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:40897/us/dl/collection1/&wt=javabin&version=2} {add=[4 (1438947898203045888)]} 0 1
[junit4:junit4] 2> 498339 T3409 C2628 P35711 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={distrib.from=http://127.0.0.1:35810/us/dl/collection1/&update.distrib=TOLEADER&test.distrib.skip.servers=http://127.0.0.1:40897/us/dl/collection1/&wt=javabin&version=2} {add=[4 (1438947898203045888)]} 0 7
[junit4:junit4] 2> 498339 T3460 C2627 P35810 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={test.distrib.skip.servers=http://127.0.0.1:40897/us/dl/collection1/&wt=javabin&version=2} {add=[4]} 0 8
[junit4:junit4] 2> 498340 T3373 oasc.ChaosMonkey.monkeyLog monkey: kill shard! 35711
[junit4:junit4] 2> 498361 T3373 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=20012095
[junit4:junit4] 2> 499105 T3396 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 499106 T3396 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"core_node1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:35711_us%2Fdl",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:35711/us/dl"}
[junit4:junit4] 2> 499106 T3396 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4:junit4] 2> 499109 T3465 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 499109 T3448 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 499109 T3431 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 499109 T3415 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 499109 T3402 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 499109 T3395 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 500363 T3373 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 500363 T3373 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 500366 T3373 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@66be85
[junit4:junit4] 2> 500369 T3373 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=6,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=1,adds=1,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=5,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0}
[junit4:junit4] 2> 500369 T3373 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 500369 T3373 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 500370 T3373 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> C2628_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, node_name=127.0.0.1:35711_us%2Fdl, base_url=http://127.0.0.1:35711/us/dl, leader=true}
[junit4:junit4] 2> 500372 T3373 C2628 P35711 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=3
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1377ac4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@122d2d4),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1377ac4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@122d2d4),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1377ac4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@122d2d4),segFN=segments_3,generation=3}
[junit4:junit4] 2> 500373 T3373 C2628 P35711 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 500374 T3373 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 500374 T3373 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 500375 T3373 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.SyncSliceTest-1372287629333/jetty1/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.SyncSliceTest-1372287629333/jetty1/index;done=false>>]
[junit4:junit4] 2> 500375 T3373 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.SyncSliceTest-1372287629333/jetty1/index
[junit4:junit4] 2> 500375 T3373 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.SyncSliceTest-1372287629333/jetty1 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.SyncSliceTest-1372287629333/jetty1;done=false>>]
[junit4:junit4] 2> 500376 T3373 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.SyncSliceTest-1372287629333/jetty1
[junit4:junit4] 2> 500377 T3415 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 500377 T3431 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 500377 T3395 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 500378 T3465 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 500378 T3402 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 500378 T3448 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 500378 T3402 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 500378 T3465 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 500378 T3448 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 500379 T3431 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 500380 T3395 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 500379 T3373 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/us/dl,null}
[junit4:junit4] 2> 500380 T3431 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4:junit4] 2> 500382 T3431 oasc.ShardLeaderElectionContext.shouldIBeLeader Checking if I should try and be the leader.
[junit4:junit4] 2> 500383 T3431 oasc.ShardLeaderElectionContext.shouldIBeLeader My last published State was Active, it's okay to be the leader.
[junit4:junit4] 2> 500383 T3431 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 500383 T3431 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:34479/us/dl/collection1/
[junit4:junit4] 2> 500383 T3431 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:34479/us/dl START replicas=[http://127.0.0.1:40897/us/dl/collection1/, http://127.0.0.1:35810/us/dl/collection1/] nUpdates=100
[junit4:junit4] 2> 500385 T3460 C2627 P35810 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 500385 T3443 C2630 P40897 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 500386 T3431 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:34479/us/dl Received 6 versions from 127.0.0.1:35810/us/dl/collection1/
[junit4:junit4] 2> 500386 T3431 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:34479/us/dl Our versions are newer. ourLowThreshold=1438947895933927424 otherHigh=1438947895970627584
[junit4:junit4] 2> 500402 T3431 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:34479/us/dl Received 5 versions from 127.0.0.1:40897/us/dl/collection1/
[junit4:junit4] 2> 500403 T3431 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:34479/us/dl Our versions are newer. ourLowThreshold=1438947895933927424 otherHigh=1438947895958044672
[junit4:junit4] 2> 500403 T3431 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:34479/us/dl DONE. sync succeeded
[junit4:junit4] 2> 500403 T3431 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 500403 T3431 oasc.SyncStrategy.syncToMe http://127.0.0.1:34479/us/dl/collection1/: try and ask http://127.0.0.1:40897/us/dl/collection1/ to sync
[junit4:junit4] 2> 500403 T3431 oasc.SyncStrategy.syncToMe http://127.0.0.1:34479/us/dl/collection1/: try and ask http://127.0.0.1:35810/us/dl/collection1/ to sync
[junit4:junit4] 2> ASYNC NEW_CORE C2632 name=collection1 org.apache.solr.core.SolrCore@1b84571 url=http://127.0.0.1:40897/us/dl/collection1 node=127.0.0.1:40897_us%2Fdl C2632_STATE=coll:collection1 core:collection1 props:{state=active, core=collection1, node_name=127.0.0.1:40897_us%2Fdl, base_url=http://127.0.0.1:40897/us/dl}
[junit4:junit4] 2> 500405 T3444 C2632 P40897 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:40897/us/dl START replicas=[http://127.0.0.1:34479/us/dl/collection1/] nUpdates=100
[junit4:junit4] 2> ASYNC NEW_CORE C2633 name=collection1 org.apache.solr.core.SolrCore@1bbb354 url=http://127.0.0.1:35810/us/dl/collection1 node=127.0.0.1:35810_us%2Fdl C2633_STATE=coll:collection1 core:collection1 props:{state=active, core=collection1, node_name=127.0.0.1:35810_us%2Fdl, base_url=http://127.0.0.1:35810/us/dl}
[junit4:junit4] 2> 500405 T3459 C2633 P35810 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:35810/us/dl START replicas=[http://127.0.0.1:34479/us/dl/collection1/] nUpdates=100
[junit4:junit4] 2> ASYNC NEW_CORE C2634 name=collection1 org.apache.solr.core.SolrCore@f6c3fe url=http://127.0.0.1:34479/us/dl/collection1 node=127.0.0.1:34479_us%2Fdl C2634_STATE=coll:collecti
[...truncated too long message...]
"leader":"true"},
[junit4:junit4] 1> "core_node4":{
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "node_name":"127.0.0.1:35810_us%2Fdl",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:35810/us/dl"}}}},
[junit4:junit4] 1> "router":"compositeId"},
[junit4:junit4] 1> "control_collection":{
[junit4:junit4] 1> "shards":{"shard1":{
[junit4:junit4] 1> "range":"80000000-7fffffff",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "replicas":{"core_node1":{
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "node_name":"127.0.0.1:45318_us%2Fdl",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:45318/us/dl",
[junit4:junit4] 1> "leader":"true"}}}},
[junit4:junit4] 1> "router":"compositeId"}}
[junit4:junit4] 1> /solr/aliases.json (0)
[junit4:junit4] 1> /solr/live_nodes (4)
[junit4:junit4] 1> /solr/live_nodes/127.0.0.1:35810_us%2Fdl (0)
[junit4:junit4] 1> /solr/live_nodes/127.0.0.1:45318_us%2Fdl (0)
[junit4:junit4] 1> /solr/live_nodes/127.0.0.1:35711_us%2Fdl (0)
[junit4:junit4] 1> /solr/live_nodes/127.0.0.1:40897_us%2Fdl (0)
[junit4:junit4] 1> /solr/overseer (3)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1>
[junit4:junit4] 1> /solr/overseer/queue (0)
[junit4:junit4] 1> /solr/overseer/queue-work (0)
[junit4:junit4] 1> /solr/overseer/collection-queue-work (0)
[junit4:junit4] 1> /solr/collections (2)
[junit4:junit4] 1> /solr/collections/collection1 (3)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {"configName":"conf1"}
[junit4:junit4] 1> /solr/collections/collection1/shards (0)
[junit4:junit4] 1> /solr/collections/collection1/leader_elect (1)
[junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard1 (1)
[junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard1/election (3)
[junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard1/election/89934242076164106-core_node3-n_0000000002 (0)
[junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard1/election/89934242076164108-core_node4-n_0000000003 (0)
[junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard1/election/89934242076164110-core_node1-n_0000000004 (0)
[junit4:junit4] 1> /solr/collections/collection1/leaders (1)
[junit4:junit4] 1> /solr/collections/collection1/leaders/shard1 (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "node_name":"127.0.0.1:40897_us%2Fdl",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:40897/us/dl"}
[junit4:junit4] 1> /solr/collections/control_collection (3)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {"configName":"conf1"}
[junit4:junit4] 1> /solr/collections/control_collection/shards (0)
[junit4:junit4] 1> /solr/collections/control_collection/leader_elect (1)
[junit4:junit4] 1> /solr/collections/control_collection/leader_elect/shard1 (1)
[junit4:junit4] 1> /solr/collections/control_collection/leader_elect/shard1/election (1)
[junit4:junit4] 1> /solr/collections/control_collection/leader_elect/shard1/election/89934242076164099-core_node1-n_0000000000 (0)
[junit4:junit4] 1> /solr/collections/control_collection/leaders (1)
[junit4:junit4] 1> /solr/collections/control_collection/leaders/shard1 (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "node_name":"127.0.0.1:45318_us%2Fdl",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:45318/us/dl"}
[junit4:junit4] 1> /solr/overseer_elect (2)
[junit4:junit4] 1> /solr/overseer_elect/election (4)
[junit4:junit4] 1> /solr/overseer_elect/election/89934242076164106-127.0.0.1:40897_us%2Fdl-n_0000000003 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89934242076164110-127.0.0.1:35711_us%2Fdl-n_0000000005 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89934242076164099-127.0.0.1:45318_us%2Fdl-n_0000000000 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89934242076164108-127.0.0.1:35810_us%2Fdl-n_0000000004 (0)
[junit4:junit4] 1> /solr/overseer_elect/leader (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {"id":"89934242076164099-127.0.0.1:45318_us%2Fdl-n_0000000000"}
[junit4:junit4] 1> /zookeeper (1)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1>
[junit4:junit4] 1>
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=SyncSliceTest -Dtests.method=testDistribSearch -Dtests.seed=7CA5FD4E6AE27A7 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=es_BO -Dtests.timezone=Atlantic/Reykjavik -Dtests.file.encoding=UTF-8
[junit4:junit4] FAILURE 99.0s J0 | SyncSliceTest.testDistribSearch <<<
[junit4:junit4] > Throwable #1: java.lang.AssertionError: shard1 is not consistent. Got 305 from http://127.0.0.1:35711/us/dl/collection1lastClient and got 250 from http://127.0.0.1:40897/us/dl/collection1
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([7CA5FD4E6AE27A7:862CD1CC91F1479B]:0)
[junit4:junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1045)
[junit4:junit4] > at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:237)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:724)
[junit4:junit4] 2> 573480 T3373 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 99016 T3372 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 4 leaked thread(s).
[junit4:junit4] 2> 573617 T3448 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 573617 T3448 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 573617 T3448 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 574704 T3465 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 574704 T3465 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 574705 T3465 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> NOTE: test params are: codec=Lucene40, sim=RandomSimilarityProvider(queryNorm=false,coord=yes): {}, locale=es_BO, timezone=Atlantic/Reykjavik
[junit4:junit4] 2> NOTE: Linux 3.2.0-48-generic i386/Oracle Corporation 1.8.0-ea (32-bit)/cpus=8,threads=1,free=110056424,total=420458496
[junit4:junit4] 2> NOTE: All tests run in this JVM: [HdfsUnloadDistributedZkTest, DirectSolrConnectionTest, SpatialFilterTest, TestReplicationHandler, TestSchemaSimilarityResource, RecoveryZkTest, SchemaVersionSpecificBehaviorTest, LeaderElectionTest, TestQuerySenderListener, TestRemoteStreaming, HdfsLockFactoryTest, PolyFieldTest, HdfsBasicDistributedZk2Test, TestCharFilters, SolrCoreTest, ScriptEngineTest, HdfsCollectionsAPIDistributedZkTest, TestIBSimilarityFactory, AutoCommitTest, TestSolrCoreProperties, TestStressRecovery, TestSweetSpotSimilarityFactory, TestQueryUtils, TestSolrIndexConfig, SuggesterFSTTest, TestRandomDVFaceting, TestReversedWildcardFilterFactory, MoreLikeThisHandlerTest, DirectUpdateHandlerOptimizeTest, PrimUtilsTest, ResponseLogComponentTest, TermVectorComponentTest, TestUniqueKeyFieldResource, LegacyHTMLStripCharFilterTest, TestRecoveryHdfs, HdfsRecoveryZkTest, FieldMutatingUpdateProcessorTest, SoftAutoCommitTest, TestPHPSerializedResponseWriter, BasicDistributedZkTest, UnloadDistributedZkTest, LoggingHandlerTest, PeerSyncTest, TestLMDirichletSimilarityFactory, OverseerCollectionProcessorTest, RAMDirectoryFactoryTest, SolrTestCaseJ4Test, UUIDFieldTest, IndexSchemaTest, TestJoin, SyncSliceTest]
[junit4:junit4] Completed on J0 in 100.34s, 1 test, 1 failure <<< FAILURES!
[...truncated 553 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:386: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:366: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:190: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:443: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1243: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:887: There were test failures: 311 suites, 1281 tests, 2 suite-level errors, 1 failure, 23 ignored (11 assumptions)
Total time: 39 minutes 33 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.8.0-ea-b94 -server -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.7.0_25) - Build #
6338 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/6338/
Java: 32bit/jdk1.7.0_25 -server -XX:+UseConcMarkSweepGC
All tests passed
Build Log:
[...truncated 31489 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:386: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:325: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:122: Source checkout is dirty after running tests!!! Offending files:
* solr/licenses/log4j-1.2.17.jar.sha1
Total time: 47 minutes 1 second
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.7.0_25 -server -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.7.0_25) - Build #
6337 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/6337/
Java: 32bit/jdk1.7.0_25 -client -XX:+UseParallelGC
All tests passed
Build Log:
[...truncated 31447 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:386: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:325: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:122: Source checkout is dirty after running tests!!! Offending files:
* solr/licenses/log4j-1.2.17.jar.sha1
Total time: 43 minutes 3 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.7.0_25 -client -XX:+UseParallelGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.8.0-ea-b94) - Build #
6336 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/6336/
Java: 32bit/jdk1.8.0-ea-b94 -server -XX:+UseG1GC
2 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest
Error Message:
FIXME: This test fails under Java 8 all the time, see SOLR-4711
Stack Trace:
com.carrotsearch.randomizedtesting.InternalAssumptionViolatedException: FIXME: This test fails under Java 8 all the time, see SOLR-4711
at __randomizedtesting.SeedInfo.seed([6B32BDEA9EDC8B8A]:0)
at com.carrotsearch.randomizedtesting.RandomizedTest.assumeTrue(RandomizedTest.java:598)
at com.carrotsearch.randomizedtesting.RandomizedTest.assumeFalse(RandomizedTest.java:606)
at org.apache.lucene.util.LuceneTestCase.assumeFalse(LuceneTestCase.java:672)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.beforeThisClass2(CollectionsAPIDistributedZkTest.java:99)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:491)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:677)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:724)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest
Error Message:
Can't set default locale to NULL
Stack Trace:
java.lang.NullPointerException: Can't set default locale to NULL
at __randomizedtesting.SeedInfo.seed([6B32BDEA9EDC8B8A]:0)
at java.util.Locale.setDefault(Locale.java:971)
at java.util.Locale.setDefault(Locale.java:933)
at org.apache.solr.cloud.hdfs.HdfsTestUtil.teardownClass(HdfsTestUtil.java:69)
at org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.teardownClass(HdfsCollectionsAPIDistributedZkTest.java:52)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:491)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:700)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:724)
Build Log:
[...truncated 9213 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest
[junit4:junit4] 2> 3542 T14 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /x/t
[junit4:junit4] 2> 3544 T14 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> NOTE: test params are: codec=FastCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST, chunkSize=84), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST, chunkSize=84)), sim=DefaultSimilarity, locale=ar_SA, timezone=IET
[junit4:junit4] 2> NOTE: Linux 3.2.0-48-generic i386/Oracle Corporation 1.8.0-ea (32-bit)/cpus=8,threads=1,free=52718264,total=67108864
[junit4:junit4] 2> NOTE: All tests run in this JVM: [TestElisionMultitermQuery, HdfsCollectionsAPIDistributedZkTest]
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=HdfsCollectionsAPIDistributedZkTest -Dtests.seed=6B32BDEA9EDC8B8A -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ar_SA -Dtests.timezone=IET -Dtests.file.encoding=US-ASCII
[junit4:junit4] ERROR 0.00s J1 | HdfsCollectionsAPIDistributedZkTest (suite) <<<
[junit4:junit4] > Assumption #1: FIXME: This test fails under Java 8 all the time, see SOLR-4711Throwable #2: java.lang.NullPointerException: Can't set default locale to NULL
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([6B32BDEA9EDC8B8A]:0)
[junit4:junit4] > at java.util.Locale.setDefault(Locale.java:971)
[junit4:junit4] > at java.util.Locale.setDefault(Locale.java:933)
[junit4:junit4] > at org.apache.solr.cloud.hdfs.HdfsTestUtil.teardownClass(HdfsTestUtil.java:69)
[junit4:junit4] > at org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.teardownClass(HdfsCollectionsAPIDistributedZkTest.java:52)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:724)
[junit4:junit4] Completed on J1 in 0.21s, 0 tests, 1 error <<< FAILURES!
[...truncated 965 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:386: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:366: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:190: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:443: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1243: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:887: There were test failures: 312 suites, 1314 tests, 2 suite-level errors, 23 ignored (11 assumptions)
Total time: 37 minutes 48 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.8.0-ea-b94 -server -XX:+UseG1GC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.7.0_25) - Build #
6335 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/6335/
Java: 64bit/jdk1.7.0_25 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC
All tests passed
Build Log:
[...truncated 34703 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:386: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:325: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:122: Source checkout is dirty after running tests!!! Offending files:
* solr/licenses/log4j-1.2.17.jar.sha1
Total time: 47 minutes 9 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0_25 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.7.0_25) - Build #
6334 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/6334/
Java: 64bit/jdk1.7.0_25 -XX:-UseCompressedOops -XX:+UseSerialGC
2 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.BasicZkTest
Error Message:
1 thread leaked from SUITE scope at org.apache.solr.cloud.BasicZkTest: 1) Thread[id=3594, name=IPC Parameter Sending Thread #2, state=TIMED_WAITING, group=TGRP-TestRecoveryHdfs] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.BasicZkTest:
1) Thread[id=3594, name=IPC Parameter Sending Thread #2, state=TIMED_WAITING, group=TGRP-TestRecoveryHdfs]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
at __randomizedtesting.SeedInfo.seed([E9F9C2C20847E8C4]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.BasicZkTest
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=3594, name=IPC Parameter Sending Thread #2, state=TIMED_WAITING, group=TGRP-TestRecoveryHdfs] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=3594, name=IPC Parameter Sending Thread #2, state=TIMED_WAITING, group=TGRP-TestRecoveryHdfs]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
at __randomizedtesting.SeedInfo.seed([E9F9C2C20847E8C4]:0)
Build Log:
[...truncated 9594 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicZkTest
[junit4:junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicZkTest-1372343602384
[junit4:junit4] 2> 434362 T3572 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 434362 T3573 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 434462 T3572 oasc.ZkTestServer.run start zk server on port:33134
[junit4:junit4] 2> 434463 T3572 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 434500 T3579 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7eebb877 name:ZooKeeperConnection Watcher:127.0.0.1:33134 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 434500 T3572 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 434500 T3572 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 434506 T3572 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 434507 T3581 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@304e96b2 name:ZooKeeperConnection Watcher:127.0.0.1:33134/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 434507 T3572 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 434507 T3572 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 434510 T3572 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 434512 T3572 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 434514 T3572 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 434516 T3572 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 434516 T3572 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 434519 T3572 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 434520 T3572 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 434528 T3572 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 434528 T3572 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 434530 T3572 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 434531 T3572 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 434533 T3572 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 434533 T3572 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 434536 T3572 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 434536 T3572 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 434538 T3572 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 434538 T3572 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 434540 T3572 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 434540 T3572 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 434542 T3572 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 434543 T3572 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 434546 T3572 oas.SolrTestCaseJ4.initCore ####initCore
[junit4:junit4] 2> 434546 T3572 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/'
[junit4:junit4] 2> 434546 T3572 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/lib/README' to classloader
[junit4:junit4] 2> 434547 T3572 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 434575 T3572 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 434611 T3572 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 434612 T3572 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 434615 T3572 oass.IndexSchema.readSchema [null] Schema name=test
[junit4:junit4] 2> 434917 T3572 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 434922 T3572 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 434925 T3572 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 434929 T3572 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 434932 T3572 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 434934 T3572 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 434934 T3572 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 434935 T3572 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 434935 T3572 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 434935 T3572 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 434935 T3572 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 434936 T3572 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 434936 T3572 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr
[junit4:junit4] 2> 434936 T3572 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/'
[junit4:junit4] 2> 434943 T3572 oasc.CoreContainer.<init> New CoreContainer 2083202670
[junit4:junit4] 2> 434943 T3572 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:33134/solr
[junit4:junit4] 2> 434944 T3572 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 434944 T3572 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 434946 T3583 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@74e83f71 name:ZooKeeperConnection Watcher:127.0.0.1:33134 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 434946 T3572 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 434948 T3572 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=30000&connTimeout=30000
[junit4:junit4] 2> 434952 T3572 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 434954 T3585 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7aaafa04 name:ZooKeeperConnection Watcher:127.0.0.1:33134/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 434955 T3572 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 434956 T3572 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 434959 T3572 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 434961 T3572 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 434962 T3572 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/188.138.97.18:8983_solr
[junit4:junit4] 2> 434963 T3572 oascc.SolrZkClient.makePath makePath: /live_nodes/188.138.97.18:8983_solr
[junit4:junit4] 2> 434965 T3572 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 434969 T3572 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 434970 T3572 oasc.Overseer.start Overseer (id=89937910326034435-188.138.97.18:8983_solr-n_0000000000) starting
[junit4:junit4] 2> 434972 T3572 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 434975 T3587 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 434975 T3572 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 434977 T3572 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 434978 T3572 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 434980 T3586 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 435013 T3572 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 435013 T3572 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 435015 T3572 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4:junit4] 2> 436484 T3586 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 436485 T3586 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"core_node1",
[junit4:junit4] 2> "numShards":null,
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"188.138.97.18:8983_solr",
[junit4:junit4] 2> "base_url":"http://188.138.97.18:8983/solr"}
[junit4:junit4] 2> 436485 T3586 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 436488 T3585 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 437015 T3572 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4:junit4] 2> 437016 T3572 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 437016 T3572 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 437018 T3572 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4:junit4] 2> 437018 T3572 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 437018 T3572 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicZkTest-1372343602384/
[junit4:junit4] 2> 437018 T3572 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@48834a71
[junit4:junit4] 2> 437019 T3572 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicZkTest-1372343602384
[junit4:junit4] 2> 437019 T3572 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicZkTest-1372343602384/index/
[junit4:junit4] 2> 437019 T3572 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicZkTest-1372343602384/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 437020 T3572 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicZkTest-1372343602384/index
[junit4:junit4] 2> 437021 T3572 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(MockDirWrapper(org.apache.lucene.store.RAMDirectory@9ce7c54 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7304c2e6)),segFN=segments_1,generation=1}
[junit4:junit4] 2> 437021 T3572 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 437022 T3572 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4] 2> 437023 T3572 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 437023 T3572 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4] 2> 437024 T3572 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 437024 T3572 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4] 2> 437024 T3572 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 437025 T3572 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 437025 T3572 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 437025 T3572 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 437026 T3572 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 437026 T3572 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4] 2> 437026 T3572 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4] 2> 437027 T3572 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 437027 T3572 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 437027 T3572 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 437028 T3572 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 437028 T3572 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 437028 T3572 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 437029 T3572 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 437029 T3572 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 437029 T3572 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 437030 T3572 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 437030 T3572 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 437030 T3572 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 437031 T3572 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 437031 T3572 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4] 2> 437032 T3572 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4] 2> 437034 T3572 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 437035 T3572 oasc.SolrCore.initDeprecatedSupport WARN solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4] 2> 437037 T3572 oasc.SolrCore.initDeprecatedSupport WARN adding ShowFileRequestHandler with hidden files: [THROW.ERROR.ON.ADD.UPDATEPROCESSOR.JS, SOLRCONFIG-HIGHLIGHT.XML, SCHEMA-REQUIRED-FIELDS.XML, SCHEMA-REPLICATION2.XML, TRIVIAL.UPDATEPROCESSOR1.JS, SCHEMA-MINIMAL.XML, BAD-SCHEMA-DOCVALUES-NOT-REQUIRED-NO-DEFAULT.XML, BAD-SCHEMA-DUP-DYNAMICFIELD.XML, SOLRCONFIG-CACHING.XML, BAD-SOLRCONFIG-UNEXPECTED-SCHEMA-ATTRIBUTE.XML, SCHEMA-POSTINGSHIGHLIGHT.XML, SOLRCONFIG-REPEATER.XML, REGEX-BOOST-PROCESSOR-TEST.TXT, SOLRCONFIG-MERGEPOLICY.XML, BAD-SCHEMA-NONTEXT-ANALYZER.XML, BAD-SCHEMA-CURRENCY-FT-BOGUS-CODE-IN-XML.XML, CURRENCY.XML, SOLRCONFIG-TLOG.XML, SOLRCONFIG-MASTER.XML, SOLRCONFIG-COMPONENTS-NAME.XML, SOLRCONFIG-MERGEPOLICY-LEGACY.XML, BAD-SCHEMA-UNIQUEKEY-MULTIVALUED.XML, SCHEMA11.XML, SOLRCONFIG-BASIC.XML, DA_COMPOUNDDICTIONARY.TXT, MISSLEADING.EXTENSION.UPDATEPROCESSOR.JS.TXT, SCHEMA-COPYFIELD-TEST.XML, SOLRCONFIG-SLAVE.XML, ELEVATE.XML, SOLRCONFIG-PROPINJECT-INDEXDEFAULT.XML, TRIVIAL.UPDATEPROCESSOR0.JS, SCHEMA-SWEETSPOT.XML, BAD-SOLRCONFIG-BOGUS-SCRIPTENGINE-NAME.XML, SCHEMA-CHARFILTERS.XML, SCHEMA-IB.XML, BAD-SCHEMA-MISPLACED-ASTERISK-COPYFIELD-SOURCE-SHOULD-FAIL-TEST.XML, SOLRCONFIG-QUERYSENDER.XML, SCHEMA-REPLICATION1.XML, SOLRCONFIG-SNIPPET-PROCESSOR.XML, DA_UTF8.XML, BAD-SCHEMA-NON-GLOB-COPYFIELD-SOURCE-MATCHING-NOTHING-SHOULD-FAIL-TEST.XML, SCHEMA-TINY.XML, CONDITIONAL.UPDATEPROCESSOR.JS, SOLRCONFIG-DEFAULTS.XML, MISSING.FUNCTIONS.UPDATEPROCESSOR.JS, SOLRCONFIG-ENABLEPLUGIN.XML, HYPHENATION.DTD, BAD-SOLRCONFIG-SCHEMA-MUTABLE-BUT-NOT-MANAGED.XML, SCHEMA-PHRASESUGGEST.XML, STEMDICT.TXT, SCHEMA-ID-AND-VERSION-FIELDS-ONLY.XML, HUNSPELL-TEST.AFF, BAD-SCHEMA-CURRENCY-FT-OER-NORATES.XML, SCHEMA-SNIPPET-TYPE.XML, STOPTYPES-1.TXT, STOPWORDSWRONGENCODING.TXT, SCHEMA-NUMERIC.XML, SOLRCONFIG-TRANSFORMERS.XML, SOLRCONFIG-PROPINJECT.XML, BAD-SCHEMA-NOT-INDEXED-BUT-TF.XML, SOLRCONFIG-SIMPLELOCK.XML, SCHEMA-DOCVALUES.XML, SOLRCONFIG-TLOG-MUTABLE-MANAGED-SCHEMA.XML, WDFTYPES.TXT, SCHEMA-REVERSED.XML, STOPTYPES-2.TXT, BAD-SCHEMA-CURRENCY-FT-MULTIVALUED.XML, BAD-SCHEMA-BOGUS-ANALYSIS-PARAMETERS.XML, SOLRCONFIG-SPELLCHECKCOMPONENT.XML, BAD-SCHEMA-CURRENCY-MULTIVALUED.XML, SOLRCONFIG-PHRASESUGGEST.XML, SCHEMA-DFR.XML, BAD-SCHEMA-NOT-INDEXED-BUT-POS.XML, KEEP-1.TXT, SCHEMA-SPATIAL.XML, OPEN-EXCHANGE-RATES.JSON, STOPWITHBOM.TXT, SCHEMA-BINARYFIELD.XML, SOLRCONFIG-SPELLCHECKER.XML, SOLRCONFIG-POSTINGSHIGHLIGHT.XML, SOLRCONFIG-WARMER.XML, SOLRCONFIG-UPDATE-PROCESSOR-CHAINS.XML, BAD-SCHEMA-OMIT-TF-BUT-NOT-POS.XML, BAD-SCHEMA-DUP-FIELDTYPE.XML, SCHEMA-XINCLUDE.XML, SOLRCONFIG-MASTER1.XML, BAD-SCHEMA-MULTIPLE-ASTERISK-COPYFIELD-SOURCE-SHOULD-FAIL-TEST.XML, SCHEMA-BEHAVIOR.XML, SYNONYMS.TXT, SOLRCONFIG-MINIMAL.XML, SCHEMA-DOCVALUESMULTI.XML, BAD-SCHEMA-CURRENCY-DYNAMIC-MULTIVALUED.XML, BAD-SCHEMA-UNSUPPORTED-DOCVALUES.XML, SCHEMA_CODEC.XML, BAD-SCHEMA-SWEETSPOT-PARTIAL-HYPERBOLIC.XML, SOLRCONFIG-SOLR-749.XML, SOLRCONFIG-MASTER1-KEEPONEBACKUP.XML, SCHEMA-EFF.XML, SOLRCONFIG-FUNCTIONQUERY.XML, STOP-2.TXT, SCHEMA-LMDIRICHLET.XML, SOLRCONFIG-TERMINDEX.XML, SCHEMA-ONE-FIELD-NO-DYNAMIC-FIELD.XML, BAD-SCHEMA-SWEETSPOT-PARTIAL-NORMS.XML, SOLRCONFIG-ELEVATE.XML, BAD-SCHEMA-SWEETSPOT-PARTIAL-BASELINE.XML, STOPWORDS.TXT, SCHEMA-FOLDING.XML, SCHEMA-STOP-KEEP.XML, BAD-SCHEMA-BOGUS-FIELD-PARAMETERS.XML, FUZZYSUGGEST.TXT, BAD-SOLRCONFIG-MANAGED-SCHEMA-NAMED-SCHEMA.XML.XML, BAD-SCHEMA-NOT-INDEXED-BUT-NORMS.XML, SCHEMA-REST.XML, SOLRCONFIG-TLOG-MANAGED-SCHEMA.XML, SOLRCONFIG-PARSING-UPDATE-PROCESSOR-CHAINS.XML, SOLRCONFIG-SOLCOREPROPERTIES.XML, STOP-1.TXT, SOLRCONFIG-MANAGED-SCHEMA.XML, SOLRCONFIG-MASTER2.XML, SOLRCONFIG-MERGEPOLICY-DEFAULTS.XML, SCHEMA-SPELLCHECKER.XML, SOLRCONFIG-RESPONSE-LOG-COMPONENT.XML, BAD-SCHEMA-MISPLACED-ASTERISK-COPYFIELD-DEST-SHOULD-FAIL-TEST.XML, SOLRCONFIG-LAZYWRITER.XML, SCHEMA-LUCENEMATCHVERSION.XML, SCHEMA-CLASS-NAME-SHORTENING-ON-SERIALIZATION.XML, FRENCHARTICLES.TXT, BAD-MP-SOLRCONFIG.XML, SCHEMA15.XML, SOLRCONFIG-REQHANDLER.INCL, SCHEMASURROUND.XML, SOLRCONFIG-MASTER3.XML, HUNSPELL-TEST.DIC, BAD-SCHEMA-MULTIPLE-ASTERISK-COPYFIELD-DEST-SHOULD-FAIL-TEST.XML, BAD-SCHEMA-CODEC-GLOBAL-VS-FT-MISMATCH.XML, SOLRCONFIG-XINCLUDE.XML, SOLRCONFIG-SLAVE1.XML, SOLRCONFIG-DELPOLICY1.XML, SCHEMA-SIM.XML, SCHEMA-SNIPPET-FIELD.XML, SCHEMA-COLLATE.XML, STOP-SNOWBALL.TXT, BAD-SCHEMA-SIM-GLOBAL-VS-FT-MISMATCH.XML, PROTWORDS.TXT, SCHEMA-TRIE.XML, SOLRCONFIG_CODEC.XML, SCHEMA-SYNONYM-TOKENIZER.XML, BAD-SOLRCONFIG-INVALID-SCRIPTFILE.XML, JASUGGEST.TXT, SCHEMA-REST-LUCENE-MATCH-VERSION.XML, SCHEMA-DOCVALUESFACETING.XML, SCHEMA-TFIDF.XML, SOLRCONFIG-SCRIPT-UPDATEPROCESSOR.XML, SCHEMA-LMJELINEKMERCER.XML, PHRASESUGGEST.TXT, BAD-SOLRCONFIG-MISSING-SCRIPTFILE.XML, BAD-SCHEMA-UNIQUEKEY-USES-DEFAULT.XML, OLD_SYNONYMS.TXT, SOLRCONFIG-DELPOLICY2.XML, XSLT, SOLRCONFIG-NATIVELOCK.XML, BAD-SCHEMA-DUP-FIELD.XML, SOLRCONFIG-MUTABLE-MANAGED-SCHEMA.XML, SOLRCONFIG-NOCACHE.XML, SCHEMA-BM25.XML, BAD-SCHEMA-SWEETSPOT-BOTH-TF.XML, ADDFIELDS.UPDATEPROCESSOR.JS, SOLRCONFIG-QUERYSENDER-NOQUERY.XML, SOLRCONFIG-ALTDIRECTORY.XML, COMPOUNDDICTIONARY.TXT, SOLRCONFIG_PERF.XML, BAD-SCHEMA-CURRENCY-FT-BOGUS-DEFAULT-CODE.XML, BAD-CURRENCY.XML, SOLRCONFIG-INDEXCONFIG.XML, BAD-SCHEMA-ANALYZER-CLASS-AND-NESTED.XML, SCHEMA-NOT-REQUIRED-UNIQUE-KEY.XML, KEEP-2.TXT, SCHEMA12.XML, BAD-SCHEMA-UNIQUEKEY-IS-COPYFIELD-DEST.XML, MAPPING-ISOLATIN1ACCENT.TXT, BAD_SOLRCONFIG.XML, SOLRCONFIG.SNIPPET.RANDOMINDEXCONFIG.XML, BAD-SCHEMA-EXTERNAL-FILEFIELD.XML]
[junit4:junit4] 2> 437039 T3572 oass.SolrIndexSearcher.<init> Opening Searcher@4de59c72 main
[junit4:junit4] 2> 437039 T3572 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 437040 T3572 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 437040 T3572 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4] 2> 437044 T3572 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4] 2> 437063 T3588 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4de59c72 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 437067 T3572 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 437067 T3572 oasc.ZkController.register Register replica - core:collection1 address:http://188.138.97.18:8983/solr collection:collection1 shard:shard1
[junit4:junit4] 2> 437068 T3572 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 437076 T3572 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4:junit4] 2> 437077 T3572 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 437078 T3572 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 437078 T3572 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://188.138.97.18:8983/solr/collection1/ shard1
[junit4:junit4] 2> 437078 T3572 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 437992 T3586 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 437993 T3586 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"core_node1",
[junit4:junit4] 2> "numShards":null,
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"188.138.97.18:8983_solr",
[junit4:junit4] 2> "base_url":"http://188.138.97.18:8983/solr"}
[junit4:junit4] 2> 438000 T3585 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 438037 T3572 oasc.ZkController.register We are http://188.138.97.18:8983/solr/collection1/ and leader is http://188.138.97.18:8983/solr/collection1/
[junit4:junit4] 2> 438037 T3572 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://188.138.97.18:8983/solr
[junit4:junit4] 2> 438037 T3572 oasc.ZkController.checkRecovery WARN Skipping recovery according to sys prop solrcloud.skip.autorecovery
[junit4:junit4] 2> 438037 T3572 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 438038 T3572 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 438039 T3572 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 438042 T3572 oas.SolrTestCaseJ4.initCore ####initCore end
[junit4:junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> 438058 T3572 oas.SolrTestCaseJ4.setUp ###Starting testBasic
[junit4:junit4] 2> 438059 T3572 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(MockDirWrapper(org.apache.lucene.store.RAMDirectory@9ce7c54 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7304c2e6)),segFN=segments_1,generation=1}
[junit4:junit4] 2> 438060 T3572 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> ASYNC NEW_CORE C2066 name=collection1 org.apache.solr.core.SolrCore@2746ec1f url=http://188.138.97.18:8983/solr/collection1 node=188.138.97.18:8983_solr C2066_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, node_name=188.138.97.18:8983_solr, base_url=http://188.138.97.18:8983/solr, leader=true}
[junit4:junit4] 2> 438060 T3572 C2066 P8983 oasc.SolrCore.execute [collection1] webapp=null path=null params={start=0&q=qlkciyopsbgzyvkylsjhchghjrdf&qt=standard&rows=20&version=2.2} hits=0 status=0 QTime=0
[junit4:junit4] 2> 438069 T3572 C2066 P8983 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {delete=[42 (-1439006569100476416)]} 0 1
[junit4:junit4] 2> 438075 T3572 C2066 P8983 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[42 (1439006569106767872)]} 0 1
[junit4:junit4] 2> 438080 T3572 C2066 P8983 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 438083 T3572 C2066 P8983 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(MockDirWrapper(org.apache.lucene.store.RAMDirectory@9ce7c54 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7304c2e6)),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(MockDirWrapper(org.apache.lucene.store.RAMDirectory@9ce7c54 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7304c2e6)),segFN=segments_2,generation=2}
[junit4:junit4] 2> 438084 T3572 C2066 P8983 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 438085 T3572 C2066 P8983 oass.SolrIndexSearcher.<init> Opening Searcher@7887b8f2 main
[junit4:junit4] 2> 438085 T3572 C2066 P8983 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 438086 T3588 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7887b8f2 main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):C1)}
[junit4:junit4] 2> 438087 T3572 C2066 P8983 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {commit=} 0 7
[junit4:junit4] 2> 438089 T3572 C2066 P8983 oasc.SolrCore.execute [collection1] webapp=null path=null params={start=0&q=id:42+AND+val_s:aa\;bb&qt=standard&rows=20&version=2.2} hits=1 status=0 QTime=0
[junit4:junit4] 2> 438091 T3572 C2066 P8983 oasc.SolrCore.execute [collection1] webapp=null path=null params={start=0&q=id:42+AND+val_s:"aa;bb"&qt=standard&rows=20&version=2.2} hits=1 status=0 QTime=0
[junit4:junit4] 2> 438093 T3572 C2066 P8983 oasc.SolrCore.execute [collection1] webapp=null path=null params={start=0&q=id:42+AND+val_s:aa&qt=standard&rows=20&version=2.2} hits=0 status=0 QTime=0
[junit4:junit4] 2> 438099 T3572 C2066 P8983 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {delete=[42 (-1439006569131933696)]} 0 1
[junit4:junit4] 2> 438104 T3572 C2066 P8983 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 438105 T3572 C2066 P8983 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4] 2> 438105 T3572 C2066 P8983 oass.SolrIndexSearcher.<init> Opening Searcher@2b5f1ca5 main
[junit4:junit4] 2> 438105 T3572 C2066 P8983 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 438107 T3588 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2b5f1ca5 main{StandardDirectoryReader(segments_2:5:nrt)}
[junit4:junit4] 2> 438108 T3572 C2066 P8983 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {commit=} 0 4
[junit4:junit4] 2> 438109 T3572 C2066 P8983 oasc.SolrCore.execute [collection1] webapp=null path=null params={start=0&q=id:42&qt=standard&rows=20&version=2.2} hits=0 status=0 QTime=0
[junit4:junit4] 2> 438115 T3572 C2066 P8983 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[42 (1439006569148710912)]} 0 1
[junit4:junit4] 2> 438121 T3572 C2066 P8983 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[42 (1439006569155002368)]} 0 1
[junit4:junit4] 2> 438126 T3572 C2066 P8983 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 438129 T3572 C2066 P8983 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(MockDirWrapper(org.apache.lucene.store.RAMDirectory@9ce7c54 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7304c2e6)),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(MockDirWrapper(org.apache.lucene.store.RAMDirectory@9ce7c54 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7304c2e6)),segFN=segments_3,generation=3}
[junit4:junit4] 2> 438129 T3572 C2066 P8983 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 438131 T3572 C2066 P8983 oass.SolrIndexSearcher.<init> Opening Searcher@439f901c main
[junit4:junit4] 2> 438131 T3572 C2066 P8983 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 438133 T3588 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@439f901c main{StandardDirectoryReader(segments_3:7:nrt _1(5.0):C2/1)}
[junit4:junit4] 2> 438133 T3572 C2066 P8983 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {commit=} 0 7
[junit4:junit4] 2> 438134 T3572 C2066 P8983 oasc.SolrCore.execute [collection1] webapp=null path=null params={start=0&q=id:42&qt=standard&rows=20&version=2.2} hits=1 status=0 QTime=0
[junit4:junit4] 2> 438141 T3572 C2066 P8983 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[42 (1439006569175973888)]} 0 1
[junit4:junit4] 2> 438147 T3572 C2066 P8983 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[42 (1439006569182265344)]} 0 1
[junit4:junit4] 2> 438152 T3572 C2066 P8983 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 438155 T3572 C2066 P8983 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(MockDirWrapper(org.apache.lucene.store.RAMDirectory@9ce7c54 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7304c2e6)),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(MockDirWrapper(org.apache.lucene.store.RAMDirectory@9ce7c54 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7304c2e6)),segFN=segments_4,generation=4}
[junit4:junit4] 2> 438156 T3572 C2066 P8983 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4:junit4] 2> 438157 T3572 C2066 P8983 oass.SolrIndexSearcher.<init> Opening Searcher@55249881 main
[junit4:junit4] 2> 438158 T3572 C2066 P8983 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 438159 T3588 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@55249881 main{StandardDirectoryReader(segments_4:11:nrt _2(5.0):C2/1)}
[junit4:junit4] 2> 438160 T3572 C2066 P8983 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {commit=} 0 8
[junit4:junit4] 2> 438161 T3572 C2066 P8983 oasc.SolrCore.execute [collection1] webapp=null path=null params={start=0&q=id:42&qt=standard&rows=20&version=2.2} hits=1 status=0 QTime=0
[junit4:junit4] 2> 438168 T3572 C2066 P8983 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[101 (1439006569204285440)]} 0 1
[junit4:junit4] 2> 438174 T3572 C2066 P8983 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[101 (1439006569210576896)]} 0 1
[junit4:junit4] 2> 438179 T3572 C2066 P8983 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[105 (1439006569216868352)]} 0 0
[junit4:junit4] 2> 438185 T3572 C2066 P8983 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[102 (1439006569223159808)]} 0 0
[junit4:junit4] 2> 438191 T3572 C2066 P8983 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[103 (1439006569229451264)]} 0 1
[junit4:junit4] 2> 438197 T3572 C2066 P8983 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[101 (1439006569234694144)]} 0 1
[junit4:junit4] 2> 438202 T3572 C2066 P8983 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 438207 T3572 C2066 P8983 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(MockDirWrapper(org.apache.lucene.store.RAMDirectory@9ce7c54 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7304c2e6)),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(MockDirWrapper(org.apache.lucene.store.RAMDirectory@9ce7c54 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7304c2e6)),segFN=segments_5,generation=5}
[junit4:junit4] 2> 438207 T3572 C2066 P8983 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 5
[junit4:junit4] 2> 438209 T3572 C2066 P8983 oass.SolrIndexSearcher.<init> Opening Searcher@6d422184 main
[junit4:junit4] 2> 438209 T3572 C2066 P8983 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 438211 T3588 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6d422184 main{StandardDirectoryReader(segments_5:13:nrt _2(5.0):C2/1 _3(5.0):C6/2)}
[junit4:junit4] 2> 438211 T3572 C2066 P8983 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {commit=} 0 9
[junit4:junit4] 2> 438213 T3572 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:33134 33134
[junit4:junit4] 2> 438315 T3585 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: null state: Disconnected type None
[junit4:junit4] 2> 438315 T3585 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7aaafa04 name:ZooKeeperConnection Watcher:127.0.0.1:33134/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4:junit4] 2> 438315 T3585 oascc.ConnectionManager.process zkClient has disconnected
[junit4:junit4] 2> 438515 T3572 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 438516 T3589 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 438616 T3572 oasc.ZkTestServer.run start zk server on port:33134
[junit4:junit4] 2> 438917 T3572 C2066 P8983 oasc.SolrCore.execute [collection1] webapp=null path=null params={q=id:[100+TO+110]&rows=2147483647} hits=4 status=0 QTime=0
[junit4:junit4] 2> 438919 T3572 C2066 P8983 oasc.SolrCore.execute [collection1] webapp=null path=null params={q=id:[100+TO+111]&rows=1147483647} hits=4 status=0 QTime=0
[junit4:junit4] 2> 438921 T3572 C2066 P8983 oasc.SolrCore.execute [collection1] webapp=null path=null params={start=0&q=id:[100+TO+110]&qt=standard&rows=20&version=2.2} hits=4 status=0 QTime=0
[junit4:junit4] 2> 438926 T3572 C2066 P8983 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {delete=[102 (-1439006570000154624)]} 0 0
[junit4:junit4] 2> ASYNC NEW_CORE C2067 name=collection1 org.apache.solr.core.SolrCore@2746ec1f url=http://188.138.97.18:8983/solr/collection1 node=188.138.97.18:8983_solr C2067_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, node_name=188.138.97.18:8983_solr, base_url=http://188.138.97.18:8983/solr, leader=true}
[junit4:junit4] 2> 438941 T3572 C2067 P8983 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 438942 T3572 C2067 P8983 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4] 2> 438942 T3572 C2067 P8983 oass.SolrIndexSearcher.<init> Opening Searcher@7085c1cd main
[junit4:junit4] 2> 438943 T3572 C2067 P8983 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 438944 T3588 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7085c1cd main{StandardDirectoryReader(segments_5:14:nrt _2(5.0):C2/1 _3(5.0):C6/3)}
[junit4:junit4] 2> 438945 T3572 C2067 P8983 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {commit=} 0 4
[junit4:junit4] 2> 438946 T3572 C2067 P8983 oasc.SolrCore.execute [collection1] webapp=null path=null params={start=0&q=id:[100+TO+110]&qt=standard&rows=20&version=2.2} hits=3 status=0 QTime=0
[junit4:junit4] 2> 438952 T3572 C2067 P8983 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {delete=[105 (-1439006570026369024)]} 0 1
[junit4:junit4] 2> 438957 T3572 C2067 P8983 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 438958 T3572 C2067 P8983 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(MockDirWrapper(org.apache.lucene.store.RAMDirectory@9ce7c54 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7304c2e6)),segFN=segments_5,generation=5}
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(MockDirWrapper(org.apache.lucene.store.RAMDirectory@9ce7c54 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7304c2e6)),segFN=segments_6,generation=6}
[junit4:junit4] 2> 438958 T3572 C2067 P8983 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 6
[junit4:junit4] 2> 438959 T3572 C2067 P8983 oass.SolrIndexSearcher.<init> Opening Searcher@5ef94325 main
[junit4:junit4] 2> 438959 T3572 C2067 P8983 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 438961 T3588 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5ef94325 main{StandardDirectoryReader(segments_6:15:nrt _2(5.0):C2/1 _3(5.0):C6/4)}
[junit4:junit4] 2> 438961 T3572 C2067 P8983 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {commit=} 0 4
[junit4:junit4] 2> 438963 T3572 C2067 P8983 oasc.SolrCore.execute [collection1] webapp=null path=null params={start=0&q=id:[100+TO+110]&qt=standard&rows=20&version=2.2} hits=2 status=0 QTime=1
[junit4:junit4] 2> 438969 T3572 C2067 P8983 oass.SolrIndexSearcher.<init> Opening Searcher@4ac307fe realtime
[junit4:junit4] 2> 438970 T3572 C2067 P8983 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {deleteByQuery=id:[100 TO 110] (-1439006570044194816)} 0 2
[junit4:junit4] 2> 438975 T3572 C2067 P8983 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 438975 T3572 C2067 P8983 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(MockDirWrapper(org.apache.lucene.store.RAMDirectory@9ce7c54 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7304c2e6)),segFN=segments_6,generation=6}
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(MockDirWrapper(org.apache.lucene.store.RAMDirectory@9ce7c54 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7304c2e6)),segFN=segments_7,generation=7}
[junit4:junit4] 2> 438976 T3572 C2067 P8983 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 7
[junit4:junit4] 2> 438976 T3572 C2067 P8983 oass.SolrIndexSearcher.<init> Opening Searcher@3d3f562f main
[junit4:junit4] 2> 438977 T3572 C2067 P8983 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 438978 T3588 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3d3f562f main{StandardDirectoryReader(segments_6:17:nrt _2(5.0):C2/1)}
[junit4:junit4] 2> 438979 T3572 C2067 P8983 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {commit=} 0 4
[junit4:junit4] 2> 438980 T3572 C2067 P8983 oasc.SolrCore.execute [collection1] webapp=null path=null params={start=0&q=id:[100+TO+110]&qt=standard&rows=20&version=2.2} hits=0 status=0 QTime=0
[junit4:junit4] 2> 440124 T3585 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: null state: SyncConnected type None
[junit4:junit4] 2> 440125 T3585 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7aaafa04 name:ZooKeeperConnection Watcher:127.0.0.1:33134/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 440127 T3572 oasc.CoreContainer.reload Reloading SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1
[junit4:junit4] 2> 440128 T3572 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 440129 T3572 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 440129 T3572 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 440129 T3586 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 440130 T3586 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"core_node1",
[junit4:junit4] 2> "numShards":null,
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"188.138.97.18:8983_solr",
[junit4:junit4] 2> "base_url":"http://188.138.97.18:8983/solr"}
[junit4:junit4] 2> 440130 T3572 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/'
[junit4:junit4] 2> 440131 T3572 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/lib/README' to classloader
[junit4:junit4] 2> 440131 T3572 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 440133 T3585 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 440146 T3572 oasc.SolrException.log ERROR Exception during parsing file: solrconfig.xml:org.xml.sax.SAXParseException; systemId: solrres:/solrconfig.xml; lineNumber: 1; columnNumber: 1; Premature end of file.
[junit4:junit4] 2> at com.sun.org.apache.xerces.internal.util.ErrorHandlerWrapper.createSAXParseException(ErrorHandlerWrapper.java:198)
[junit4:junit4] 2> at com.sun.org.apache.xerces.internal.util.ErrorHandlerWrapper.fatalError(ErrorHandlerWrapper.java:177)
[junit4:junit4] 2> at com.sun.org.apache.xerces.internal.impl.XMLErrorReporter.reportError(XMLErrorReporter.java:441)
[junit4:junit4] 2> at com.sun.org.apache.xerces.internal.impl.XMLErrorReporter.reportError(XMLErrorReporter.java:368)
[junit4:junit4] 2> at com.sun.org.apache.xerces.internal.impl.XMLScanner.reportFatalError(XMLScanner.java:1388)
[junit4:junit4] 2> at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl$PrologDriver.next(XMLDocumentScannerImpl.java:1018)
[junit4:junit4] 2> at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.next(XMLDocumentScannerImpl.java:607)
[junit4:junit4] 2> at com.sun.org.apache.xerces.internal.impl.XMLNSDocumentScannerImpl.next(XMLNSDocumentScannerImpl.java:116)
[junit4:junit4] 2> at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(XMLDocumentFragmentScannerImpl.java:489)
[junit4:junit4] 2> at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:835)
[junit4:junit4] 2> at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:764)
[junit4:junit4] 2> at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.java:123)
[junit4:junit4] 2> at com.sun.org.apache.xerces.internal.parsers.DOMParser.parse(DOMParser.java:237)
[junit4:junit4] 2> at com.sun.org.apache.xerces.internal.jaxp.DocumentBuilderImpl.parse(DocumentBuilderImpl.java:300)
[junit4:junit4] 2> at org.apache.solr.core.Config.<init>(Config.java:133)
[junit4:junit4] 2> at org.apache.solr.core.Config.<init>(Config.java:85)
[junit4:junit4] 2> at org.apache.solr.core.SolrConfig.<init>(SolrConfig.java:120)
[junit4:junit4] 2> at org.apache.solr.core.SolrCore.reload(SolrCore.java:404)
[junit4:junit4] 2> at org.apache.solr.core.CoreContainer.reload(CoreContainer.java:889)
[junit4:junit4] 2> at org.apache.solr.cloud.BasicZkTest.testBasic(BasicZkTest.java:160)
[junit4:junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4] 2> at java.lang.reflect.Method.invoke(Method.java:606)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] 2> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4] 2> at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] 2> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:724)
[junit4:junit4] 2>
[junit4:junit4] 2> 440147 T3572 oasc.CoreContainer.recordAndThrow ERROR Unable to reload core: collection1 org.xml.sax.SAXParseException; systemId: solrres:/solrconfig.xml; lineNumber: 1; columnNumber: 1; Premature end of file.
[junit4:junit4] 2> at com.sun.org.apache.xerces.internal.util.ErrorHandlerWrapper.createSAXParseException(ErrorHandlerWrapper.java:198)
[junit4:junit4] 2> at com.sun.org.apache.xerces.internal.util.ErrorHandlerWrapper.fatalError(ErrorHandlerWrapper.java:177)
[junit4:junit4] 2> at com.sun.org.apache.xerces.internal.impl.XMLErrorReporter.reportError(XMLErrorReporter.java:441)
[junit4:junit4] 2> at com.sun.org.apache.xerces.internal.impl.XMLErrorReporter.reportError(XMLErrorReporter.java:368)
[junit4:junit4] 2> at com.sun.org.apache.xerces.internal.impl.XMLScanner.reportFatalError(XMLScanner.java:1388)
[junit4:junit4] 2> at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl$PrologDriver.next(XMLDocumentScannerImpl.java:1018)
[junit4:junit4] 2> at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.next(XMLDocumentScannerImpl.java:607)
[junit4:junit4] 2> at com.sun.org.apache.xerces.internal.impl.XMLNSDocumentScannerImpl.next(XMLNSDocumentScannerImpl.java:116)
[junit4:junit4] 2> at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(XMLDocumentFragmentScannerImpl.java:489)
[junit4:junit4] 2> at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:835)
[junit4:junit4] 2> at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:764)
[junit4:junit4] 2> at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.java:123)
[junit4:junit4] 2> at com.sun.org.apache.xerces.internal.parsers.DOMParser.parse(DOMParser.java:237)
[junit4:junit4] 2> at com.sun.org.apache.xerces.internal.jaxp.DocumentBuilderImpl.parse(DocumentBuilderImpl.java:300)
[junit4:junit4] 2> at org.apache.solr.core.Config.<init>(Config.java:133)
[junit4:junit4] 2> at org.apache.solr.core.Config.<init>(Config.java:85)
[junit4:junit4] 2> at org.apache.solr.core.SolrConfig.<init>(SolrConfig.java:120)
[junit4:junit4] 2> at org.apache.solr.core.SolrCore.reload(SolrCore.java:404)
[junit4:junit4] 2> at org.apache.solr.core.CoreContainer.reload(CoreContainer.java:889)
[junit4:junit4] 2> at org.apache.solr.cloud.BasicZkTest.testBasic(BasicZkTest.java:160)
[junit4:junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4] 2> at java.lang.reflect.Method.invoke(Method.java:606)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] 2> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4] 2> at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] 2> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:724)
[junit4:junit4] 2>
[junit4:junit4] 2> 440148 T3572 oas.SolrTestCaseJ4.tearDown ###Ending testBasic
[junit4:junit4] 1> client port:0.0.0.0/0.0.0.0:33134
[junit4:junit4] 2> 440150 T3572 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:33134 33134
[junit4:junit4] 2> 440252 T3585 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: null state: Disconnected type None
[junit4:junit4] 2> 440252 T3585 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: null state: Disconnected type None
[junit4:junit4] 2> 440252 T3585 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7aaafa04 name:ZooKeeperConnection Watcher:127.0.0.1:33134/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4:junit4] 2> 440252 T3585 oascc.ConnectionManager.process zkClient has disconnected
[junit4:junit4] 2> 441398 T3584 oaz.ClientCnxn$SendThread.run WARN Session 0x13f860d8cd30003 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4:junit4] 2>
[junit4:junit4] 2> 442152 T3572 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 442152 T3572 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=2083202670
[junit4:junit4] 2> 442670 T3584 oaz.ClientCnxn$SendThread.run WARN Session 0x13f860d8cd30003 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4:junit4] 2>
[junit4:junit4] 2> 444281 T3584 oaz.ClientCnxn$SendThread.run WARN Session 0x13f860d8cd30003 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4:junit4] 2>
[junit4:junit4] 2> 445947 T3584 oaz.ClientCnxn$SendThread.run WARN Session 0x13f860d8cd30003 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4:junit4] 2>
[junit4:junit4] 2> 447171 T3584 oaz.ClientCnxn$SendThread.run WARN Session 0x13f860d8cd30003 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4:junit4] 2>
[junit4:junit4] 2> 448934 T3584 oaz.ClientCnxn$SendThread.run WARN Session 0x13f860d8cd30003 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4:junit4] 2>
[junit4:junit4] 2> 450818 T3584 oaz.ClientCnxn$SendThread.run WARN Session 0x13f860d8cd30003 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4:junit4] 2>
[junit4:junit4] 2> 452235 T3584 oaz.ClientCnxn$SendThread.run WARN Session 0x13f860d8cd30003 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4:junit4] 2>
[junit4:junit4] 2> 454250 T3584 oaz.ClientCnxn$SendThread.run WARN Session 0x13f860d8cd30003 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4:junit4] 2>
[junit4:junit4] 2> 455396 T3584 oaz.ClientCnxn$SendThread.run WARN Session 0x13f860d8cd30003 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4:junit4] 2>
[junit4:junit4] 2> 456889 T3584 oaz.ClientCnxn$SendThread.run WARN Session 0x13f860d8cd30003 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4:junit4] 2>
[junit4:junit4] 2> 458919 T3584 oaz.ClientCnxn$SendThread.run WARN Session 0x13f860d8cd30003 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4:junit4] 2>
[junit4:junit4] 2> 460461 T3584 oaz.ClientCnxn$SendThread.run WARN Session 0x13f860d8cd30003 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4:junit4] 2>
[junit4:junit4] 2> 461931 T3584 oaz.ClientCnxn$SendThread.run WARN Session 0x13f860d8cd30003 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4:junit4] 2>
[junit4:junit4] 2> 463409 T3584 oaz.ClientCnxn$SendThread.run WARN Session 0x13f860d8cd30003 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4:junit4] 2>
[junit4:junit4] 2> 465271 T3584 oaz.ClientCnxn$SendThread.run WARN Session 0x13f860d8cd30003 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4:junit4] 2>
[junit4:junit4] 2> 466444 T3584 oaz.ClientCnxn$SendThread.run WARN Session 0x13f860d8cd30003 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4:junit4] 2>
[junit4:junit4] 2> 467795 T3584 oaz.ClientCnxn$SendThread.run WARN Session 0x13f860d8cd30003 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4:junit4] 2>
[junit4:junit4] 2> 469058 T3584 oaz.ClientCnxn$SendThread.run WARN Session 0x13f860d8cd30003 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4:junit4] 2>
[junit4:junit4] 2> 470832 T3584 oaz.ClientCnxn$SendThread.run WARN Session 0x13f860d8cd30003 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4:junit4] 2>
[junit4:junit4] 2> 472183 T3584 oaz.ClientCnxn$SendThread.run WARN Session 0x13f860d8cd30003 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4:junit4] 2>
[junit4:junit4] 2> 473566 T3584 oaz.ClientCnxn$SendThread.run WARN Session 0x13f860d8cd30003 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4:junit4] 2>
[junit4:junit4] 2> 474345 T3587 oasc.OverseerCollectionProcessor.run WARN Overseer cannot talk to ZK
[junit4:junit4] 2> 474794 T3584 oaz.ClientCnxn$SendThread.run WARN Session 0x13f860d8cd30003 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4:junit4] 2>
[junit4:junit4] 2> 475696 T3586 oasc.Overseer$ClusterStateUpdater.amILeader WARN org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /overseer_elect/leader
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1151)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:252)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:249)
[junit4:junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:249)
[junit4:junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.amILeader(Overseer.java:251)
[junit4:junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:128)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:724)
[junit4:junit4] 2>
[junit4:junit4] 2> 475697 T3586 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89937910326034435-188.138.97.18:8983_solr-n_0000000000) am no longer a leader.
[junit4:junit4] 2> 475696 T3572 oasc.CoreContainer.shutdown ERROR org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /overseer/queue/qn-
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4] 2> at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:218)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:215)
[junit4:junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:215)
[junit4:junit4] 2> at org.apache.solr.cloud.DistributedQueue.createData(DistributedQueue.java:284)
[junit4:junit4] 2> at org.apache.solr.cloud.DistributedQueue.offer(DistributedQueue.java:271)
[junit4:junit4] 2> at org.apache.solr.cloud.ZkController.publishAndWaitForDownStates(ZkController.java:562)
[junit4:junit4] 2> at org.apache.solr.core.CoreContainer.shutdown(CoreContainer.java:553)
[junit4:junit4] 2> at org.apache.solr.util.TestHarness.close(TestHarness.java:383)
[junit4:junit4] 2> at org.apache.solr.SolrTestCaseJ4.deleteCore(SolrTestCaseJ4.java:432)
[junit4:junit4] 2> at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:102)
[junit4:junit4] 2> at sun.reflect.GeneratedMethodAccessor24.invoke(Unknown Source)
[junit4:junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4] 2> at java.lang.reflect.Method.invoke(Method.java:606)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:700)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:724)
[junit4:junit4] 2>
[junit4:junit4] 2> 475698 T3572 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 475699 T3572 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 476329 T3584 oaz.ClientCnxn$SendThread.run WARN Session 0x13f860d8cd30003 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4:junit4] 2>
[junit4:junit4] 2> 477581 T3584 oaz.ClientCnxn$SendThread.run WARN Session 0x13f860d8cd30003 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4:junit4] 2>
[junit4:junit4] 2> 479608 T3584 oaz.ClientCnxn$SendThread.run WARN Session 0x13f860d8cd30003 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4:junit4] 2>
[junit4:junit4] 2> 481133 T3584 oaz.ClientCnxn$SendThread.run WARN Session 0x13f860d8cd30003 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4:junit4] 2>
[junit4:junit4] 2> 482287 T3584 oaz.ClientCnxn$SendThread.run WARN Session 0x13f860d8cd30003 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4:junit4] 2>
[junit4:junit4] 2> 484081 T3584 oaz.ClientCnxn$SendThread.run WARN Session 0x13f860d8cd30003 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4:junit4] 2>
[junit4:junit4] 2> 485508 T3584 oaz.ClientCnxn$SendThread.run WARN Session 0x13f860d8cd30003 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4:junit4] 2>
[junit4:junit4] 2> 487158 T3584 oaz.ClientCnxn$SendThread.run WARN Session 0x13f860d8cd30003 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4:junit4] 2>
[junit4:junit4] 2> 488613 T3584 oaz.ClientCnxn$SendThread.run WARN Session 0x13f860d8cd30003 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4:junit4] 2>
[junit4:junit4] 2> 489787 T3584 oaz.ClientCnxn$SendThread.run WARN Session 0x13f860d8cd30003 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4:junit4] 2>
[junit4:junit4] 2> 491632 T3584 oaz.ClientCnxn$SendThread.run WARN Session 0x13f860d8cd30003 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4:junit4] 2>
[junit4:junit4] 2> 493614 T3584 oaz.ClientCnxn$SendThread.run WARN Session 0x13f860d8cd30003 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4:junit4] 2>
[junit4:junit4] 2> 495316 T3584 oaz.ClientCnxn$SendThread.run WARN Session 0x13f860d8cd30003 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4:junit4] 2>
[junit4:junit4] 2> 497281 T3584 oaz.ClientCnxn$SendThread.run WARN Session 0x13f860d8cd30003 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4:junit4] 2>
[junit4:junit4] 2> 499105 T3584 oaz.ClientCnxn$SendThread.run WARN Session 0x13f860d8cd30003 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4:junit4] 2>
[junit4:junit4] 2> 500412 T3584 oaz.ClientCnxn$SendThread.run WARN Session 0x13f860d8cd30003 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4:junit4] 2>
[junit4:junit4] 2> 502214 T3584 oaz.ClientCnxn$SendThread.run WARN Session 0x13f860d8cd30003 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4:junit4] 2>
[junit4:junit4] 2> 503361 T3584 oaz.ClientCnxn$SendThread.run WARN Session 0x13f860d8cd30003 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4:junit4] 2>
[junit4:junit4] 2> 505183 T3584 oaz.ClientCnxn$SendThread.run WARN Session 0x13f860d8cd30003 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4:junit4] 2>
[junit4:junit4] 2> 506470 T3584 oaz.ClientCnxn$SendThread.run WARN Session 0x13f860d8cd30003 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4:junit4] 2>
[junit4:junit4] 2> 507976 T3584 oaz.ClientCnxn$SendThread.run WARN Session 0x13f860d8cd30003 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4:junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4:junit4] 2>
[junit4:junit4] 2> 508313 T3572 oasc.ZkContainer.publishCoresAsDown ERROR org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /overseer/queue/qn-
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4] 2> at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:218)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:215)
[junit4:junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:215)
[junit4:junit4] 2> at org.apache.solr.cloud.DistributedQueue.createData(DistributedQueue.java:284)
[junit4:junit4] 2> at org.apache.solr.cloud.DistributedQueue.offer(DistributedQueue.java:271)
[junit4:junit4] 2> at org.apache.solr.cloud.ZkController.publish(ZkController.java:1013)
[junit4:junit4] 2> at org.apache.solr.cloud.ZkController.publish(ZkController.java:978)
[junit4:junit4] 2> at org.apache.solr.core.ZkContainer.publishCoresAsDown(ZkContainer.java:331)
[junit4:junit4] 2> at org.apache.solr.core.CoreContainer.shutdown(CoreContainer.java:564)
[junit4:junit4] 2> at org.apache.solr.util.TestHarness.close(TestHarness.java:383)
[junit4:junit4] 2> at org.apache.solr.SolrTestCaseJ4.deleteCore(SolrTestCaseJ4.java:432)
[junit4:junit4] 2> at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:102)
[junit4:junit4] 2> at sun.reflect.GeneratedMethodAccessor24.invoke(Unknown Source)
[junit4:junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4] 2> at java.lang.reflect.Method.invoke(Method.java:606)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:700)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:724)
[junit4:junit4] 2>
[junit4:junit4] 2> 508314 T3572 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@2746ec1f
[junit4:junit4] 2> 508324 T3572 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=8,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=11,cumulative_deletesById=4,cumulative_deletesByQuery=1,cumulative_errors=0}
[junit4:junit4] 2> 508324 T3572 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 508325 T3572 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 508325 T3572 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 508326 T3572 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 508326 T3572 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 508326 T3572 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicZkTest-1372343602384 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicZkTest-1372343602384;done=false>>]
[junit4:junit4] 2> 508326 T3572 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicZkTest-1372343602384
[junit4:junit4] 2> 508326 T3572 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicZkTest-1372343602384/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicZkTest-1372343602384/index;done=false>>]
[junit4:junit4] 2> 508327 T3572 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicZkTest-1372343602384/index
[junit4:junit4] 2> 74562 T3571 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 1 leaked thread(s).
[junit4:junit4] 2> 94769 T3571 ccr.ThreadLeakControl.checkThreadLeaks SEVERE 1 thread leaked from SUITE scope at org.apache.solr.cloud.BasicZkTest:
[junit4:junit4] 2> 1) Thread[id=3594, name=IPC Parameter Sending Thread #2, state=TIMED_WAITING, group=TGRP-TestRecoveryHdfs]
[junit4:junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4:junit4] 2> at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
[junit4:junit4] 2> at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4:junit4] 2> at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)
[junit4:junit4] 2> at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:724)
[junit4:junit4] 2> 94769 T3571 ccr.ThreadLeakControl.tryToInterruptAll Starting to interrupt leaked threads:
[junit4:junit4] 2> 1) Thread[id=3594, name=IPC Parameter Sending Thread #2, state=TIMED_WAITING, group=TGRP-TestRecoveryHdfs]
[junit4:junit4] 2> 97772 T3571 ccr.ThreadLeakControl.tryToInterruptAll SEVERE There are still zombie threads that couldn't be terminated:
[junit4:junit4] 2> 1) Thread[id=3594, name=IPC Parameter Sending Thread #2, state=TIMED_WAITING, group=TGRP-TestRecoveryHdfs]
[junit4:junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4:junit4] 2> at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
[junit4:junit4] 2> at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4:junit4] 2> at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)
[junit4:junit4] 2> at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:724)
[junit4:junit4] 2> NOTE: test params are: codec=Lucene42: {timestamp=PostingsFormat(name=Memory doPackFST= true), range_facet_l=PostingsFormat(name=Memory doPackFST= true), id=PostingsFormat(name=TestBloomFilteredLucene41Postings), range_facet_sl=PostingsFormat(name=MockSep), range_facet_si=PostingsFormat(name=Direct), _version_=PostingsFormat(name=Memory doPackFST= true), val_s=PostingsFormat(name=MockSep), multiDefault=PostingsFormat(name=Direct), intDefault=PostingsFormat(name=Memory doPackFST= true)}, docValues:{timestamp=DocValuesFormat(name=Asserting)}, sim=RandomSimilarityProvider(queryNorm=false,coord=no): {}, locale=lv, timezone=SystemV/PST8
[junit4:junit4] 2> NOTE: Linux 3.2.0-48-generic amd64/Oracle Corporation 1.7.0_25 (64-bit)/cpus=8,threads=1,free=197531432,total=477126656
[junit4:junit4] 2> NOTE: All tests run in this JVM: [FieldAnalysisRequestHandlerTest, SpellPossibilityIteratorTest, CachingDirectoryFactoryTest, TestCloudManagedSchema, TestLazyCores, FileUtilsTest, ConvertedLegacyTest, SolrCmdDistributorTest, TestBM25SimilarityFactory, TestRTGBase, TestStressReorder, DisMaxRequestHandlerTest, HighlighterConfigTest, TestQuerySenderNoQuery, CoreContainerCoreInitFailuresTest, TestLuceneMatchVersion, TestSolrJ, DocumentAnalysisRequestHandlerTest, TestRecoveryHdfs, TimeZoneUtilsTest, TestIndexingPerformance, TestSolrQueryParserResource, TestAtomicUpdateErrorCases, IndexReaderFactoryTest, TestCodecSupport, OpenExchangeRatesOrgProviderTest, TestRandomFaceting, TestManagedSchema, TestFoldingMultitermQuery, TestFiltering, DirectUpdateHandlerTest, TestCloudManagedSchemaAddField, TestDefaultSimilarityFactory, BasicDistributedZk2Test, SolrPluginUtilsTest, TestJmxIntegration, ZkSolrClientTest, TestRangeQuery, JSONWriterTest, CopyFieldTest, DOMUtilTest, PathHierarchyTokenizerFactoryTest, TestHashPartitioner, TestRecovery, SortByFunctionTest, BasicZkTest]
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=BasicZkTest -Dtests.seed=E9F9C2C20847E8C4 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=lv -Dtests.timezone=SystemV/PST8 -Dtests.file.encoding=ISO-8859-1
[junit4:junit4] ERROR 0.00s J1 | BasicZkTest (suite) <<<
[junit4:junit4] > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.BasicZkTest:
[junit4:junit4] > 1) Thread[id=3594, name=IPC Parameter Sending Thread #2, state=TIMED_WAITING, group=TGRP-TestRecoveryHdfs]
[junit4:junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4:junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
[junit4:junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4:junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)
[junit4:junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)
[junit4:junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
[junit4:junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
[junit4:junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:724)
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([E9F9C2C20847E8C4]:0)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
[junit4:junit4] > 1) Thread[id=3594, name=IPC Parameter Sending Thread #2, state=TIMED_WAITING, group=TGRP-TestRecoveryHdfs]
[junit4:junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4:junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
[junit4:junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4:junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)
[junit4:junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)
[junit4:junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
[junit4:junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
[junit4:junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:724)
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([E9F9C2C20847E8C4]:0)
[junit4:junit4] Completed on J1 in 97.83s, 1 test, 2 errors <<< FAILURES!
[...truncated 563 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:386: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:366: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:190: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:443: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1243: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:887: There were test failures: 312 suites, 1315 tests, 2 suite-level errors, 659 ignored (1 assumption)
Total time: 26 minutes 43 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0_25 -XX:-UseCompressedOops -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.7.0_25) - Build #
6333 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/6333/
Java: 64bit/jdk1.7.0_25 -XX:+UseCompressedOops -XX:+UseSerialGC
All tests passed
Build Log:
[...truncated 34410 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:386: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:325: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:122: Source checkout is dirty after running tests!!! Offending files:
* solr/licenses/log4j-1.2.17.jar.sha1
Total time: 52 minutes 59 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0_25 -XX:+UseCompressedOops -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.7.0_25) - Build #
6332 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/6332/
Java: 64bit/jdk1.7.0_25 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC
All tests passed
Build Log:
[...truncated 34349 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:386: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:325: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:122: Source checkout is dirty after running tests!!! Offending files:
* solr/licenses/log4j-1.2.17.jar.sha1
Total time: 50 minutes 21 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0_25 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.7.0_25) - Build #
6331 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/6331/
Java: 32bit/jdk1.7.0_25 -server -XX:+UseSerialGC
1 tests failed.
REGRESSION: org.apache.solr.handler.TestReplicationHandler.doTestStressReplication
Error Message:
timed out waiting for collection1 startAt time to exceed: Thu Jun 27 08:02:42 GMT 2013
Stack Trace:
java.lang.AssertionError: timed out waiting for collection1 startAt time to exceed: Thu Jun 27 08:02:42 GMT 2013
at __randomizedtesting.SeedInfo.seed([D2048A2808D6B4EB:9AF8AEE0DFEDD58]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.handler.TestReplicationHandler.watchCoreStartAt(TestReplicationHandler.java:1473)
at org.apache.solr.handler.TestReplicationHandler.doTestStressReplication(TestReplicationHandler.java:777)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:724)
Build Log:
[...truncated 9684 lines...]
[junit4:junit4] Suite: org.apache.solr.handler.TestReplicationHandler
[junit4:junit4] 2> 703382 T2326 oas.SolrTestCaseJ4.setUp ###Starting doTestReplicateAfterStartupWithNoActivity
[junit4:junit4] 2> 703386 T2326 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 703389 T2326 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:45864
[junit4:junit4] 2> 703390 T2326 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 703390 T2326 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 703390 T2326 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141704/master
[junit4:junit4] 2> 703391 T2326 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141704/master/solr.xml
[junit4:junit4] 2> 703391 T2326 oasc.CoreContainer.<init> New CoreContainer 8055244
[junit4:junit4] 2> 703391 T2326 oasc.CoreContainer$Initializer.initialize no solr.xml found. using default old-style solr.xml
[junit4:junit4] 2> 703391 T2326 oasc.CoreContainer.load Loading CoreContainer using Solr Home: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141704/master/'
[junit4:junit4] 2> 703392 T2326 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141704/master/'
[junit4:junit4] 2> 703447 T2326 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4] 2> 703447 T2326 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 703447 T2326 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4] 2> 703448 T2326 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 703448 T2326 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 703448 T2326 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 703448 T2326 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 703449 T2326 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 703449 T2326 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 703449 T2326 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4] 2> 703452 T2326 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 703455 T2336 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141704/master/collection1
[junit4:junit4] 2> 703455 T2336 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141704/master/collection1/'
[junit4:junit4] 2> 703484 T2336 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 703511 T2336 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 703511 T2336 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 703513 T2336 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 703523 T2336 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 703524 T2336 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 703524 T2336 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141704/master/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141704/master/collection1/data/
[junit4:junit4] 2> 703524 T2336 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4:junit4] 2> 703525 T2336 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141704/master/collection1/data
[junit4:junit4] 2> 703525 T2336 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141704/master/collection1/data/index/
[junit4:junit4] 2> 703525 T2336 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141704/master/collection1/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 703525 T2336 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141704/master/collection1/data/index
[junit4:junit4] 2> 703526 T2336 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@10f75df lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1c1ff62),segFN=segments_1,generation=1}
[junit4:junit4] 2> 703526 T2336 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 703528 T2336 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 703529 T2336 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 703529 T2336 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 703529 T2336 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 703529 T2336 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 703529 T2336 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 703532 T2336 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 703533 T2336 oass.SolrIndexSearcher.<init> Opening Searcher@645281 main
[junit4:junit4] 2> 703534 T2336 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 703534 T2336 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 703534 T2336 oash.ReplicationHandler.inform Replication enabled for following config files: schema.xml,xslt/dummy.xsl
[junit4:junit4] 2> 703534 T2336 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 703535 T2336 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 703535 T2337 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@645281 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 703535 T2326 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 703536 T2326 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 703536 T2326 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 703583 T2326 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 703585 T2326 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:40054
[junit4:junit4] 2> 703586 T2326 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 703586 T2326 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 703586 T2326 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141902/slave
[junit4:junit4] 2> 703587 T2326 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141902/slave/solr.xml
[junit4:junit4] 2> 703587 T2326 oasc.CoreContainer.<init> New CoreContainer 18436342
[junit4:junit4] 2> 703587 T2326 oasc.CoreContainer$Initializer.initialize no solr.xml found. using default old-style solr.xml
[junit4:junit4] 2> 703587 T2326 oasc.CoreContainer.load Loading CoreContainer using Solr Home: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141902/slave/'
[junit4:junit4] 2> 703588 T2326 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141902/slave/'
[junit4:junit4] 2> 703635 T2326 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4] 2> 703636 T2326 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 703636 T2326 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4] 2> 703636 T2326 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 703636 T2326 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 703637 T2326 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 703637 T2326 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 703637 T2326 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 703637 T2326 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 703638 T2326 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4] 2> 703640 T2326 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 703642 T2348 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141902/slave/collection1
[junit4:junit4] 2> 703643 T2348 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141902/slave/collection1/'
[junit4:junit4] 2> 703673 T2348 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 703699 T2348 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 703700 T2348 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 703701 T2348 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 703711 T2348 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 703712 T2348 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 703712 T2348 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141902/slave/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141902/slave/collection1/data/
[junit4:junit4] 2> 703712 T2348 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4:junit4] 2> 703713 T2348 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141902/slave/collection1/data
[junit4:junit4] 2> 703713 T2348 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141902/slave/collection1/data/index/
[junit4:junit4] 2> 703713 T2348 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141902/slave/collection1/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 703714 T2348 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141902/slave/collection1/data/index
[junit4:junit4] 2> 703715 T2348 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@166444f lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@226db2),segFN=segments_1,generation=1}
[junit4:junit4] 2> 703715 T2348 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 703717 T2348 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 703717 T2348 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 703717 T2348 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 703717 T2348 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 703718 T2348 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 703718 T2348 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 703719 T2348 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 703721 T2348 oass.SolrIndexSearcher.<init> Opening Searcher@13755bc main
[junit4:junit4] 2> 703721 T2348 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 703721 T2348 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 703723 T2348 oash.SnapPuller.startExecutorService Poll Scheduled at an interval of 1000ms
[junit4:junit4] 2> 703723 T2348 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 703723 T2349 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@13755bc main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 703724 T2326 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 703724 T2326 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 703725 T2326 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 703749 T2326 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=18436342
[junit4:junit4] 2> 703749 T2326 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@169eea
[junit4:junit4] 2> 703750 T2326 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 703750 T2326 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 703751 T2326 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 703751 T2326 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 703751 T2326 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 703752 T2326 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 703752 T2326 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141902/slave/collection1/data [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141902/slave/collection1/data;done=false>>]
[junit4:junit4] 2> 703752 T2326 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141902/slave/collection1/data
[junit4:junit4] 2> 703753 T2326 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141902/slave/collection1/data/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141902/slave/collection1/data/index;done=false>>]
[junit4:junit4] 2> 703753 T2326 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141902/slave/collection1/data/index
[junit4:junit4] 2> 703753 T2326 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4:junit4] 2> ASYNC NEW_CORE C2275 name=collection1 org.apache.solr.core.SolrCore@19b7eb0
[junit4:junit4] 2> 703810 T2333 C2275 oasu.DirectUpdateHandler2.deleteAll [collection1] REMOVING ALL DOCUMENTS FROM INDEX
[junit4:junit4] 2> 703811 T2333 C2275 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@10f75df lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1c1ff62),segFN=segments_1,generation=1}
[junit4:junit4] 2> 703812 T2333 C2275 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 703813 T2333 C2275 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {deleteByQuery=*:*} 0 3
[junit4:junit4] 2> 703815 T2334 C2275 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 703816 T2334 C2275 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@10f75df lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1c1ff62),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@10f75df lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1c1ff62),segFN=segments_2,generation=2}
[junit4:junit4] 2> 703816 T2334 C2275 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 703817 T2334 C2275 oass.SolrIndexSearcher.<init> Opening Searcher@14abb59 main
[junit4:junit4] 2> 703817 T2334 C2275 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 703817 T2337 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@14abb59 main{StandardDirectoryReader(segments_2:2:nrt)}
[junit4:junit4] 2> 703818 T2334 C2275 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 3
[junit4:junit4] 2> 703841 T2326 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=8055244
[junit4:junit4] 2> 703842 T2326 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@19b7eb0
[junit4:junit4] 2> 703842 T2326 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0}
[junit4:junit4] 2> 703843 T2326 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 703843 T2326 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 703843 T2326 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 703844 T2326 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 703844 T2326 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 703844 T2326 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141704/master/collection1/data/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141704/master/collection1/data/index;done=false>>]
[junit4:junit4] 2> 703844 T2326 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141704/master/collection1/data/index
[junit4:junit4] 2> 703845 T2326 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141704/master/collection1/data [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141704/master/collection1/data;done=false>>]
[junit4:junit4] 2> 703845 T2326 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141704/master/collection1/data
[junit4:junit4] 2> 703845 T2326 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4:junit4] 2> 703897 T2326 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 703899 T2326 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:59340
[junit4:junit4] 2> 703899 T2326 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 703900 T2326 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 703900 T2326 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141704/master
[junit4:junit4] 2> 703900 T2326 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141704/master/solr.xml
[junit4:junit4] 2> 703901 T2326 oasc.CoreContainer.<init> New CoreContainer 12632450
[junit4:junit4] 2> 703901 T2326 oasc.CoreContainer$Initializer.initialize no solr.xml found. using default old-style solr.xml
[junit4:junit4] 2> 703901 T2326 oasc.CoreContainer.load Loading CoreContainer using Solr Home: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141704/master/'
[junit4:junit4] 2> 703901 T2326 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141704/master/'
[junit4:junit4] 2> 703948 T2326 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4] 2> 703948 T2326 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 703948 T2326 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4] 2> 703949 T2326 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 703949 T2326 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 703949 T2326 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 703949 T2326 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 703949 T2326 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 703950 T2326 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 703950 T2326 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4] 2> 703952 T2326 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 703955 T2361 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141704/master/collection1
[junit4:junit4] 2> 703955 T2361 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141704/master/collection1/'
[junit4:junit4] 2> 704021 T2361 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 704048 T2361 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 704048 T2361 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 704050 T2361 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 704059 T2361 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 704060 T2361 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 704067 T2361 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141704/master/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141704/master/collection1/data/
[junit4:junit4] 2> 704067 T2361 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4:junit4] 2> 704067 T2361 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141704/master/collection1/data
[junit4:junit4] 2> 704068 T2361 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141704/master/collection1/data/index/
[junit4:junit4] 2> 704068 T2361 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141704/master/collection1/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 704068 T2361 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141704/master/collection1/data/index
[junit4:junit4] 2> 704248 T2361 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141704/master/collection1/data/index,segFN=segments_1,generation=1}
[junit4:junit4] 2> 704248 T2361 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 704250 T2361 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 704251 T2361 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 704251 T2361 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 704251 T2361 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 704251 T2361 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 704251 T2361 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 704253 T2361 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 704254 T2361 oass.SolrIndexSearcher.<init> Opening Searcher@2b5f29 main
[junit4:junit4] 2> 704255 T2361 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 704255 T2361 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 704255 T2361 oash.ReplicationHandler.inform Replication enabled for following config files: schema.xml
[junit4:junit4] 2> 704256 T2361 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141704/master/collection1/data/index,segFN=segments_1,generation=1}
[junit4:junit4] 2> 704256 T2361 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 704257 T2361 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 704257 T2361 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 704257 T2362 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2b5f29 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 704257 T2326 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 704258 T2326 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 704258 T2326 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C2276 name=collection1 org.apache.solr.core.SolrCore@129e5ce
[junit4:junit4] 2> 704265 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[0]} 0 1
[junit4:junit4] 2> 704267 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[1]} 0 0
[junit4:junit4] 2> 704269 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[2]} 0 0
[junit4:junit4] 2> 704271 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[3]} 0 0
[junit4:junit4] 2> 704273 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[4]} 0 0
[junit4:junit4] 2> 704275 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[5]} 0 0
[junit4:junit4] 2> 704277 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[6]} 0 0
[junit4:junit4] 2> 704279 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[7]} 0 0
[junit4:junit4] 2> 704281 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[8]} 0 0
[junit4:junit4] 2> 704283 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[9]} 0 0
[junit4:junit4] 2> 704285 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[10]} 0 0
[junit4:junit4] 2> 704287 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[11]} 0 0
[junit4:junit4] 2> 704289 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[12]} 0 0
[junit4:junit4] 2> 704291 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[13]} 0 0
[junit4:junit4] 2> 704293 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[14]} 0 0
[junit4:junit4] 2> 704295 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[15]} 0 0
[junit4:junit4] 2> 704297 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[16]} 0 0
[junit4:junit4] 2> 704299 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[17]} 0 0
[junit4:junit4] 2> 704301 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[18]} 0 0
[junit4:junit4] 2> 704303 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[19]} 0 0
[junit4:junit4] 2> 704305 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[20]} 0 0
[junit4:junit4] 2> 704307 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[21]} 0 0
[junit4:junit4] 2> 704309 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[22]} 0 0
[junit4:junit4] 2> 704311 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[23]} 0 0
[junit4:junit4] 2> 704313 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[24]} 0 0
[junit4:junit4] 2> 704315 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[25]} 0 0
[junit4:junit4] 2> 704317 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[26]} 0 0
[junit4:junit4] 2> 704319 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[27]} 0 0
[junit4:junit4] 2> 704321 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[28]} 0 0
[junit4:junit4] 2> 704324 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[29]} 0 1
[junit4:junit4] 2> 704326 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[30]} 0 0
[junit4:junit4] 2> 704328 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[31]} 0 0
[junit4:junit4] 2> 704331 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[32]} 0 0
[junit4:junit4] 2> 704333 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[33]} 0 0
[junit4:junit4] 2> 704336 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[34]} 0 0
[junit4:junit4] 2> 704339 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[35]} 0 0
[junit4:junit4] 2> 704341 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[36]} 0 0
[junit4:junit4] 2> 704343 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[37]} 0 0
[junit4:junit4] 2> 704345 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[38]} 0 0
[junit4:junit4] 2> 704347 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[39]} 0 0
[junit4:junit4] 2> 704349 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[40]} 0 0
[junit4:junit4] 2> 704351 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[41]} 0 0
[junit4:junit4] 2> 704353 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[42]} 0 0
[junit4:junit4] 2> 704355 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[43]} 0 0
[junit4:junit4] 2> 704357 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[44]} 0 0
[junit4:junit4] 2> 704359 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[45]} 0 0
[junit4:junit4] 2> 704361 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[46]} 0 0
[junit4:junit4] 2> 704363 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[47]} 0 0
[junit4:junit4] 2> 704365 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[48]} 0 0
[junit4:junit4] 2> 704367 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[49]} 0 0
[junit4:junit4] 2> 704369 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[50]} 0 0
[junit4:junit4] 2> 704371 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[51]} 0 0
[junit4:junit4] 2> 704373 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[52]} 0 0
[junit4:junit4] 2> 704375 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[53]} 0 0
[junit4:junit4] 2> 704377 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[54]} 0 0
[junit4:junit4] 2> 704379 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[55]} 0 0
[junit4:junit4] 2> 704381 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[56]} 0 0
[junit4:junit4] 2> 704383 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[57]} 0 0
[junit4:junit4] 2> 704385 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[58]} 0 0
[junit4:junit4] 2> 704388 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[59]} 0 1
[junit4:junit4] 2> 704390 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[60]} 0 1
[junit4:junit4] 2> 704392 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[61]} 0 1
[junit4:junit4] 2> 704394 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[62]} 0 1
[junit4:junit4] 2> 704396 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[63]} 0 1
[junit4:junit4] 2> 704398 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[64]} 0 0
[junit4:junit4] 2> 704400 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[65]} 0 0
[junit4:junit4] 2> 704402 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[66]} 0 0
[junit4:junit4] 2> 704404 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[67]} 0 0
[junit4:junit4] 2> 704406 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[68]} 0 0
[junit4:junit4] 2> 704408 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[69]} 0 0
[junit4:junit4] 2> 704410 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[70]} 0 0
[junit4:junit4] 2> 704412 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[71]} 0 0
[junit4:junit4] 2> 704414 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[72]} 0 0
[junit4:junit4] 2> 704416 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[73]} 0 0
[junit4:junit4] 2> 704419 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[74]} 0 1
[junit4:junit4] 2> 704421 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[75]} 0 1
[junit4:junit4] 2> 704423 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[76]} 0 1
[junit4:junit4] 2> 704425 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[77]} 0 0
[junit4:junit4] 2> 704427 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[78]} 0 0
[junit4:junit4] 2> 704429 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[79]} 0 0
[junit4:junit4] 2> 704431 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[80]} 0 0
[junit4:junit4] 2> 704433 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[81]} 0 0
[junit4:junit4] 2> 704435 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[82]} 0 0
[junit4:junit4] 2> 704437 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[83]} 0 0
[junit4:junit4] 2> 704439 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[84]} 0 0
[junit4:junit4] 2> 704441 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[85]} 0 0
[junit4:junit4] 2> 704443 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[86]} 0 0
[junit4:junit4] 2> 704445 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[87]} 0 0
[junit4:junit4] 2> 704447 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[88]} 0 0
[junit4:junit4] 2> 704449 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[89]} 0 0
[junit4:junit4] 2> 704451 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[90]} 0 0
[junit4:junit4] 2> 704453 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[91]} 0 0
[junit4:junit4] 2> 704455 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[92]} 0 0
[junit4:junit4] 2> 704457 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[93]} 0 0
[junit4:junit4] 2> 704459 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[94]} 0 0
[junit4:junit4] 2> 704461 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[95]} 0 0
[junit4:junit4] 2> 704463 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[96]} 0 0
[junit4:junit4] 2> 704465 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[97]} 0 0
[junit4:junit4] 2> 704467 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[98]} 0 0
[junit4:junit4] 2> 704469 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[99]} 0 0
[junit4:junit4] 2> 704472 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[100]} 0 1
[junit4:junit4] 2> 704474 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[101]} 0 1
[junit4:junit4] 2> 704476 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[102]} 0 0
[junit4:junit4] 2> 704478 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[103]} 0 0
[junit4:junit4] 2> 704480 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[104]} 0 0
[junit4:junit4] 2> 704482 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[105]} 0 0
[junit4:junit4] 2> 704484 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[106]} 0 0
[junit4:junit4] 2> 704486 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[107]} 0 0
[junit4:junit4] 2> 704488 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[108]} 0 0
[junit4:junit4] 2> 704490 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[109]} 0 0
[junit4:junit4] 2> 704492 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[110]} 0 0
[junit4:junit4] 2> 704494 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[111]} 0 0
[junit4:junit4] 2> 704496 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[112]} 0 0
[junit4:junit4] 2> 704498 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[113]} 0 0
[junit4:junit4] 2> 704500 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[114]} 0 0
[junit4:junit4] 2> 704502 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[115]} 0 0
[junit4:junit4] 2> 704504 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[116]} 0 0
[junit4:junit4] 2> 704506 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[117]} 0 0
[junit4:junit4] 2> 704508 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[118]} 0 0
[junit4:junit4] 2> 704510 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[119]} 0 0
[junit4:junit4] 2> 704513 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[120]} 0 1
[junit4:junit4] 2> 704515 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[121]} 0 1
[junit4:junit4] 2> 704517 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[122]} 0 1
[junit4:junit4] 2> 704519 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[123]} 0 1
[junit4:junit4] 2> 704521 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[124]} 0 0
[junit4:junit4] 2> 704523 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[125]} 0 0
[junit4:junit4] 2> 704525 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[126]} 0 0
[junit4:junit4] 2> 704527 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[127]} 0 0
[junit4:junit4] 2> 704529 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[128]} 0 0
[junit4:junit4] 2> 704531 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[129]} 0 0
[junit4:junit4] 2> 704533 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[130]} 0 0
[junit4:junit4] 2> 704535 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[131]} 0 0
[junit4:junit4] 2> 704537 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[132]} 0 0
[junit4:junit4] 2> 704539 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[133]} 0 0
[junit4:junit4] 2> 704541 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[134]} 0 0
[junit4:junit4] 2> 704543 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[135]} 0 0
[junit4:junit4] 2> 704545 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[136]} 0 0
[junit4:junit4] 2> 704547 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[137]} 0 0
[junit4:junit4] 2> 704551 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[138]} 0 0
[junit4:junit4] 2> 704553 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[139]} 0 0
[junit4:junit4] 2> 704555 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[140]} 0 0
[junit4:junit4] 2> 704557 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[141]} 0 0
[junit4:junit4] 2> 704559 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[142]} 0 0
[junit4:junit4] 2> 704561 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[143]} 0 0
[junit4:junit4] 2> 704563 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[144]} 0 0
[junit4:junit4] 2> 704565 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[145]} 0 0
[junit4:junit4] 2> 704567 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[146]} 0 0
[junit4:junit4] 2> 704569 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[147]} 0 0
[junit4:junit4] 2> 704571 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[148]} 0 0
[junit4:junit4] 2> 704573 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[149]} 0 0
[junit4:junit4] 2> 704575 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[150]} 0 0
[junit4:junit4] 2> 704577 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[151]} 0 0
[junit4:junit4] 2> 704579 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[152]} 0 0
[junit4:junit4] 2> 704581 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[153]} 0 0
[junit4:junit4] 2> 704584 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[154]} 0 1
[junit4:junit4] 2> 704586 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[155]} 0 0
[junit4:junit4] 2> 704588 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[156]} 0 0
[junit4:junit4] 2> 704590 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[157]} 0 0
[junit4:junit4] 2> 704592 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[158]} 0 0
[junit4:junit4] 2> 704594 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[159]} 0 0
[junit4:junit4] 2> 704596 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[160]} 0 0
[junit4:junit4] 2> 704598 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[161]} 0 0
[junit4:junit4] 2> 704600 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[162]} 0 0
[junit4:junit4] 2> 704602 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[163]} 0 0
[junit4:junit4] 2> 704604 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[164]} 0 0
[junit4:junit4] 2> 704606 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[165]} 0 0
[junit4:junit4] 2> 704608 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[166]} 0 0
[junit4:junit4] 2> 704610 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[167]} 0 0
[junit4:junit4] 2> 704612 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[168]} 0 0
[junit4:junit4] 2> 704614 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[169]} 0 0
[junit4:junit4] 2> 704616 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[170]} 0 0
[junit4:junit4] 2> 704619 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[171]} 0 1
[junit4:junit4] 2> 704621 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[172]} 0 1
[junit4:junit4] 2> 704623 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[173]} 0 1
[junit4:junit4] 2> 704625 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[174]} 0 1
[junit4:junit4] 2> 704627 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[175]} 0 0
[junit4:junit4] 2> 704629 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[176]} 0 0
[junit4:junit4] 2> 704631 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[177]} 0 1
[junit4:junit4] 2> 704633 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[178]} 0 0
[junit4:junit4] 2> 704635 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[179]} 0 0
[junit4:junit4] 2> 704637 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[180]} 0 0
[junit4:junit4] 2> 704639 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[181]} 0 0
[junit4:junit4] 2> 704641 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[182]} 0 0
[junit4:junit4] 2> 704643 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[183]} 0 0
[junit4:junit4] 2> 704645 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[184]} 0 0
[junit4:junit4] 2> 704647 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[185]} 0 0
[junit4:junit4] 2> 704649 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[186]} 0 0
[junit4:junit4] 2> 704651 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[187]} 0 0
[junit4:junit4] 2> 704653 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[188]} 0 0
[junit4:junit4] 2> 704655 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[189]} 0 0
[junit4:junit4] 2> 704657 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[190]} 0 0
[junit4:junit4] 2> 704659 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[191]} 0 0
[junit4:junit4] 2> 704661 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[192]} 0 0
[junit4:junit4] 2> 704663 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[193]} 0 0
[junit4:junit4] 2> 704665 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[194]} 0 0
[junit4:junit4] 2> 704667 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[195]} 0 0
[junit4:junit4] 2> 704669 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[196]} 0 0
[junit4:junit4] 2> 704671 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[197]} 0 0
[junit4:junit4] 2> 704673 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[198]} 0 0
[junit4:junit4] 2> 704675 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[199]} 0 0
[junit4:junit4] 2> 704677 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[200]} 0 0
[junit4:junit4] 2> 704679 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[201]} 0 0
[junit4:junit4] 2> 704681 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[202]} 0 0
[junit4:junit4] 2> 704683 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[203]} 0 0
[junit4:junit4] 2> 704685 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[204]} 0 0
[junit4:junit4] 2> 704687 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[205]} 0 0
[junit4:junit4] 2> 704689 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[206]} 0 0
[junit4:junit4] 2> 704691 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[207]} 0 0
[junit4:junit4] 2> 704693 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[208]} 0 0
[junit4:junit4] 2> 704695 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[209]} 0 0
[junit4:junit4] 2> 704697 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[210]} 0 0
[junit4:junit4] 2> 704699 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[211]} 0 0
[junit4:junit4] 2> 704701 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[212]} 0 0
[junit4:junit4] 2> 704703 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[213]} 0 0
[junit4:junit4] 2> 704705 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[214]} 0 0
[junit4:junit4] 2> 704707 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[215]} 0 0
[junit4:junit4] 2> 704710 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[216]} 0 1
[junit4:junit4] 2> 704712 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[217]} 0 1
[junit4:junit4] 2> 704714 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[218]} 0 0
[junit4:junit4] 2> 704716 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[219]} 0 1
[junit4:junit4] 2> 704718 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[220]} 0 0
[junit4:junit4] 2> 704720 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[221]} 0 0
[junit4:junit4] 2> 704722 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[222]} 0 0
[junit4:junit4] 2> 704724 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[223]} 0 0
[junit4:junit4] 2> 704726 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[224]} 0 0
[junit4:junit4] 2> 704728 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[225]} 0 0
[junit4:junit4] 2> 704730 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[226]} 0 0
[junit4:junit4] 2> 704732 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[227]} 0 0
[junit4:junit4] 2> 704734 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[228]} 0 0
[junit4:junit4] 2> 704736 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[229]} 0 0
[junit4:junit4] 2> 704738 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[230]} 0 0
[junit4:junit4] 2> 704740 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[231]} 0 0
[junit4:junit4] 2> 704742 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[232]} 0 0
[junit4:junit4] 2> 704744 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[233]} 0 0
[junit4:junit4] 2> 704746 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[234]} 0 0
[junit4:junit4] 2> 704748 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[235]} 0 0
[junit4:junit4] 2> 704750 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[236]} 0 0
[junit4:junit4] 2> 704752 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[237]} 0 0
[junit4:junit4] 2> 704754 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[238]} 0 0
[junit4:junit4] 2> 704756 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[239]} 0 0
[junit4:junit4] 2> 704758 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[240]} 0 0
[junit4:junit4] 2> 704760 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[241]} 0 0
[junit4:junit4] 2> 704762 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[242]} 0 0
[junit4:junit4] 2> 704764 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[243]} 0 0
[junit4:junit4] 2> 704766 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[244]} 0 0
[junit4:junit4] 2> 704768 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[245]} 0 0
[junit4:junit4] 2> 704770 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[246]} 0 0
[junit4:junit4] 2> 704772 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[247]} 0 0
[junit4:junit4] 2> 704774 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[248]} 0 0
[junit4:junit4] 2> 704776 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[249]} 0 0
[junit4:junit4] 2> 704778 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[250]} 0 0
[junit4:junit4] 2> 704780 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[251]} 0 0
[junit4:junit4] 2> 704782 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[252]} 0 0
[junit4:junit4] 2> 704784 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[253]} 0 0
[junit4:junit4] 2> 704786 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[254]} 0 0
[junit4:junit4] 2> 704788 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[255]} 0 0
[junit4:junit4] 2> 704790 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[256]} 0 0
[junit4:junit4] 2> 704792 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[257]} 0 0
[junit4:junit4] 2> 704794 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[258]} 0 0
[junit4:junit4] 2> 704796 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[259]} 0 0
[junit4:junit4] 2> 704798 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[260]} 0 0
[junit4:junit4] 2> 704800 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[261]} 0 1
[junit4:junit4] 2> 704802 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[262]} 0 1
[junit4:junit4] 2> 704803 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[263]} 0 0
[junit4:junit4] 2> 704805 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[264]} 0 0
[junit4:junit4] 2> 704807 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[265]} 0 0
[junit4:junit4] 2> 704809 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[266]} 0 0
[junit4:junit4] 2> 704811 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[267]} 0 0
[junit4:junit4] 2> 704813 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[268]} 0 0
[junit4:junit4] 2> 704815 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[269]} 0 0
[junit4:junit4] 2> 704817 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[270]} 0 0
[junit4:junit4] 2> 704819 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[271]} 0 0
[junit4:junit4] 2> 704821 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[272]} 0 0
[junit4:junit4] 2> 704823 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[273]} 0 0
[junit4:junit4] 2> 704825 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[274]} 0 0
[junit4:junit4] 2> 704827 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[275]} 0 0
[junit4:junit4] 2> 704829 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[276]} 0 0
[junit4:junit4] 2> 704831 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[277]} 0 0
[junit4:junit4] 2> 704833 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[278]} 0 0
[junit4:junit4] 2> 704835 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[279]} 0 0
[junit4:junit4] 2> 704837 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[280]} 0 0
[junit4:junit4] 2> 704839 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[281]} 0 1
[junit4:junit4] 2> 704841 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[282]} 0 1
[junit4:junit4] 2> 704843 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[283]} 0 1
[junit4:junit4] 2> 704845 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[284]} 0 1
[junit4:junit4] 2> 704846 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[285]} 0 0
[junit4:junit4] 2> 704848 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[286]} 0 0
[junit4:junit4] 2> 704850 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[287]} 0 0
[junit4:junit4] 2> 704852 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[288]} 0 0
[junit4:junit4] 2> 704854 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[289]} 0 0
[junit4:junit4] 2> 704856 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[290]} 0 0
[junit4:junit4] 2> 704858 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[291]} 0 0
[junit4:junit4] 2> 704860 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[292]} 0 0
[junit4:junit4] 2> 704862 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[293]} 0 0
[junit4:junit4] 2> 704864 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[294]} 0 0
[junit4:junit4] 2> 704866 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[295]} 0 0
[junit4:junit4] 2> 704868 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[296]} 0 0
[junit4:junit4] 2> 704870 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[297]} 0 0
[junit4:junit4] 2> 704872 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[298]} 0 0
[junit4:junit4] 2> 704874 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[299]} 0 0
[junit4:junit4] 2> 704876 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[300]} 0 0
[junit4:junit4] 2> 704878 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[301]} 0 0
[junit4:junit4] 2> 704880 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[302]} 0 0
[junit4:junit4] 2> 704882 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[303]} 0 0
[junit4:junit4] 2> 704884 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[304]} 0 0
[junit4:junit4] 2> 704886 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[305]} 0 0
[junit4:junit4] 2> 704888 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[306]} 0 0
[junit4:junit4] 2> 704890 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[307]} 0 0
[junit4:junit4] 2> 704892 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[308]} 0 0
[junit4:junit4] 2> 704894 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[309]} 0 0
[junit4:junit4] 2> 704896 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[310]} 0 0
[junit4:junit4] 2> 704898 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[311]} 0 0
[junit4:junit4] 2> 704900 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[312]} 0 0
[junit4:junit4] 2> 704902 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[313]} 0 0
[junit4:junit4] 2> 704904 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[314]} 0 0
[junit4:junit4] 2> 704906 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[315]} 0 0
[junit4:junit4] 2> 704908 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[316]} 0 0
[junit4:junit4] 2> 704910 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[317]} 0 0
[junit4:junit4] 2> 704912 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[318]} 0 0
[junit4:junit4] 2> 704914 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[319]} 0 0
[junit4:junit4] 2> 704916 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[320]} 0 0
[junit4:junit4] 2> 704918 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[321]} 0 0
[junit4:junit4] 2> 704920 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[322]} 0 0
[junit4:junit4] 2> 704922 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[323]} 0 0
[junit4:junit4] 2> 704924 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[324]} 0 0
[junit4:junit4] 2> 704926 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[325]} 0 0
[junit4:junit4] 2> 704928 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[326]} 0 0
[junit4:junit4] 2> 704930 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[327]} 0 0
[junit4:junit4] 2> 704932 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[328]} 0 0
[junit4:junit4] 2> 704934 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[329]} 0 0
[junit4:junit4] 2> 704936 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[330]} 0 0
[junit4:junit4] 2> 704938 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[331]} 0 0
[junit4:junit4] 2> 704940 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[332]} 0 0
[junit4:junit4] 2> 704942 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[333]} 0 0
[junit4:junit4] 2> 704944 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[334]} 0 0
[junit4:junit4] 2> 704946 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[335]} 0 0
[junit4:junit4] 2> 704949 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[336]} 0 1
[junit4:junit4] 2> 704951 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[337]} 0 1
[junit4:junit4] 2> 704953 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[338]} 0 1
[junit4:junit4] 2> 704955 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[339]} 0 1
[junit4:junit4] 2> 704957 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[340]} 0 0
[junit4:junit4] 2> 704959 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[341]} 0 0
[junit4:junit4] 2> 704961 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[342]} 0 0
[junit4:junit4] 2> 704963 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[343]} 0 0
[junit4:junit4] 2> 704965 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[344]} 0 0
[junit4:junit4] 2> 704967 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[345]} 0 0
[junit4:junit4] 2> 704970 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[346]} 0 1
[junit4:junit4] 2> 704972 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[347]} 0 0
[junit4:junit4] 2> 704975 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[348]} 0 0
[junit4:junit4] 2> 704977 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[349]} 0 0
[junit4:junit4] 2> 704979 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[350]} 0 0
[junit4:junit4] 2> 704982 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[351]} 0 1
[junit4:junit4] 2> 704984 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[352]} 0 0
[junit4:junit4] 2> 704986 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[353]} 0 0
[junit4:junit4] 2> 704988 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[354]} 0 0
[junit4:junit4] 2> 704990 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[355]} 0 0
[junit4:junit4] 2> 704992 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[356]} 0 0
[junit4:junit4] 2> 704994 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[357]} 0 0
[junit4:junit4] 2> 704996 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[358]} 0 0
[junit4:junit4] 2> 704998 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[359]} 0 0
[junit4:junit4] 2> 705000 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[360]} 0 0
[junit4:junit4] 2> 705002 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[361]} 0 0
[junit4:junit4] 2> 705004 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[362]} 0 0
[junit4:junit4] 2> 705006 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[363]} 0 0
[junit4:junit4] 2> 705008 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[364]} 0 0
[junit4:junit4] 2> 705011 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[365]} 0 1
[junit4:junit4] 2> 705013 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[366]} 0 1
[junit4:junit4] 2> 705015 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[367]} 0 0
[junit4:junit4] 2> 705017 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[368]} 0 0
[junit4:junit4] 2> 705019 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[369]} 0 0
[junit4:junit4] 2> 705021 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[370]} 0 0
[junit4:junit4] 2> 705023 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[371]} 0 0
[junit4:junit4] 2> 705025 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[372]} 0 0
[junit4:junit4] 2> 705027 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[373]} 0 0
[junit4:junit4] 2> 705029 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[374]} 0 0
[junit4:junit4] 2> 705031 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[375]} 0 0
[junit4:junit4] 2> 705033 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[376]} 0 0
[junit4:junit4] 2> 705035 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[377]} 0 0
[junit4:junit4] 2> 705037 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[378]} 0 0
[junit4:junit4] 2> 705039 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[379]} 0 0
[junit4:junit4] 2> 705041 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[380]} 0 0
[junit4:junit4] 2> 705043 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[381]} 0 0
[junit4:junit4] 2> 705045 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[382]} 0 0
[junit4:junit4] 2> 705047 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[383]} 0 0
[junit4:junit4] 2> 705049 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[384]} 0 0
[junit4:junit4] 2> 705052 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[385]} 0 1
[junit4:junit4] 2> 705054 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[386]} 0 0
[junit4:junit4] 2> 705056 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[387]} 0 0
[junit4:junit4] 2> 705058 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[388]} 0 0
[junit4:junit4] 2> 705061 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[389]} 0 0
[junit4:junit4] 2> 705063 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[390]} 0 0
[junit4:junit4] 2> 705065 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[391]} 0 0
[junit4:junit4] 2> 705068 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[392]} 0 1
[junit4:junit4] 2> 705070 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[393]} 0 0
[junit4:junit4] 2> 705072 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[394]} 0 0
[junit4:junit4] 2> 705074 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[395]} 0 0
[junit4:junit4] 2> 705076 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[396]} 0 1
[junit4:junit4] 2> 705078 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[397]} 0 0
[junit4:junit4] 2> 705080 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[398]} 0 0
[junit4:junit4] 2> 705082 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[399]} 0 1
[junit4:junit4] 2> 705084 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[400]} 0 1
[junit4:junit4] 2> 705086 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[401]} 0 0
[junit4:junit4] 2> 705088 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[402]} 0 0
[junit4:junit4] 2> 705090 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[403]} 0 1
[junit4:junit4] 2> 705092 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[404]} 0 1
[junit4:junit4] 2> 705094 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[405]} 0 0
[junit4:junit4] 2> 705096 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[406]} 0 0
[junit4:junit4] 2> 705098 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[407]} 0 0
[junit4:junit4] 2> 705100 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[408]} 0 1
[junit4:junit4] 2> 705102 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[409]} 0 0
[junit4:junit4] 2> 705104 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[410]} 0 0
[junit4:junit4] 2> 705106 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[411]} 0 0
[junit4:junit4] 2> 705108 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[412]} 0 0
[junit4:junit4] 2> 705110 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[413]} 0 0
[junit4:junit4] 2> 705112 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[414]} 0 0
[junit4:junit4] 2> 705114 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[415]} 0 0
[junit4:junit4] 2> 705116 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[416]} 0 0
[junit4:junit4] 2> 705118 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[417]} 0 0
[junit4:junit4] 2> 705120 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[418]} 0 0
[junit4:junit4] 2> 705122 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[419]} 0 0
[junit4:junit4] 2> 705125 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[420]} 0 1
[junit4:junit4] 2> 705127 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[421]} 0 0
[junit4:junit4] 2> 705129 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[422]} 0 0
[junit4:junit4] 2> 705131 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[423]} 0 0
[junit4:junit4] 2> 705133 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[424]} 0 0
[junit4:junit4] 2> 705135 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[425]} 0 0
[junit4:junit4] 2> 705137 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[426]} 0 0
[junit4:junit4] 2> 705139 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[427]} 0 0
[junit4:junit4] 2> 705141 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[428]} 0 0
[junit4:junit4] 2> 705143 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[429]} 0 0
[junit4:junit4] 2> 705145 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[430]} 0 0
[junit4:junit4] 2> 705147 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[431]} 0 0
[junit4:junit4] 2> 705149 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[432]} 0 0
[junit4:junit4] 2> 705151 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[433]} 0 0
[junit4:junit4] 2> 705153 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[434]} 0 0
[junit4:junit4] 2> 705155 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[435]} 0 0
[junit4:junit4] 2> 705157 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[436]} 0 0
[junit4:junit4] 2> 705159 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[437]} 0 0
[junit4:junit4] 2> 705161 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[438]} 0 0
[junit4:junit4] 2> 705163 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[439]} 0 0
[junit4:junit4] 2> 705165 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[440]} 0 0
[junit4:junit4] 2> 705167 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[441]} 0 0
[junit4:junit4] 2> 705169 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[442]} 0 0
[junit4:junit4] 2> 705171 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[443]} 0 0
[junit4:junit4] 2> 705173 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[444]} 0 0
[junit4:junit4] 2> 705175 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[445]} 0 0
[junit4:junit4] 2> 705177 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[446]} 0 0
[junit4:junit4] 2> 705179 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[447]} 0 0
[junit4:junit4] 2> 705181 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[448]} 0 0
[junit4:junit4] 2> 705184 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[449]} 0 1
[junit4:junit4] 2> 705186 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[450]} 0 1
[junit4:junit4] 2> 705188 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[451]} 0 1
[junit4:junit4] 2> 705190 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[452]} 0 1
[junit4:junit4] 2> 705192 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[453]} 0 1
[junit4:junit4] 2> 705194 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[454]} 0 1
[junit4:junit4] 2> 705196 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[455]} 0 0
[junit4:junit4] 2> 705198 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[456]} 0 0
[junit4:junit4] 2> 705200 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[457]} 0 0
[junit4:junit4] 2> 705202 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[458]} 0 0
[junit4:junit4] 2> 705204 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[459]} 0 0
[junit4:junit4] 2> 705206 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[460]} 0 0
[junit4:junit4] 2> 705208 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[461]} 0 0
[junit4:junit4] 2> 705210 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[462]} 0 0
[junit4:junit4] 2> 705212 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[463]} 0 0
[junit4:junit4] 2> 705214 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[464]} 0 0
[junit4:junit4] 2> 705216 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[465]} 0 0
[junit4:junit4] 2> 705219 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[466]} 0 1
[junit4:junit4] 2> 705221 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[467]} 0 1
[junit4:junit4] 2> 705223 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[468]} 0 1
[junit4:junit4] 2> 705225 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[469]} 0 0
[junit4:junit4] 2> 705227 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[470]} 0 0
[junit4:junit4] 2> 705229 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[471]} 0 0
[junit4:junit4] 2> 705231 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[472]} 0 0
[junit4:junit4] 2> 705233 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[473]} 0 0
[junit4:junit4] 2> 705235 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[474]} 0 0
[junit4:junit4] 2> 705238 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[475]} 0 0
[junit4:junit4] 2> 705241 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[476]} 0 0
[junit4:junit4] 2> 705243 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[477]} 0 0
[junit4:junit4] 2> 705245 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[478]} 0 0
[junit4:junit4] 2> 705247 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[479]} 0 0
[junit4:junit4] 2> 705249 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[480]} 0 0
[junit4:junit4] 2> 705251 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[481]} 0 0
[junit4:junit4] 2> 705253 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[482]} 0 0
[junit4:junit4] 2> 705255 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[483]} 0 0
[junit4:junit4] 2> 705259 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[484]} 0 2
[junit4:junit4] 2> 705261 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[485]} 0 0
[junit4:junit4] 2> 705263 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[486]} 0 0
[junit4:junit4] 2> 705265 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[487]} 0 0
[junit4:junit4] 2> 705267 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[488]} 0 0
[junit4:junit4] 2> 705270 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[489]} 0 1
[junit4:junit4] 2> 705272 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[490]} 0 1
[junit4:junit4] 2> 705274 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[491]} 0 1
[junit4:junit4] 2> 705276 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[492]} 0 0
[junit4:junit4] 2> 705278 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[493]} 0 0
[junit4:junit4] 2> 705280 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[494]} 0 0
[junit4:junit4] 2> 705282 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[495]} 0 0
[junit4:junit4] 2> 705284 T2358 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[496]} 0 0
[junit4:junit4] 2> 705286 T2357 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[497]} 0 0
[junit4:junit4] 2> 705288 T2360 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[498]} 0 0
[junit4:junit4] 2> 705290 T2359 C2276 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 705316 T2359 C2276 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141704/master/collection1/data/index,segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141704/master/collection1/data/index,segFN=segments_2,generation=2}
[junit4:junit4] 2> 705317 T2359 C2276 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 705319 T2359 C2276 oass.SolrIndexSearcher.<init> Opening Searcher@1c823f3 main
[junit4:junit4] 2> 705319 T2359 C2276 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 705319 T2362 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1c823f3 main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):C499)}
[junit4:junit4] 2> 705320 T2359 C2276 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 30
[junit4:junit4] 2> 705342 T2326 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=12632450
[junit4:junit4] 2> 705343 T2326 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@129e5ce
[junit4:junit4] 2> 705343 T2326 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=499,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 705344 T2326 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 705344 T2326 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 705344 T2326 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 705345 T2326 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 705345 T2326 oasc.CachingDirectoryFactory.close Closing StandardDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 705346 T2326 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141704/master/collection1/data/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141704/master/collection1/data/index;done=false>>]
[junit4:junit4] 2> 705346 T2326 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141704/master/collection1/data/index
[junit4:junit4] 2> 705346 T2326 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141704/master/collection1/data [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141704/master/collection1/data;done=false>>]
[junit4:junit4] 2> 705347 T2326 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141704/master/collection1/data
[junit4:junit4] 2> 705347 T2326 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4:junit4] 2> 705398 T2326 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 705400 T2326 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:59340
[junit4:junit4] 2> 705401 T2326 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 705401 T2326 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 705401 T2326 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141704/master
[junit4:junit4] 2> 705402 T2326 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141704/master/solr.xml
[junit4:junit4] 2> 705402 T2326 oasc.CoreContainer.<init> New CoreContainer 33063937
[junit4:junit4] 2> 705402 T2326 oasc.CoreContainer$Initializer.initialize no solr.xml found. using default old-style solr.xml
[junit4:junit4] 2> 705403 T2326 oasc.CoreContainer.load Loading CoreContainer using Solr Home: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141704/master/'
[junit4:junit4] 2> 705403 T2326 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141704/master/'
[junit4:junit4] 2> 705455 T2326 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4] 2> 705455 T2326 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 705455 T2326 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4] 2> 705456 T2326 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 705456 T2326 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 705456 T2326 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 705456 T2326 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 705457 T2326 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 705457 T2326 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 705457 T2326 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4] 2> 705460 T2326 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 705463 T2373 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141704/master/collection1
[junit4:junit4] 2> 705463 T2373 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141704/master/collection1/'
[junit4:junit4] 2> 705540 T2373 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 705575 T2373 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 705576 T2373 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 705578 T2373 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 705587 T2373 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 705588 T2373 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 705589 T2373 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141704/master/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141704/master/collection1/data/
[junit4:junit4] 2> 705589 T2373 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4:junit4] 2> 705589 T2373 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141704/master/collection1/data
[junit4:junit4] 2> 705589 T2373 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141704/master/collection1/data/index/
[junit4:junit4] 2> 705591 T2373 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 705592 T2373 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 705592 T2373 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 705592 T2373 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 705592 T2373 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 705592 T2373 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 705595 T2373 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 705596 T2373 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141704/master/collection1/data/index
[junit4:junit4] 2> 705598 T2373 oass.SolrIndexSearcher.<init> Opening Searcher@b60ce5 main
[junit4:junit4] 2> 705598 T2373 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 705598 T2373 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 705599 T2373 oash.ReplicationHandler.inform Replication enabled for following config files: schema.xml
[junit4:junit4] 2> 705600 T2373 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141704/master/collection1/data/index,segFN=segments_2,generation=2}
[junit4:junit4] 2> 705601 T2373 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 705601 T2373 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 705601 T2373 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 705601 T2374 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@b60ce5 main{StandardDirectoryReader(segments_2:3 _0(5.0):C499)}
[junit4:junit4] 2> 705602 T2326 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 705602 T2326 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> ASYNC NEW_CORE C2277 name=collection1 org.apache.solr.core.SolrCore@1dfb917
[junit4:junit4] 2> 705609 T2369 C2277 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={sort=id+desc&q=*:*&wt=javabin&version=2} hits=499 status=0 QTime=3
[junit4:junit4] 2> 705611 T2326 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 705613 T2326 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:55942
[junit4:junit4] 2> 705613 T2326 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 705613 T2326 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 705614 T2326 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141902/slave
[junit4:junit4] 2> 705614 T2326 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141902/slave/solr.xml
[junit4:junit4] 2> 705614 T2326 oasc.CoreContainer.<init> New CoreContainer 11273034
[junit4:junit4] 2> 705614 T2326 oasc.CoreContainer$Initializer.initialize no solr.xml found. using default old-style solr.xml
[junit4:junit4] 2> 705615 T2326 oasc.CoreContainer.load Loading CoreContainer using Solr Home: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141902/slave/'
[junit4:junit4] 2> 705615 T2326 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141902/slave/'
[junit4:junit4] 2> 705662 T2326 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4] 2> 705662 T2326 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 705663 T2326 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4] 2> 705663 T2326 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 705663 T2326 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 705663 T2326 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 705664 T2326 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 705664 T2326 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 705664 T2326 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 705664 T2326 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4] 2> 705667 T2326 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 705669 T2385 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141902/slave/collection1
[junit4:junit4] 2> 705670 T2385 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141902/slave/collection1/'
[junit4:junit4] 2> 705697 T2385 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 705723 T2385 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 705723 T2385 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 705725 T2385 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 705734 T2385 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 705735 T2385 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 705735 T2385 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141902/slave/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141902/slave/collection1/data/
[junit4:junit4] 2> 705735 T2385 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4:junit4] 2> 705736 T2385 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141902/slave/collection1/data
[junit4:junit4] 2> 705736 T2385 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141902/slave/collection1/data/index/
[junit4:junit4] 2> 705736 T2385 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141902/slave/collection1/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 705737 T2385 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141902/slave/collection1/data/index
[junit4:junit4] 2> 705748 T2385 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141902/slave/collection1/data/index,segFN=segments_1,generation=1}
[junit4:junit4] 2> 705748 T2385 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 705749 T2385 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 705750 T2385 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 705750 T2385 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 705750 T2385 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 705750 T2385 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 705751 T2385 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 705752 T2385 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 705754 T2385 oass.SolrIndexSearcher.<init> Opening Searcher@d5af6d main
[junit4:junit4] 2> 705754 T2385 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 705754 T2385 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 705754 T2385 oash.SnapPuller.startExecutorService Poll Scheduled at an interval of 1000ms
[junit4:junit4] 2> 705755 T2385 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 705755 T2386 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@d5af6d main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 705755 T2326 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 705755 T2326 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 705756 T2326 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C2278 name=collection1 org.apache.solr.core.SolrCore@1dddea5
[junit4:junit4] 2> 705762 T2381 C2278 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={sort=id+desc&q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4:junit4] 2> 705763 T2326 oash.TestReplicationHandler.rQuery Waiting for 499 docs
[junit4:junit4] 2> 705865 T2382 C2278 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={sort=id+desc&q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4:junit4] 2> 705866 T2326 oash.TestReplicationHandler.rQuery Waiting for 499 docs
[junit4:junit4] 2> 705968 T2383 C2278 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={sort=id+desc&q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4:junit4] 2> 705969 T2326 oash.TestReplicationHandler.rQuery Waiting for 499 docs
[junit4:junit4] 2> 706071 T2381 C2278 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={sort=id+desc&q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4:junit4] 2> 706072 T2326 oash.TestReplicationHandler.rQuery Waiting for 499 docs
[junit4:junit4] 2> 706174 T2383 C2278 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={sort=id+desc&q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4:junit4] 2> 706175 T2326 oash.TestReplicationHandler.rQuery Waiting for 499 docs
[junit4:junit4] 2> 706278 T2384 C2278 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={sort=id+desc&q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4:junit4] 2> 706279 T2326 oash.TestReplicationHandler.rQuery Waiting for 499 docs
[junit4:junit4] 2> 706381 T2382 C2278 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={sort=id+desc&q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4:junit4] 2> 706382 T2326 oash.TestReplicationHandler.rQuery Waiting for 499 docs
[junit4:junit4] 2> 706484 T2381 C2278 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={sort=id+desc&q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4:junit4] 2> 706485 T2326 oash.TestReplicationHandler.rQuery Waiting for 499 docs
[junit4:junit4] 2> 706587 T2384 C2278 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={sort=id+desc&q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4:junit4] 2> 706587 T2326 oash.TestReplicationHandler.rQuery Waiting for 499 docs
[junit4:junit4] 2> 706681 T2370 C2277 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4] 2> 706682 T2387 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 706682 T2387 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 706682 T2387 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 706688 T2371 C2277 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=4
[junit4:junit4] 2> 706689 T2387 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 10
[junit4:junit4] 2> 706689 T2387 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141902/slave/collection1/data/index.20130627080225010
[junit4:junit4] 2> 706690 T2382 C2278 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={sort=id+desc&q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=1
[junit4:junit4] 2> 706690 T2387 oash.SnapPuller.fetchLatestIndex Starting download to org.apache.lucene.store.NIOFSDirectory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141902/slave/collection1/data/index.20130627080225010 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1984ad7 fullCopy=false
[junit4:junit4] 2> 706690 T2326 oash.TestReplicationHandler.rQuery Waiting for 499 docs
[junit4:junit4] 2> 706692 T2372 C2277 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_0.fnm&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 706695 T2369 C2277 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_0_Lucene41_0.doc&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> ASYNC NEW_CORE C2279 name=collection1 org.apache.solr.core.SolrCore@1dfb917
[junit4:junit4] 2> 706746 T2370 C2279 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_0.nvd&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 706749 T2371 C2279 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 706752 T2372 C2279 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_0.fdx&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 706755 T2369 C2279 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_0.si&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=1
[junit4:junit4] 2> 706757 T2370 C2279 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_0.nvm&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 706760 T2371 C2279 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_0_Lucene41_0.tim&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 706763 T2372 C2279 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_0.fdt&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 706766 T2369 C2279 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_0_Lucene41_0.tip&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 706767 T2387 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 706768 T2387 oasu.DefaultSolrCoreState.closeIndexWriter Closing IndexWriter...
[junit4:junit4] 2> 706768 T2387 oasu.DefaultSolrCoreState.closeIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 706770 T2387 oasu.DefaultSolrCoreState.openIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 706772 T2387 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141902/slave/collection1/data/index,segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141902/slave/collection1/data/index,segFN=segments_2,generation=2}
[junit4:junit4] 2> 706773 T2387 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 706773 T2387 oasu.DefaultSolrCoreState.openIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 706775 T2387 oass.SolrIndexSearcher.<init> Opening Searcher@1c36942 main
[junit4:junit4] 2> 706775 T2386 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1c36942 main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):C499)}
[junit4:junit4] 2> 706775 T2387 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141902/slave/collection1/data/index.20130627080225010 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141902/slave/collection1/data/index.20130627080225010;done=true>>]
[junit4:junit4] 2> 706775 T2387 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141902/slave/collection1/data/index.20130627080225010
[junit4:junit4] 2> 706776 T2387 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141902/slave/collection1/data/index.20130627080225010
[junit4:junit4] 2> ASYNC NEW_CORE C2280 name=collection1 org.apache.solr.core.SolrCore@1dddea5
[junit4:junit4] 2> 706794 T2383 C2280 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={sort=id+desc&q=*:*&wt=javabin&version=2} hits=499 status=0 QTime=2
[junit4:junit4] 2> 706795 T2326 oas.SolrTestCaseJ4.tearDown ###Ending doTestReplicateAfterStartupWithNoActivity
[junit4:junit4] 2> 706817 T2326 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=33063937
[junit4:junit4] 2> 706817 T2326 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@1dfb917
[junit4:junit4] 2> 706818 T2326 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 706818 T2326 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 706818 T2326 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 706818 T2326 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 706819 T2326 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 706819 T2326 oasc.CachingDirectoryFactory.close Closing StandardDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 706820 T2326 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141704/master/collection1/data [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141704/master/collection1/data;done=false>>]
[junit4:junit4] 2> 706820 T2326 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141704/master/collection1/data
[junit4:junit4] 2> 706820 T2326 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141704/master/collection1/data/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141704/master/collection1/data/index;done=false>>]
[junit4:junit4] 2> 706820 T2326 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141704/master/collection1/data/index
[junit4:junit4] 2> 706821 T2326 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4:junit4] 2> 706894 T2326 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=11273034
[junit4:junit4] 2> 706895 T2326 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@1dddea5
[junit4:junit4] 2> 706895 T2326 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 706896 T2326 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 706896 T2326 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 706896 T2326 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 706897 T2326 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 706897 T2326 oasc.CachingDirectoryFactory.close Closing StandardDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 706898 T2326 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141902/slave/collection1/data [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141902/slave/collection1/data;done=false>>]
[junit4:junit4] 2> 706898 T2326 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141902/slave/collection1/data
[junit4:junit4] 2> 706898 T2326 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141902/slave/collection1/data/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141902/slave/collection1/data/index;done=false>>]
[junit4:junit4] 2> 706899 T2326 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320141902/slave/collection1/data/index
[junit4:junit4] 2> 706899 T2326 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4:junit4] 2> 706961 T2326 oas.SolrTestCaseJ4.setUp ###Starting doTestRepeater
[junit4:junit4] 2> 706963 T2326 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 706965 T2326 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:35330
[junit4:junit4] 2> 706965 T2326 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 706965 T2326 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 706966 T2326 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320145282/master
[junit4:junit4] 2> 706966 T2326 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320145282/master/solr.xml
[junit4:junit4] 2> 706966 T2326 oasc.CoreContainer.<init> New CoreContainer 465811
[junit4:junit4] 2> 706967 T2326 oasc.CoreContainer$Initializer.initialize no solr.xml found. using default old-style solr.xml
[junit4:junit4] 2> 706967 T2326 oasc.CoreContainer.load Loading CoreContainer using Solr Home: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320145282/master/'
[junit4:junit4] 2> 706967 T2326 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320145282/master/'
[junit4:junit4] 2> 707022 T2326 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4] 2> 707023 T2326 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 707023 T2326 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4] 2> 707023 T2326 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 707023 T2326 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 707024 T2326 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 707024 T2326 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 707024 T2326 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 707024 T2326 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 707025 T2326 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4] 2> 707028 T2326 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 707030 T2399 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320145282/master/collection1
[junit4:junit4] 2> 707030 T2399 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320145282/master/collection1/'
[junit4:junit4] 2> 707059 T2399 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 707085 T2399 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 707086 T2399 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 707087 T2399 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 707097 T2399 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 707098 T2399 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 707098 T2399 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320145282/master/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320145282/master/collection1/data/
[junit4:junit4] 2> 707098 T2399 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4:junit4] 2> 707099 T2399 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320145282/master/collection1/data
[junit4:junit4] 2> 707099 T2399 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320145282/master/collection1/data/index/
[junit4:junit4] 2> 707099 T2399 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320145282/master/collection1/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 707100 T2399 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320145282/master/collection1/data/index
[junit4:junit4] 2> 707101 T2399 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1497b04 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@14ead15),segFN=segments_1,generation=1}
[junit4:junit4] 2> 707101 T2399 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 707103 T2399 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 707103 T2399 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 707103 T2399 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 707104 T2399 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 707104 T2399 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 707104 T2399 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 707106 T2399 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 707108 T2399 oass.SolrIndexSearcher.<init> Opening Searcher@e93e40 main
[junit4:junit4] 2> 707108 T2399 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 707108 T2399 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 707109 T2399 oash.ReplicationHandler.inform Replication enabled for following config files: schema.xml,xslt/dummy.xsl
[junit4:junit4] 2> 707109 T2399 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 707109 T2399 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 707109 T2400 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@e93e40 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 707110 T2326 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 707110 T2326 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 707110 T2326 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 707114 T2326 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 707116 T2326 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:35946
[junit4:junit4] 2> 707116 T2326 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 707117 T2326 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 707117 T2326 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320145433/slave
[junit4:junit4] 2> 707117 T2326 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320145433/slave/solr.xml
[junit4:junit4] 2> 707117 T2326 oasc.CoreContainer.<init> New CoreContainer 29882211
[junit4:junit4] 2> 707118 T2326 oasc.CoreContainer$Initializer.initialize no solr.xml found. using default old-style solr.xml
[junit4:junit4] 2> 707118 T2326 oasc.CoreContainer.load Loading CoreContainer using Solr Home: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320145433/slave/'
[junit4:junit4] 2> 707118 T2326 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320145433/slave/'
[junit4:junit4] 2> 707204 T2326 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4] 2> 707204 T2326 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 707205 T2326 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4] 2> 707205 T2326 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 707205 T2326 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 707205 T2326 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 707206 T2326 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 707206 T2326 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 707206 T2326 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 707206 T2326 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4] 2> 707209 T2326 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 707213 T2411 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320145433/slave/collection1
[junit4:junit4] 2> 707213 T2411 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320145433/slave/collection1/'
[junit4:junit4] 2> 707241 T2411 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 707267 T2411 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 707267 T2411 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 707269 T2411 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 707278 T2411 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 707279 T2411 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 707279 T2411 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320145433/slave/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320145433/slave/collection1/data/
[junit4:junit4] 2> 707279 T2411 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4:junit4] 2> 707280 T2411 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320145433/slave/collection1/data
[junit4:junit4] 2> 707280 T2411 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320145433/slave/collection1/data/index/
[junit4:junit4] 2> 707280 T2411 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320145433/slave/collection1/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 707281 T2411 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320145433/slave/collection1/data/index
[junit4:junit4] 2> 707282 T2411 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@16735cf lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@140332e),segFN=segments_1,generation=1}
[junit4:junit4] 2> 707282 T2411 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 707284 T2411 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 707284 T2411 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 707284 T2411 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 707284 T2411 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 707285 T2411 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 707285 T2411 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 707286 T2411 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 707288 T2411 oass.SolrIndexSearcher.<init> Opening Searcher@f419b main
[junit4:junit4] 2> 707288 T2411 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 707288 T2411 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 707289 T2411 oash.SnapPuller.startExecutorService Poll Scheduled at an interval of 1000ms
[junit4:junit4] 2> 707289 T2411 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 707289 T2412 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@f419b main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 707290 T2326 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 707290 T2326 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 707290 T2326 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 707315 T2326 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=29882211
[junit4:junit4] 2> 707316 T2326 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@312e6e
[junit4:junit4] 2> 707316 T2326 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 707317 T2326 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 707317 T2326 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 707317 T2326 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 707317 T2326 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 707318 T2326 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 707318 T2326 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320145433/slave/collection1/data/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320145433/slave/collection1/data/index;done=false>>]
[junit4:junit4] 2> 707318 T2326 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320145433/slave/collection1/data/index
[junit4:junit4] 2> 707319 T2326 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320145433/slave/collection1/data [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320145433/slave/collection1/data;done=false>>]
[junit4:junit4] 2> 707319 T2326 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320145433/slave/collection1/data
[junit4:junit4] 2> 707319 T2326 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4:junit4] 2> 707371 T2326 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 707373 T2326 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:35283
[junit4:junit4] 2> 707374 T2326 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 707374 T2326 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 707375 T2326 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320145433/slave
[junit4:junit4] 2> 707375 T2326 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320145433/slave/solr.xml
[junit4:junit4] 2> 707376 T2326 oasc.CoreContainer.<init> New CoreContainer 30405961
[junit4:junit4] 2> 707376 T2326 oasc.CoreContainer$Initializer.initialize no solr.xml found. using default old-style solr.xml
[junit4:junit4] 2> 707376 T2326 oasc.CoreContainer.load Loading CoreContainer using Solr Home: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320145433/slave/'
[junit4:junit4] 2> 707377 T2326 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320145433/slave/'
[junit4:junit4] 2> 707433 T2326 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4] 2> 707433 T2326 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 707434 T2326 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4] 2> 707434 T2326 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 707434 T2326 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 707434 T2326 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 707435 T2326 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 707435 T2326 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 707435 T2326 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 707436 T2326 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4] 2> 707438 T2326 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 707441 T2424 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320145433/slave/collection1
[junit4:junit4] 2> 707441 T2424 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320145433/slave/collection1/'
[junit4:junit4] 2> 707469 T2424 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 707495 T2424 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 707495 T2424 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 707497 T2424 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 707553 T2424 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 707554 T2424 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 707554 T2424 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320145433/slave/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320145433/slave/collection1/data/
[junit4:junit4] 2> 707555 T2424 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4:junit4] 2> 707555 T2424 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320145433/slave/collection1/data
[junit4:junit4] 2> 707555 T2424 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320145433/slave/collection1/data/index/
[junit4:junit4] 2> 707556 T2424 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320145433/slave/collection1/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 707556 T2424 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320145433/slave/collection1/data/index
[junit4:junit4] 2> 707558 T2424 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1a07a78 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@f65ea),segFN=segments_1,generation=1}
[junit4:junit4] 2> 707558 T2424 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 707560 T2424 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 707560 T2424 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 707561 T2424 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 707561 T2424 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 707561 T2424 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 707562 T2424 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 707563 T2424 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 707565 T2424 oass.SolrIndexSearcher.<init> Opening Searcher@10eee0d main
[junit4:junit4] 2> 707565 T2424 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 707566 T2424 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 707566 T2424 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 707566 T2424 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 707566 T2425 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@10eee0d main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 707566 T2326 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 707567 T2326 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 707567 T2326 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 707571 T2326 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 707573 T2326 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:55668
[junit4:junit4] 2> 707573 T2326 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 707574 T2326 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 707574 T2326 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320145890/repeater
[junit4:junit4] 2> 707574 T2326 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320145890/repeater/solr.xml
[junit4:junit4] 2> 707575 T2326 oasc.CoreContainer.<init> New CoreContainer 9233329
[junit4:junit4] 2> 707575 T2326 oasc.CoreContainer$Initializer.initialize no solr.xml found. using default old-style solr.xml
[junit4:junit4] 2> 707575 T2326 oasc.CoreContainer.load Loading CoreContainer using Solr Home: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320145890/repeater/'
[junit4:junit4] 2> 707575 T2326 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320145890/repeater/'
[junit4:junit4] 2> 707624 T2326 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4] 2> 707625 T2326 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 707625 T2326 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4] 2> 707625 T2326 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 707625 T2326 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 707626 T2326 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 707626 T2326 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 707626 T2326 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 707626 T2326 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 707627 T2326 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4] 2> 707629 T2326 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 707632 T2436 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320145890/repeater/collection1
[junit4:junit4] 2> 707632 T2436 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320145890/repeater/collection1/'
[junit4:junit4] 2> 707661 T2436 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 707687 T2436 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 707688 T2436 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 707690 T2436 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 707699 T2436 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 707700 T2436 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 707700 T2436 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320145890/repeater/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320145890/repeater/collection1/data/
[junit4:junit4] 2> 707701 T2436 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4:junit4] 2> 707701 T2436 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320145890/repeater/collection1/data
[junit4:junit4] 2> 707701 T2436 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320145890/repeater/collection1/data/index/
[junit4:junit4] 2> 707701 T2436 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320145890/repeater/collection1/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 707702 T2436 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320145890/repeater/collection1/data/index
[junit4:junit4] 2> 707703 T2436 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@74fdbf lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@350323),segFN=segments_1,generation=1}
[junit4:junit4] 2> 707703 T2436 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 707705 T2436 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 707705 T2436 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 707705 T2436 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 707706 T2436 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 707706 T2436 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 707706 T2436 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 707707 T2436 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 707709 T2436 oass.SolrIndexSearcher.<init> Opening Searcher@bdf053 main
[junit4:junit4] 2> 707709 T2436 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 707710 T2436 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 707710 T2436 oash.SnapPuller.<init> WARN 'masterUrl' must be specified without the /replication suffix
[junit4:junit4] 2> 707710 T2436 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 707710 T2436 oash.ReplicationHandler.inform Replication enabled for following config files: schema.xml
[junit4:junit4] 2> 707710 T2436 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 707711 T2436 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 707711 T2437 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@bdf053 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 707711 T2326 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 707712 T2326 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 707712 T2326 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C2281 name=collection1 org.apache.solr.core.SolrCore@1b9dcb3
[junit4:junit4] 2> 707721 T2397 C2281 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1497b04 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@14ead15),segFN=segments_1,generation=1}
[junit4:junit4] 2> 707721 T2397 C2281 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 707722 T2397 C2281 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[0]} 0 4
[junit4:junit4] 2> 707724 T2398 C2281 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[1]} 0 0
[junit4:junit4] 2> 707726 T2395 C2281 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[2]} 0 0
[junit4:junit4] 2> 707728 T2396 C2281 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 707730 T2396 C2281 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1497b04 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@14ead15),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1497b04 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@14ead15),segFN=segments_2,generation=2}
[junit4:junit4] 2> 707730 T2396 C2281 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 707731 T2396 C2281 oass.SolrIndexSearcher.<init> Opening Searcher@10171e main
[junit4:junit4] 2> 707731 T2396 C2281 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 707731 T2400 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@10171e main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):C3)}
[junit4:junit4] 2> 707732 T2396 C2281 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 4
[junit4:junit4] 2> 707737 T2439 oash.SnapPuller.<init> WARN 'masterUrl' must be specified without the /replication suffix
[junit4:junit4] 2> 707737 T2439 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 707738 T2397 C2281 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4] 2> 707739 T2439 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 707739 T2439 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 707739 T2439 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 707741 T2398 C2281 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 707742 T2439 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 10
[junit4:junit4] 2> 707742 T2439 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320145890/repeater/collection1/data/index.20130627080226063
[junit4:junit4] 2> 707743 T2439 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@ac88fb lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@18e381a) fullCopy=false
[junit4:junit4] 2> 707745 T2395 C2281 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_0.fnm&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 707748 T2396 C2281 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_0_Lucene41_0.doc&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 707751 T2397 C2281 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_0.nvd&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 707754 T2398 C2281 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 707757 T2395 C2281 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_0.fdx&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 707760 T2396 C2281 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_0.nvm&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 707762 T2397 C2281 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_0.si&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 707765 T2398 C2281 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_0_Lucene41_0.tim&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 707767 T2396 C2281 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_0_Lucene41_0.tip&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 707770 T2397 C2281 oasc.SolrCore.execute [coll
[...truncated too long message...]
509 T2326 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=11408326
[junit4:junit4] 2> 768510 T2949 oahic.DefaultRequestDirector.tryExecute I/O exception (org.apache.http.NoHttpResponseException) caught when processing request: The target server failed to respond
[junit4:junit4] 2> 768510 T2326 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@1e1e779
[junit4:junit4] 2> 768510 T2949 oahic.DefaultRequestDirector.tryExecute Retrying request
[junit4:junit4] 2> 768510 T2326 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=492,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 768511 T2949 oash.SnapPuller.fetchLatestIndex ERROR Master at: http://127.0.0.1:47532/solr is not available. Index fetch failed. Exception: org.apache.solr.client.solrj.SolrServerException: Server refused connection at: http://127.0.0.1:47532/solr
[junit4:junit4] 2> 768511 T2326 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 768512 T2326 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 768512 T2326 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 768513 T2326 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 768513 T2326 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 768514 T2326 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320205228/master/collection1/data/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320205228/master/collection1/data/index;done=false>>]
[junit4:junit4] 2> 768514 T2326 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320205228/master/collection1/data/index
[junit4:junit4] 2> 768515 T2326 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320205228/master/collection1/data [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320205228/master/collection1/data;done=false>>]
[junit4:junit4] 2> 768515 T2326 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320205228/master/collection1/data
[junit4:junit4] 2> 768516 T2326 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4:junit4] 2> 768588 T2326 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=22551353
[junit4:junit4] 2> 768589 T2326 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@14968b0
[junit4:junit4] 2> 768590 T2326 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=5,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=5,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 768590 T2326 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 768591 T2326 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 768592 T2326 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 768593 T2326 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 768594 T2326 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 768595 T2326 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320205450/slave/collection1/data/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320205450/slave/collection1/data/index;done=false>>]
[junit4:junit4] 2> 768595 T2326 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320205450/slave/collection1/data/index
[junit4:junit4] 2> 768596 T2326 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320205450/slave/collection1/data [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320205450/slave/collection1/data;done=false>>]
[junit4:junit4] 2> 768597 T2326 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1372320205450/slave/collection1/data
[junit4:junit4] 2> 768598 T2326 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4:junit4] 2> 768656 T2326 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> NOTE: test params are: codec=FastDecompressionCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST_DECOMPRESSION, chunkSize=492), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST_DECOMPRESSION, chunkSize=492)), sim=DefaultSimilarity, locale=ar_TN, timezone=Africa/Dakar
[junit4:junit4] 2> NOTE: Linux 3.2.0-48-generic i386/Oracle Corporation 1.7.0_25 (32-bit)/cpus=8,threads=1,free=92416552,total=425725952
[junit4:junit4] 2> NOTE: All tests run in this JVM: [FileBasedSpellCheckerTest, SpatialFilterTest, UUIDFieldTest, TestManagedSchemaFieldResource, DocumentBuilderTest, LegacyHTMLStripCharFilterTest, ZkCLITest, TestPseudoReturnFields, RecoveryZkTest, TestCopyFieldCollectionResource, FieldMutatingUpdateProcessorTest, PeerSyncTest, TestQuerySenderListener, ResponseLogComponentTest, TestExtendedDismaxParser, TestDocumentBuilder, TestSolrXml, TestSolrDeletionPolicy2, BasicFunctionalityTest, TestSolrDeletionPolicy1, TestTrie, SynonymTokenizerTest, PrimUtilsTest, CircularListTest, TermVectorComponentTest, JsonLoaderTest, RegexBoostProcessorTest, TestSolrQueryParserDefaultOperatorResource, ParsingFieldUpdateProcessorsTest, TestShardHandlerFactory, TestFieldTypeResource, UpdateRequestProcessorFactoryTest, TestLRUCache, SystemInfoHandlerTest, TestStressRecovery, SolrIndexSplitterTest, ClusterStateUpdateTest, ReturnFieldsTest, DistributedTermsComponentTest, SuggesterTest, TestSort, ChaosMonkeyNothingIsSafeTest, TestSearchPerf, TestFieldTypeCollectionResource, PreAnalyzedUpdateProcessorTest, AssignTest, DirectUpdateHandlerOptimizeTest, OverseerCollectionProcessorTest, PluginInfoTest, TestRandomDVFaceting, AliasIntegrationTest, SchemaVersionSpecificBehaviorTest, MBeansHandlerTest, TestValueSourceCache, AnalysisAfterCoreReloadTest, TestXIncludeConfig, SuggesterFSTTest, SolrCoreTest, MinimalSchemaTest, TestDynamicFieldResource, TestPHPSerializedResponseWriter, SoftAutoCommitTest, TestSerializedLuceneMatchVersion, BasicHdfsTest, TestDynamicFieldCollectionResource, AutoCommitTest, ShowFileRequestHandlerTest, TestCoreContainer, QueryElevationComponentTest, BlockCacheTest, CacheHeaderTest, WordBreakSolrSpellCheckerTest, TestFastWriter, TestPropInjectDefaults, CoreAdminHandlerTest, BasicDistributedZkTest, BasicDistributedZk2Test, SyncSliceTest, OpenCloseCoreStressTest, LeaderElectionIntegrationTest, TestReplicationHandler]
[junit4:junit4] Completed on J0 in 65.30s, 13 tests, 1 failure <<< FAILURES!
[...truncated 463 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:386: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:366: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:190: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:443: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1243: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:887: There were test failures: 312 suites, 1315 tests, 1 failure, 21 ignored (14 assumptions)
Total time: 38 minutes 26 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.7.0_25 -server -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
RE: [JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.7.0_25) - Build # 6330 - Still Failing!
Posted by Uwe Schindler <uw...@thetaphi.de>.
I fixed this.
-----
Uwe Schindler
H.-H.-Meier-Allee 63, D-28213 Bremen
http://www.thetaphi.de
eMail: uwe@thetaphi.de
> -----Original Message-----
> From: Policeman Jenkins Server [mailto:jenkins@thetaphi.de]
> Sent: Thursday, June 27, 2013 8:46 AM
> To: dev@lucene.apache.org
> Subject: [JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.7.0_25) - Build # 6330
> - Still Failing!
>
> Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/6330/
> Java: 32bit/jdk1.7.0_25 -server -XX:+UseSerialGC
>
> All tests passed
>
> Build Log:
> [...truncated 31099 lines...]
> BUILD FAILED
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:386: The
> following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:325: The
> following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-
> targets.xml:120: The following files are missing svn:eol-style (or binary
> svn:mime-type):
> * dev-tools/idea/.idea/libraries/Solr_test_framework_library.xml
>
> Total time: 43 minutes 59 seconds
> Build step 'Invoke Ant' marked build as failure Description set: Java:
> 32bit/jdk1.7.0_25 -server -XX:+UseSerialGC Archiving artifacts Recording test
> results Email was triggered for: Failure Sending email for trigger: Failure
>
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.7.0_25) - Build #
6330 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/6330/
Java: 32bit/jdk1.7.0_25 -server -XX:+UseSerialGC
All tests passed
Build Log:
[...truncated 31099 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:386: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:325: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:120: The following files are missing svn:eol-style (or binary svn:mime-type):
* dev-tools/idea/.idea/libraries/Solr_test_framework_library.xml
Total time: 43 minutes 59 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.7.0_25 -server -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.7.0_25) - Build #
6329 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/6329/
Java: 64bit/jdk1.7.0_25 -XX:-UseCompressedOops -XX:+UseSerialGC
All tests passed
Build Log:
[...truncated 34342 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:386: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:325: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:120: The following files are missing svn:eol-style (or binary svn:mime-type):
* dev-tools/idea/.idea/libraries/Solr_test_framework_library.xml
Total time: 49 minutes 17 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0_25 -XX:-UseCompressedOops -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.7.0_25) - Build #
6328 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/6328/
Java: 64bit/jdk1.7.0_25 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC
2 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.ShardSplitTest
Error Message:
1 thread leaked from SUITE scope at org.apache.solr.cloud.ShardSplitTest: 1) Thread[id=6021, name=IPC Parameter Sending Thread #4, state=TIMED_WAITING, group=TGRP-HdfsBasicDistributedZk2Test] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.ShardSplitTest:
1) Thread[id=6021, name=IPC Parameter Sending Thread #4, state=TIMED_WAITING, group=TGRP-HdfsBasicDistributedZk2Test]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
at __randomizedtesting.SeedInfo.seed([D1E748F718300E16]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.ShardSplitTest
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=6021, name=IPC Parameter Sending Thread #4, state=TIMED_WAITING, group=TGRP-HdfsBasicDistributedZk2Test] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=6021, name=IPC Parameter Sending Thread #4, state=TIMED_WAITING, group=TGRP-HdfsBasicDistributedZk2Test]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
at __randomizedtesting.SeedInfo.seed([D1E748F718300E16]:0)
Build Log:
[...truncated 10137 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.ShardSplitTest
[junit4:junit4] 2> 1086257 T5897 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /ukvke/l
[junit4:junit4] 2> 1086277 T5897 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-ShardSplitTest-1372303786409
[junit4:junit4] 2> 1086278 T5897 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 1086278 T5898 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 1086378 T5897 oasc.ZkTestServer.run start zk server on port:32999
[junit4:junit4] 2> 1086379 T5897 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1086383 T5904 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1df14431 name:ZooKeeperConnection Watcher:127.0.0.1:32999 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1086383 T5897 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1086384 T5897 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 1086387 T5897 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1086388 T5906 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@28ec0e77 name:ZooKeeperConnection Watcher:127.0.0.1:32999/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1086388 T5897 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1086389 T5897 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 1086391 T5897 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 1086393 T5897 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 1086395 T5897 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 1086397 T5897 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 1086397 T5897 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 1086400 T5897 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 1086401 T5897 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 1086404 T5897 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 1086404 T5897 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 1086406 T5897 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 1086407 T5897 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 1086409 T5897 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 1086409 T5897 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 1086411 T5897 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 1086412 T5897 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 1086414 T5897 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 1086414 T5897 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 1086416 T5897 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 1086417 T5897 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 1086419 T5897 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 1086420 T5897 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 1086506 T5897 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1086516 T5897 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:42978
[junit4:junit4] 2> 1086516 T5897 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1086517 T5897 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1086517 T5897 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1372303786553
[junit4:junit4] 2> 1086517 T5897 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1372303786553/solr.xml
[junit4:junit4] 2> 1086518 T5897 oasc.CoreContainer.<init> New CoreContainer 1605779132
[junit4:junit4] 2> 1086518 T5897 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1372303786553/'
[junit4:junit4] 2> 1086518 T5897 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1372303786553/'
[junit4:junit4] 2> 1086558 T5897 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1086558 T5897 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1086558 T5897 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1086559 T5897 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1086559 T5897 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1086559 T5897 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1086559 T5897 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1086560 T5897 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1086560 T5897 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1086560 T5897 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1086571 T5897 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1086572 T5897 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:32999/solr
[junit4:junit4] 2> 1086572 T5897 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1086573 T5897 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1086575 T5917 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@140fa2ee name:ZooKeeperConnection Watcher:127.0.0.1:32999 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1086576 T5897 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1086577 T5897 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1086580 T5897 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1086581 T5919 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@251469a3 name:ZooKeeperConnection Watcher:127.0.0.1:32999/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1086581 T5897 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1086582 T5897 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 1086584 T5897 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 1086586 T5897 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 1086587 T5897 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42978_ukvke%2Fl
[junit4:junit4] 2> 1086588 T5897 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:42978_ukvke%2Fl
[junit4:junit4] 2> 1086590 T5897 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 1086596 T5897 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 1086597 T5897 oasc.Overseer.start Overseer (id=89935300946231299-127.0.0.1:42978_ukvke%2Fl-n_0000000000) starting
[junit4:junit4] 2> 1086599 T5897 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 1086602 T5921 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 1086602 T5897 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 1086604 T5897 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 1086607 T5897 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1086611 T5920 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 1086613 T5922 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1086613 T5922 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1086615 T5922 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4:junit4] 2> 1088114 T5920 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1088114 T5920 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"core_node1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:42978_ukvke%2Fl",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:42978/ukvke/l"}
[junit4:junit4] 2> 1088115 T5920 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 1088115 T5920 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 1088118 T5919 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1088615 T5922 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4:junit4] 2> 1088616 T5922 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1372303786553/collection1
[junit4:junit4] 2> 1088616 T5922 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 1088617 T5922 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1088617 T5922 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 1088618 T5922 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1372303786553/collection1/'
[junit4:junit4] 2> 1088618 T5922 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-controljetty-1372303786553/collection1/lib/README' to classloader
[junit4:junit4] 2> 1088619 T5922 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-controljetty-1372303786553/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1088641 T5922 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 1088667 T5922 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1088669 T5922 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1088671 T5922 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1088950 T5922 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1088952 T5922 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1088955 T5922 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1088958 T5922 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1088973 T5922 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1088973 T5922 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1372303786553/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1372303786409/control/data/
[junit4:junit4] 2> 1088974 T5922 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2983b534
[junit4:junit4] 2> 1088974 T5922 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1372303786409/control/data
[junit4:junit4] 2> 1088974 T5922 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1372303786409/control/data/index/
[junit4:junit4] 2> 1088975 T5922 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1372303786409/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1088975 T5922 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1372303786409/control/data/index
[junit4:junit4] 2> 1088976 T5922 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@69ce7c8 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3bb2039f),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1088976 T5922 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1088978 T5922 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1088978 T5922 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1088979 T5922 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1088979 T5922 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1088979 T5922 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1088980 T5922 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1088980 T5922 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1088980 T5922 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1088980 T5922 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1088983 T5922 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1088985 T5922 oass.SolrIndexSearcher.<init> Opening Searcher@3af53df7 main
[junit4:junit4] 2> 1088985 T5922 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1088986 T5922 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1088989 T5923 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3af53df7 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1088991 T5922 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1088991 T5922 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:42978/ukvke/l collection:control_collection shard:shard1
[junit4:junit4] 2> 1088992 T5922 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 1088997 T5922 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4:junit4] 2> 1088998 T5922 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 1088999 T5922 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 1088999 T5922 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:42978/ukvke/l/collection1/
[junit4:junit4] 2> 1088999 T5922 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 1088999 T5922 oasc.SyncStrategy.syncToMe http://127.0.0.1:42978/ukvke/l/collection1/ has no replicas
[junit4:junit4] 2> 1089000 T5922 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:42978/ukvke/l/collection1/ shard1
[junit4:junit4] 2> 1089000 T5922 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 1089621 T5920 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1089626 T5919 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1089655 T5922 oasc.ZkController.register We are http://127.0.0.1:42978/ukvke/l/collection1/ and leader is http://127.0.0.1:42978/ukvke/l/collection1/
[junit4:junit4] 2> 1089655 T5922 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:42978/ukvke/l
[junit4:junit4] 2> 1089655 T5922 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 1089655 T5922 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1089656 T5922 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1089657 T5922 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1089658 T5897 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 1089658 T5897 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1089659 T5897 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1089661 T5897 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 1089662 T5897 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1089664 T5926 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7632371e name:ZooKeeperConnection Watcher:127.0.0.1:32999/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1089664 T5897 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1089665 T5897 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1089666 T5897 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 1089720 T5897 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1089722 T5897 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:47055
[junit4:junit4] 2> 1089724 T5897 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1089724 T5897 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1089724 T5897 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1372303789797
[junit4:junit4] 2> 1089725 T5897 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1372303789797/solr.xml
[junit4:junit4] 2> 1089725 T5897 oasc.CoreContainer.<init> New CoreContainer 1135124571
[junit4:junit4] 2> 1089725 T5897 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1372303789797/'
[junit4:junit4] 2> 1089725 T5897 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1372303789797/'
[junit4:junit4] 2> 1089764 T5897 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1089765 T5897 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1089765 T5897 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1089765 T5897 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1089766 T5897 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1089766 T5897 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1089766 T5897 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1089766 T5897 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1089767 T5897 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1089767 T5897 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1089770 T5897 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1089770 T5897 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:32999/solr
[junit4:junit4] 2> 1089770 T5897 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1089772 T5897 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1089773 T5937 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@75d848f5 name:ZooKeeperConnection Watcher:127.0.0.1:32999 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1089774 T5897 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1089775 T5897 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1089778 T5897 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1089779 T5939 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@fcb8c0a name:ZooKeeperConnection Watcher:127.0.0.1:32999/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1089779 T5897 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1089781 T5897 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1090784 T5897 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47055_ukvke%2Fl
[junit4:junit4] 2> 1090785 T5897 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:47055_ukvke%2Fl
[junit4:junit4] 2> 1090786 T5919 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1090786 T5939 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1090786 T5926 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1090787 T5919 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1090790 T5940 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1090790 T5940 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1090791 T5940 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4:junit4] 2> 1091130 T5920 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1091131 T5920 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"core_node1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:42978_ukvke%2Fl",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:42978/ukvke/l"}
[junit4:junit4] 2> 1091134 T5920 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"core_node1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:47055_ukvke%2Fl",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:47055/ukvke/l"}
[junit4:junit4] 2> 1091134 T5920 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 1091134 T5920 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 1091137 T5926 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1091137 T5939 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1091137 T5919 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1091792 T5940 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4:junit4] 2> 1091792 T5940 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1372303789797/collection1
[junit4:junit4] 2> 1091792 T5940 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1091793 T5940 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1091793 T5940 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1091794 T5940 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1372303789797/collection1/'
[junit4:junit4] 2> 1091794 T5940 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty1-1372303789797/collection1/lib/README' to classloader
[junit4:junit4] 2> 1091795 T5940 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty1-1372303789797/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1091827 T5940 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 1091856 T5940 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1091857 T5940 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1091860 T5940 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1092162 T5940 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1092164 T5940 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1092165 T5940 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1092168 T5940 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1092184 T5940 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1092185 T5940 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1372303789797/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1372303786409/jetty1/
[junit4:junit4] 2> 1092185 T5940 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2983b534
[junit4:junit4] 2> 1092186 T5940 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1372303786409/jetty1
[junit4:junit4] 2> 1092186 T5940 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1372303786409/jetty1/index/
[junit4:junit4] 2> 1092186 T5940 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1372303786409/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1092187 T5940 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1372303786409/jetty1/index
[junit4:junit4] 2> 1092188 T5940 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@71b3b383 lockFactory=org.apache.lucene.store.NativeFSLockFactory@667e1d22),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1092189 T5940 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1092191 T5940 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1092191 T5940 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1092192 T5940 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1092193 T5940 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1092193 T5940 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1092193 T5940 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1092193 T5940 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1092194 T5940 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1092194 T5940 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1092196 T5940 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1092198 T5940 oass.SolrIndexSearcher.<init> Opening Searcher@3f6ae1b2 main
[junit4:junit4] 2> 1092199 T5940 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1092199 T5940 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1092204 T5941 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3f6ae1b2 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1092207 T5940 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1092207 T5940 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:47055/ukvke/l collection:collection1 shard:shard1
[junit4:junit4] 2> 1092208 T5940 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 1092215 T5940 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4:junit4] 2> 1092217 T5940 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 1092222 T5940 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 1092222 T5940 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:47055/ukvke/l/collection1/
[junit4:junit4] 2> 1092222 T5940 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 1092222 T5940 oasc.SyncStrategy.syncToMe http://127.0.0.1:47055/ukvke/l/collection1/ has no replicas
[junit4:junit4] 2> 1092223 T5940 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:47055/ukvke/l/collection1/ shard1
[junit4:junit4] 2> 1092223 T5940 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 1092641 T5920 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1092646 T5919 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1092646 T5926 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1092646 T5939 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1092678 T5940 oasc.ZkController.register We are http://127.0.0.1:47055/ukvke/l/collection1/ and leader is http://127.0.0.1:47055/ukvke/l/collection1/
[junit4:junit4] 2> 1092678 T5940 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:47055/ukvke/l
[junit4:junit4] 2> 1092679 T5940 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 1092679 T5940 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1092679 T5940 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1092680 T5940 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1092681 T5897 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 1092681 T5897 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1092682 T5897 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1092758 T5897 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1092759 T5897 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:44490
[junit4:junit4] 2> 1092761 T5897 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1092761 T5897 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1092761 T5897 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1372303792815
[junit4:junit4] 2> 1092762 T5897 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1372303792815/solr.xml
[junit4:junit4] 2> 1092762 T5897 oasc.CoreContainer.<init> New CoreContainer 543802503
[junit4:junit4] 2> 1092762 T5897 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1372303792815/'
[junit4:junit4] 2> 1092763 T5897 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1372303792815/'
[junit4:junit4] 2> 1092801 T5897 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1092802 T5897 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1092802 T5897 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1092802 T5897 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1092802 T5897 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1092803 T5897 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1092803 T5897 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1092803 T5897 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1092803 T5897 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1092804 T5897 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1092807 T5897 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1092807 T5897 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:32999/solr
[junit4:junit4] 2> 1092807 T5897 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1092808 T5897 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1092810 T5953 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5b96af61 name:ZooKeeperConnection Watcher:127.0.0.1:32999 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1092810 T5897 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1092812 T5897 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1092815 T5897 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1092816 T5955 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5eb18ec8 name:ZooKeeperConnection Watcher:127.0.0.1:32999/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1092816 T5897 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1092819 T5897 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1093821 T5897 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44490_ukvke%2Fl
[junit4:junit4] 2> 1093822 T5897 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:44490_ukvke%2Fl
[junit4:junit4] 2> 1093824 T5926 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1093824 T5919 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1093824 T5955 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1093824 T5939 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1093825 T5926 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1093826 T5919 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1093826 T5939 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1093829 T5956 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1093829 T5956 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1093830 T5956 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4:junit4] 2> 1094151 T5920 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1094151 T5920 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"core_node1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:47055_ukvke%2Fl",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:47055/ukvke/l"}
[junit4:junit4] 2> 1094153 T5920 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"core_node2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:44490_ukvke%2Fl",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:44490/ukvke/l"}
[junit4:junit4] 2> 1094154 T5920 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 1094154 T5920 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4] 2> 1094156 T5919 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1094156 T5955 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1094156 T5939 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1094156 T5926 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1094830 T5956 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4:junit4] 2> 1094831 T5956 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1372303792815/collection1
[junit4:junit4] 2> 1094831 T5956 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1094832 T5956 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1094832 T5956 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1094833 T5956 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1372303792815/collection1/'
[junit4:junit4] 2> 1094834 T5956 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty2-1372303792815/collection1/lib/README' to classloader
[junit4:junit4] 2> 1094834 T5956 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty2-1372303792815/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1094869 T5956 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 1094909 T5956 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1094910 T5956 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1094913 T5956 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1095198 T5956 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1095201 T5956 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1095202 T5956 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1095205 T5956 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1095220 T5956 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1095220 T5956 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1372303792815/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1372303786409/jetty2/
[junit4:junit4] 2> 1095221 T5956 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2983b534
[junit4:junit4] 2> 1095221 T5956 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1372303786409/jetty2
[junit4:junit4] 2> 1095221 T5956 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1372303786409/jetty2/index/
[junit4:junit4] 2> 1095221 T5956 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1372303786409/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1095222 T5956 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1372303786409/jetty2/index
[junit4:junit4] 2> 1095223 T5956 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@481b58f lockFactory=org.apache.lucene.store.NativeFSLockFactory@648fb9e9),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1095224 T5956 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1095225 T5956 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1095226 T5956 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1095226 T5956 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1095227 T5956 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1095227 T5956 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1095227 T5956 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1095227 T5956 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1095228 T5956 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1095228 T5956 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1095230 T5956 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1095232 T5956 oass.SolrIndexSearcher.<init> Opening Searcher@24f477bf main
[junit4:junit4] 2> 1095233 T5956 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1095233 T5956 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1095238 T5957 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@24f477bf main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1095241 T5956 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1095241 T5956 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:44490/ukvke/l collection:collection1 shard:shard2
[junit4:junit4] 2> 1095242 T5956 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 1095247 T5956 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4:junit4] 2> 1095249 T5956 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 1095249 T5956 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 1095249 T5956 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:44490/ukvke/l/collection1/
[junit4:junit4] 2> 1095250 T5956 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 1095250 T5956 oasc.SyncStrategy.syncToMe http://127.0.0.1:44490/ukvke/l/collection1/ has no replicas
[junit4:junit4] 2> 1095250 T5956 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:44490/ukvke/l/collection1/ shard2
[junit4:junit4] 2> 1095250 T5956 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 1095660 T5920 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1095666 T5926 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1095666 T5939 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1095666 T5919 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1095666 T5955 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1095706 T5956 oasc.ZkController.register We are http://127.0.0.1:44490/ukvke/l/collection1/ and leader is http://127.0.0.1:44490/ukvke/l/collection1/
[junit4:junit4] 2> 1095706 T5956 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:44490/ukvke/l
[junit4:junit4] 2> 1095707 T5956 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 1095707 T5956 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1095707 T5956 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1095708 T5956 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1095710 T5897 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 1095710 T5897 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1095710 T5897 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1095767 T5897 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1095769 T5897 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:47177
[junit4:junit4] 2> 1095771 T5897 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1095771 T5897 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1095771 T5897 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1372303795844
[junit4:junit4] 2> 1095772 T5897 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1372303795844/solr.xml
[junit4:junit4] 2> 1095772 T5897 oasc.CoreContainer.<init> New CoreContainer 446863900
[junit4:junit4] 2> 1095772 T5897 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1372303795844/'
[junit4:junit4] 2> 1095772 T5897 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1372303795844/'
[junit4:junit4] 2> 1095810 T5897 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1095811 T5897 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1095811 T5897 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1095811 T5897 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1095812 T5897 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1095812 T5897 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1095812 T5897 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1095812 T5897 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1095813 T5897 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1095813 T5897 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1095815 T5897 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1095816 T5897 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:32999/solr
[junit4:junit4] 2> 1095816 T5897 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1095817 T5897 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1095818 T5969 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5e427d3c name:ZooKeeperConnection Watcher:127.0.0.1:32999 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1095819 T5897 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1095820 T5897 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1095823 T5897 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1095824 T5971 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@33736a56 name:ZooKeeperConnection Watcher:127.0.0.1:32999/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1095825 T5897 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1095827 T5897 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1096829 T5897 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47177_ukvke%2Fl
[junit4:junit4] 2> 1096830 T5897 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:47177_ukvke%2Fl
[junit4:junit4] 2> 1096832 T5926 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1096832 T5955 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1096832 T5971 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1096832 T5939 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1096832 T5919 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1096833 T5926 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1096834 T5955 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1096834 T5939 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1096835 T5919 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1096837 T5972 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1096837 T5972 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1096838 T5972 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4:junit4] 2> 1097170 T5920 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1097170 T5920 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"core_node2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:44490_ukvke%2Fl",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:44490/ukvke/l"}
[junit4:junit4] 2> 1097174 T5920 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"core_node3",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:47177_ukvke%2Fl",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:47177/ukvke/l"}
[junit4:junit4] 2> 1097174 T5920 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 1097174 T5920 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 1097176 T5926 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1097176 T5939 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1097176 T5955 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1097176 T5971 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1097176 T5919 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1097838 T5972 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4:junit4] 2> 1097839 T5972 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1372303795844/collection1
[junit4:junit4] 2> 1097839 T5972 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1097840 T5972 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1097840 T5972 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1097841 T5972 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1372303795844/collection1/'
[junit4:junit4] 2> 1097842 T5972 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty3-1372303795844/collection1/lib/README' to classloader
[junit4:junit4] 2> 1097842 T5972 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty3-1372303795844/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1097867 T5972 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 1097905 T5972 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1097906 T5972 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1097909 T5972 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1098166 T5972 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1098168 T5972 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1098169 T5972 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1098172 T5972 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1098185 T5972 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1098185 T5972 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1372303795844/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1372303786409/jetty3/
[junit4:junit4] 2> 1098186 T5972 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2983b534
[junit4:junit4] 2> 1098186 T5972 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1372303786409/jetty3
[junit4:junit4] 2> 1098186 T5972 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1372303786409/jetty3/index/
[junit4:junit4] 2> 1098187 T5972 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1372303786409/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1098187 T5972 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1372303786409/jetty3/index
[junit4:junit4] 2> 1098188 T5972 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7a3e11b9 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3a2248ec),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1098189 T5972 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1098190 T5972 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1098191 T5972 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1098191 T5972 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1098192 T5972 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1098192 T5972 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1098192 T5972 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1098192 T5972 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1098193 T5972 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1098193 T5972 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1098195 T5972 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1098197 T5972 oass.SolrIndexSearcher.<init> Opening Searcher@743555b2 main
[junit4:junit4] 2> 1098198 T5972 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1098198 T5972 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1098201 T5973 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@743555b2 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1098203 T5972 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1098203 T5972 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:47177/ukvke/l collection:collection1 shard:shard1
[junit4:junit4] 2> 1098205 T5972 oasc.ZkController.register We are http://127.0.0.1:47177/ukvke/l/collection1/ and leader is http://127.0.0.1:47055/ukvke/l/collection1/
[junit4:junit4] 2> 1098205 T5972 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:47177/ukvke/l
[junit4:junit4] 2> 1098205 T5972 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 1098205 T5972 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C1903 name=collection1 org.apache.solr.core.SolrCore@59100dc6 url=http://127.0.0.1:47177/ukvke/l/collection1 node=127.0.0.1:47177_ukvke%2Fl C1903_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, node_name=127.0.0.1:47177_ukvke%2Fl, base_url=http://127.0.0.1:47177/ukvke/l}
[junit4:junit4] 2> 1098205 T5974 C1903 P47177 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 1098206 T5972 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1098206 T5974 C1903 P47177 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 1098206 T5974 C1903 P47177 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 1098207 T5974 C1903 P47177 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1098207 T5897 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 1098207 T5897 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1098207 T5974 C1903 P47177 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1098208 T5897 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1098212 T5932 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: core_node3, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 1098289 T5897 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1098292 T5897 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:53107
[junit4:junit4] 2> 1098293 T5897 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1098293 T5897 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1098293 T5897 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1372303798342
[junit4:junit4] 2> 1098294 T5897 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1372303798342/solr.xml
[junit4:junit4] 2> 1098294 T5897 oasc.CoreContainer.<init> New CoreContainer 343371293
[junit4:junit4] 2> 1098294 T5897 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1372303798342/'
[junit4:junit4] 2> 1098295 T5897 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1372303798342/'
[junit4:junit4] 2> 1098344 T5897 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1098344 T5897 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1098345 T5897 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1098345 T5897 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1098345 T5897 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1098346 T5897 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1098346 T5897 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1098346 T5897 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1098346 T5897 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1098347 T5897 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1098350 T5897 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1098351 T5897 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:32999/solr
[junit4:junit4] 2> 1098351 T5897 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1098352 T5897 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1098353 T5986 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1fe1da8f name:ZooKeeperConnection Watcher:127.0.0.1:32999 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1098354 T5897 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1098355 T5897 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1098358 T5897 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1098360 T5988 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@510a7bff name:ZooKeeperConnection Watcher:127.0.0.1:32999/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1098360 T5897 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1098362 T5897 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1098681 T5920 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1098681 T5920 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"core_node3",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:47177_ukvke%2Fl",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:47177/ukvke/l"}
[junit4:junit4] 2> 1098685 T5939 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1098685 T5955 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1098685 T5971 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1098685 T5988 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1098685 T5919 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1098685 T5926 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1099212 T5932 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: core_node3, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 1099213 T5932 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=core_node3&state=recovering&nodeName=127.0.0.1:47177_ukvke%252Fl&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1001
[junit4:junit4] 2> 1099364 T5897 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53107_ukvke%2Fl
[junit4:junit4] 2> 1099366 T5897 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53107_ukvke%2Fl
[junit4:junit4] 2> 1099368 T5926 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1099368 T5939 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1099368 T5919 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1099369 T5971 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1099368 T5955 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1099369 T5971 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1099369 T5988 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1099370 T5988 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1099370 T5939 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1099371 T5926 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1099371 T5955 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1099371 T5919 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1099374 T5989 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1099374 T5989 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1099375 T5989 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4:junit4] 2> 1100189 T5920 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1100190 T5920 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"core_node4",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:53107_ukvke%2Fl",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:53107/ukvke/l"}
[junit4:junit4] 2> 1100190 T5920 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 1100190 T5920 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4] 2> 1100193 T5926 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1100193 T5919 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1100193 T5955 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1100193 T5971 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1100193 T5988 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1100193 T5939 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1100375 T5989 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4:junit4] 2> 1100376 T5989 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1372303798342/collection1
[junit4:junit4] 2> 1100376 T5989 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1100377 T5989 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1100377 T5989 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1100378 T5989 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1372303798342/collection1/'
[junit4:junit4] 2> 1100379 T5989 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty4-1372303798342/collection1/lib/README' to classloader
[junit4:junit4] 2> 1100379 T5989 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty4-1372303798342/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1100408 T5989 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 1100442 T5989 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1100443 T5989 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1100447 T5989 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1100751 T5989 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1100753 T5989 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1100755 T5989 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1100758 T5989 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1100771 T5989 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1100771 T5989 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1372303798342/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1372303786409/jetty4/
[junit4:junit4] 2> 1100771 T5989 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2983b534
[junit4:junit4] 2> 1100772 T5989 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1372303786409/jetty4
[junit4:junit4] 2> 1100772 T5989 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1372303786409/jetty4/index/
[junit4:junit4] 2> 1100772 T5989 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1372303786409/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1100773 T5989 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1372303786409/jetty4/index
[junit4:junit4] 2> 1100774 T5989 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7fba4f59 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6b5f12cc),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1100774 T5989 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1100776 T5989 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1100776 T5989 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1100777 T5989 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1100777 T5989 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1100778 T5989 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1100778 T5989 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1100778 T5989 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1100778 T5989 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1100779 T5989 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1100781 T5989 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1100783 T5989 oass.SolrIndexSearcher.<init> Opening Searcher@5daa0b05 main
[junit4:junit4] 2> 1100783 T5989 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1100784 T5989 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1100787 T5990 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5daa0b05 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1100789 T5989 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1100789 T5989 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:53107/ukvke/l collection:collection1 shard:shard2
[junit4:junit4] 2> 1100792 T5989 oasc.ZkController.register We are http://127.0.0.1:53107/ukvke/l/collection1/ and leader is http://127.0.0.1:44490/ukvke/l/collection1/
[junit4:junit4] 2> 1100792 T5989 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:53107/ukvke/l
[junit4:junit4] 2> 1100792 T5989 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 1100792 T5989 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C1904 name=collection1 org.apache.solr.core.SolrCore@1be4ccc2 url=http://127.0.0.1:53107/ukvke/l/collection1 node=127.0.0.1:53107_ukvke%2Fl C1904_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, node_name=127.0.0.1:53107_ukvke%2Fl, base_url=http://127.0.0.1:53107/ukvke/l}
[junit4:junit4] 2> 1100793 T5991 C1904 P53107 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 1100793 T5989 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1100793 T5991 C1904 P53107 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 1100794 T5991 C1904 P53107 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 1100794 T5991 C1904 P53107 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1100794 T5897 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 1100795 T5897 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1100795 T5991 C1904 P53107 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1100795 T5897 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1100799 T5897 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1100799 T5950 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: core_node4, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 1100799 T5897 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 2> 1100800 T5897 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 2> 1100801 T5897 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> ASYNC NEW_CORE C1905 name=collection1 org.apache.solr.core.SolrCore@59100dc6 url=http://127.0.0.1:47177/ukvke/l/collection1 node=127.0.0.1:47177_ukvke%2Fl C1905_STATE=coll:collection1 core:collection1 props:{state=recovering, core=collection1, node_name=127.0.0.1:47177_ukvke%2Fl, base_url=http://127.0.0.1:47177/ukvke/l}
[junit4:junit4] 2> 1101213 T5974 C1905 P47177 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:47055/ukvke/l/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 1101214 T5974 C1905 P47177 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:47177/ukvke/l START replicas=[http://127.0.0.1:47055/ukvke/l/collection1/] nUpdates=100
[junit4:junit4] 2> 1101214 T5974 C1905 P47177 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 1101215 T5974 C1905 P47177 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 1101215 T5974 C1905 P47177 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 1101215 T5974 C1905 P47177 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 1101216 T5974 C1905 P47177 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 1101216 T5974 C1905 P47177 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:47055/ukvke/l/collection1/. core=collection1
[junit4:junit4] 2> 1101216 T5974 C1905 P47177 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C1906 name=collection1 org.apache.solr.core.SolrCore@69c1b276 url=http://127.0.0.1:47055/ukvke/l/collection1 node=127.0.0.1:47055_ukvke%2Fl C1906_STATE=coll:collection1 core:collection1 props:{state=active, core=collection1, node_name=127.0.0.1:47055_ukvke%2Fl, base_url=http://127.0.0.1:47055/ukvke/l, leader=true}
[junit4:junit4] 2> 1101220 T5933 C1906 P47055 oasc.SolrCore.execute [collection1] webapp=/ukvke/l path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 1101224 T5932 C1906 P47055 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1101227 T5932 C1906 P47055 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@71b3b383 lockFactory=org.apache.lucene.store.NativeFSLockFactory@667e1d22),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1101227 T5932 C1906 P47055 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1101228 T5932 C1906 P47055 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4] 2> 1101228 T5932 C1906 P47055 oass.SolrIndexSearcher.<init> Opening Searcher@6b20698e realtime
[junit4:junit4] 2> 1101229 T5932 C1906 P47055 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1101229 T5932 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 5
[junit4:junit4] 2> 1101230 T5974 C1905 P47177 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1101230 T5974 C1905 P47177 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 1101232 T5934 C1906 P47055 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1101232 T5934 C1906 P47055 oasc.SolrCore.execute [collection1] webapp=/ukvke/l path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 1101232 T5974 C1905 P47177 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 1101233 T5974 C1905 P47177 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 1101233 T5974 C1905 P47177 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1101233 T5974 C1905 P47177 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1101234 T5974 C1905 P47177 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 1101696 T5920 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1101696 T5920 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"core_node4",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:53107_ukvke%2Fl",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:53107/ukvke/l"}
[junit4:junit4] 2> 1101698 T5920 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"core_node3",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:47177_ukvke%2Fl",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:47177/ukvke/l"}
[junit4:junit4] 2> 1101701 T5926 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1101701 T5939 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1101701 T5971 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1101701 T5955 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1101701 T5919 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1101701 T5988 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1101799 T5950 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: core_node4, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 1101800 T5950 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=core_node4&state=recovering&nodeName=127.0.0.1:53107_ukvke%252Fl&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1001
[junit4:junit4] 2> 1101802 T5897 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1102803 T5897 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C1904_STATE=coll:collection1 core:collection1 props:{state=recovering, core=collection1, node_name=127.0.0.1:53107_ukvke%2Fl, base_url=http://127.0.0.1:53107/ukvke/l}
[junit4:junit4] 2> 1103801 T5991 C1904 P53107 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:44490/ukvke/l/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 1103801 T5991 C1904 P53107 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:53107/ukvke/l START replicas=[http://127.0.0.1:44490/ukvke/l/collection1/] nUpdates=100
[junit4:junit4] 2> 1103801 T5991 C1904 P53107 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 1103802 T5991 C1904 P53107 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 1103802 T5991 C1904 P53107 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 1103802 T5991 C1904 P53107 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 1103802 T5991 C1904 P53107 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 1103802 T5991 C1904 P53107 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:44490/ukvke/l/collection1/. core=collection1
[junit4:junit4] 2> 1103802 T5991 C1904 P53107 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1103805 T5897 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> ASYNC NEW_CORE C1907 name=collection1 org.apache.solr.core.SolrCore@4a19342a url=http://127.0.0.1:44490/ukvke/l/collection1 node=127.0.0.1:44490_ukvke%2Fl C1907_STATE=coll:collection1 core:collection1 props:{state=active, core=collection1, node_name=127.0.0.1:44490_ukvke%2Fl, base_url=http://127.0.0.1:44490/ukvke/l, leader=true}
[junit4:junit4] 2> 1103807 T5950 C1907 P44490 oasc.SolrCore.execute [collection1] webapp=/ukvke/l path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 1103809 T5951 C1907 P44490 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1103811 T5951 C1907 P44490 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@481b58f lockFactory=org.apache.lucene.store.NativeFSLockFactory@648fb9e9),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1103812 T5951 C1907 P44490 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1103812 T5951 C1907 P44490 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4] 2> 1103812 T5951 C1907 P44490 oass.SolrIndexSearcher.<init> Opening Searcher@78ace04f realtime
[junit4:junit4] 2> 1103812 T5951 C1907 P44490 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1103813 T5951 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 4
[junit4:junit4] 2> 1103813 T5991 C1904 P53107 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1103814 T5991 C1904 P53107 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 1103815 T5949 C1907 P44490 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1103815 T5949 C1907 P44490 oasc.SolrCore.execute [collection1] webapp=/ukvke/l path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4] 2> 1103816 T5991 C1904 P53107 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 1103816 T5991 C1904 P53107 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 1103816 T5991 C1904 P53107 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1103816 T5991 C1904 P53107 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1103818 T5991 C1904 P53107 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 1104706 T5920 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1104707 T5920 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"core_node4",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:53107_ukvke%2Fl",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:53107/ukvke/l"}
[junit4:junit4] 2> 1104710 T5988 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1104710 T5955 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1104710 T5971 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1104710 T5926 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1104710 T5919 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1104710 T5939 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1104806 T5897 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1104807 T5897 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> ASYNC NEW_CORE C1908 name=collection1 org.apache.solr.core.SolrCore@11d34697 url=http://127.0.0.1:42978/ukvke/l/collection1 node=127.0.0.1:42978_ukvke%2Fl C1908_STATE=coll:control_collection core:collection1 props:{state=active, core=collection1, node_name=127.0.0.1:42978_ukvke%2Fl, base_url=http://127.0.0.1:42978/ukvke/l, leader=true}
[junit4:junit4] 2> 1104814 T5913 C1908 P42978 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1104817 T5913 C1908 P42978 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@69ce7c8 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3bb2039f),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1104817 T5913 C1908 P42978 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1104818 T5913 C1908 P42978 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4] 2> 1104819 T5913 C1908 P42978 oass.SolrIndexSearcher.<init> Opening Searcher@48a32bd6 main
[junit4:junit4] 2> 1104819 T5913 C1908 P42978 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1104820 T5923 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@48a32bd6 main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4:junit4] 2> 1104821 T5913 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 1104826 T5935 C1906 P47055 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:47055/ukvke/l/collection1/, StdNode: http://127.0.0.1:47177/ukvke/l/collection1/, StdNode: http://127.0.0.1:44490/ukvke/l/collection1/, StdNode: http://127.0.0.1:53107/ukvke/l/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 1104838 T5932 C1906 P47055 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1104839 T5932 C1906 P47055 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4] 2> 1104839 T5932 C1906 P47055 oass.SolrIndexSearcher.<init> Opening Searcher@110a4f64 main
[junit4:junit4] 2> 1104840 T5932 C1906 P47055 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1104841 T5941 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@110a4f64 main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4:junit4] 2> 1104842 T5932 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 4
[junit4:junit4] 2> 1104843 T5950 C1907 P44490 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1104843 T5950 C1907 P44490 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4] 2> C1905_STATE=coll:collection1 core:collection1 props:{state=active, core=collection1, node_name=127.0.0.1:47177_ukvke%2Fl, base_url=http://127.0.0.1:47177/ukvke/l}
[junit4:junit4] 2> 1104844 T5966 C1905 P47177 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1104844 T5950 C1907 P44490 oass.SolrIndexSearcher.<init> Opening Searcher@5134e555 main
[junit4:junit4] 2> 1104845 T5950 C1907 P44490 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1104847 T5957 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5134e555 main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4:junit4] 2> 1104847 T5950 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 5
[junit4:junit4] 2> C1904_STATE=coll:collection1 core:collection1 props:{state=active, core=collection1, node_name=127.0.0.1:53107_ukvke%2Fl, base_url=http://127.0.0.1:53107/ukvke/l}
[junit4:junit4] 2> 1104848 T5981 C1904 P53107 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1104847 T5966 C1905 P47177 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7a3e11b9 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3a2248ec),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1104849 T5966 C1905 P47177 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1104850 T5966 C1905 P47177 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4] 2> 1104850 T5981 C1904 P53107 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7fba4f59 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6b5f12cc),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1104850 T5966 C1905 P47177 oass.SolrIndexSearcher.<init> Opening Searcher@78ce356 main
[junit4:junit4] 2> 1104851 T5981 C1904 P53107 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1104851 T5966 C1905 P47177 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1104851 T5981 C1904 P53107 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4] 2> 1104852 T5973 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@78ce356 main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4:junit4] 2> 1104852 T5981 C1904 P53107 oass.SolrIndexSearcher.<init> Opening Searcher@1d54106d main
[junit4:junit4] 2> 1104853 T5966 C1905 P47177 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 9
[junit4:junit4] 2> 1104853 T5981 C1904 P53107 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1104854 T5990 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1d54106d main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4:junit4] 2> 1104854 T5981 C1904 P53107 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> 1104855 T5935 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 29
[junit4:junit4] 2> 1104855 T5897 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1104857 T5933 C1906 P47055 oasc.SolrCore.execute [collection1] webapp=/ukvke/l path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 1104859 T5967 C1905 P47177 oasc.SolrCore.execute [collection1] webapp=/ukvke/l path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 1104860 T5951 C1907 P44490 oasc.SolrCore.execute [collection1] webapp=/ukvke/l path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 1104862 T5982 C1904 P53107 oasc.SolrCore.execute [collection1] webapp=/ukvke/l path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 1106866 T5912 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1438964836724637696)} 0 1
[junit4:junit4] 2> 1106873 T5966 C1905 P47177 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={update.distrib=FROMLEADER&_version_=-1438964836728832000&update.from=http://127.0.0.1:47055/ukvke/l/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1438964836728832000)} 0 1
[junit4:junit4] 2> 1106876 T5983 C1904 P53107 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={update.distrib=FROMLEADER&_version_=-1438964836731977728&update.from=http://127.0.0.1:44490/ukvke/l/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1438964836731977728)} 0 2
[junit4:junit4] 2> 1106876 T5948 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={update.distrib=TOLEADER&wt=javabin&version=2} {deleteByQuery=*:* (-1438964836731977728)} 0 4
[junit4:junit4] 2> 1106877 T5933 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1438964836728832000)} 0 8
[junit4:junit4] 2> 1106880 T5914 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[a!0 (1438964836740366336)]} 0 1
[junit4:junit4] 2> 1106889 T5982 C1904 P53107 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:44490/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!0 (1438964836745609216)]} 0 2
[junit4:junit4] 2> 1106890 T5949 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[a!0 (1438964836745609216)]} 0 6
[junit4:junit4] 2> 1106890 T5932 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[a!0]} 0 7
[junit4:junit4] 2> 1106893 T5915 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[b!1 (1438964836753997824)]} 0 0
[junit4:junit4] 2> 1106898 T5967 C1905 P47177 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!1 (1438964836756094976)]} 0 1
[junit4:junit4] 2> 1106899 T5935 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:44490/ukvke/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[b!1 (1438964836756094976)]} 0 4
[junit4:junit4] 2> 1106899 T5950 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[b!1]} 0 5
[junit4:junit4] 2> 1106902 T5913 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[c!2 (1438964836762386432)]} 0 1
[junit4:junit4] 2> 1106906 T5964 C1905 P47177 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!2 (1438964836765532160)]} 0 0
[junit4:junit4] 2> 1106907 T5934 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[c!2 (1438964836765532160)]} 0 3
[junit4:junit4] 2> 1106909 T5912 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[d!3 (1438964836770775040)]} 0 0
[junit4:junit4] 2> 1106915 T5984 C1904 P53107 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:44490/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!3 (1438964836774969344)]} 0 0
[junit4:junit4] 2> 1106915 T5951 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[d!3 (1438964836774969344)]} 0 2
[junit4:junit4] 2> 1106916 T5933 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[d!3]} 0 5
[junit4:junit4] 2> 1106918 T5914 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[e!4 (1438964836780212224)]} 0 0
[junit4:junit4] 2> 1106922 T5981 C1904 P53107 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:44490/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!4 (1438964836782309376)]} 0 0
[junit4:junit4] 2> 1106922 T5948 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[e!4 (1438964836782309376)]} 0 2
[junit4:junit4] 2> 1106924 T5915 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[f!5 (1438964836786503680)]} 0 0
[junit4:junit4] 2> 1106928 T5983 C1904 P53107 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:44490/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!5 (1438964836788600832)]} 0 0
[junit4:junit4] 2> 1106929 T5949 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[f!5 (1438964836788600832)]} 0 3
[junit4:junit4] 2> 1106931 T5913 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[g!6 (1438964836793843712)]} 0 0
[junit4:junit4] 2> 1106937 T5965 C1905 P47177 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!6 (1438964836798038016)]} 0 0
[junit4:junit4] 2> 1106938 T5932 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:44490/ukvke/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[g!6 (1438964836798038016)]} 0 3
[junit4:junit4] 2> 1106938 T5950 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[g!6]} 0 5
[junit4:junit4] 2> 1106940 T5914 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[h!7 (1438964836803280896)]} 0 0
[junit4:junit4] 2> 1106946 T5966 C1905 P47177 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!7 (1438964836807475200)]} 0 0
[junit4:junit4] 2> 1106947 T5935 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:44490/ukvke/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[h!7 (1438964836807475200)]} 0 3
[junit4:junit4] 2> 1106948 T5951 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[h!7]} 0 6
[junit4:junit4] 2> 1106950 T5915 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[i!8 (1438964836813766656)]} 0 0
[junit4:junit4] 2> 1106955 T5967 C1905 P47177 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!8 (1438964836815863808)]} 0 1
[junit4:junit4] 2> 1106955 T5934 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[i!8 (1438964836815863808)]} 0 3
[junit4:junit4] 2> 1106958 T5913 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[j!9 (1438964836821106688)]} 0 1
[junit4:junit4] 2> 1106962 T5964 C1905 P47177 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!9 (1438964836824252416)]} 0 1
[junit4:junit4] 2> 1106962 T5933 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[j!9 (1438964836824252416)]} 0 2
[junit4:junit4] 2> 1106965 T5912 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[k!10 (1438964836828446720)]} 0 1
[junit4:junit4] 2> 1106969 T5965 C1905 P47177 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[k!10 (1438964836831592448)]} 0 0
[junit4:junit4] 2> 1106970 T5932 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[k!10 (1438964836831592448)]} 0 3
[junit4:junit4] 2> 1106973 T5914 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[l!11 (1438964836836835328)]} 0 1
[junit4:junit4] 2> 1106979 T5982 C1904 P53107 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:44490/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[l!11 (1438964836842078208)]} 0 1
[junit4:junit4] 2> 1106980 T5948 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[l!11 (1438964836842078208)]} 0 4
[junit4:junit4] 2> 1106980 T5935 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[l!11]} 0 5
[junit4:junit4] 2> 1106982 T5915 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[m!12 (1438964836847321088)]} 0 0
[junit4:junit4] 2> 1106987 T5984 C1904 P53107 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:44490/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[m!12 (1438964836850466816)]} 0 1
[junit4:junit4] 2> 1106987 T5949 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[m!12 (1438964836850466816)]} 0 3
[junit4:junit4] 2> 1106990 T5913 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[n!13 (1438964836854661120)]} 0 1
[junit4:junit4] 2> 1106994 T5966 C1905 P47177 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[n!13 (1438964836857806848)]} 0 1
[junit4:junit4] 2> 1106995 T5934 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[n!13 (1438964836857806848)]} 0 3
[junit4:junit4] 2> 1106997 T5912 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[o!14 (1438964836863049728)]} 0 1
[junit4:junit4] 2> 1107003 T5981 C1904 P53107 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:44490/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[o!14 (1438964836867244032)]} 0 1
[junit4:junit4] 2> 1107003 T5950 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[o!14 (1438964836867244032)]} 0 3
[junit4:junit4] 2> 1107004 T5933 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[o!14]} 0 5
[junit4:junit4] 2> 1107006 T5914 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[p!15 (1438964836872486912)]} 0 0
[junit4:junit4] 2> 1107010 T5967 C1905 P47177 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[p!15 (1438964836874584064)]} 0 0
[junit4:junit4] 2> 1107011 T5932 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[p!15 (1438964836874584064)]} 0 3
[junit4:junit4] 2> 1107013 T5915 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[q!16 (1438964836879826944)]} 0 0
[junit4:junit4] 2> 1107019 T5964 C1905 P47177 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[q!16 (1438964836884021248)]} 0 0
[junit4:junit4] 2> 1107020 T5935 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:44490/ukvke/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[q!16 (1438964836884021248)]} 0 3
[junit4:junit4] 2> 1107021 T5951 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[q!16]} 0 6
[junit4:junit4] 2> 1107023 T5913 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[r!17 (1438964836890312704)]} 0 1
[junit4:junit4] 2> 1107027 T5983 C1904 P53107 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:44490/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[r!17 (1438964836892409856)]} 0 0
[junit4:junit4] 2> 1107028 T5948 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[r!17 (1438964836892409856)]} 0 3
[junit4:junit4] 2> 1107031 T5912 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[s!18 (1438964836897652736)]} 0 1
[junit4:junit4] 2> 1107035 T5965 C1905 P47177 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[s!18 (1438964836900798464)]} 0 0
[junit4:junit4] 2> 1107036 T5934 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[s!18 (1438964836900798464)]} 0 3
[junit4:junit4] 2> 1107038 T5914 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[t!19 (1438964836906041344)]} 0 0
[junit4:junit4] 2> 1107044 T5966 C1905 P47177 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[t!19 (1438964836910235648)]} 0 0
[junit4:junit4] 2> 1107045 T5933 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:44490/ukvke/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[t!19 (1438964836910235648)]} 0 3
[junit4:junit4] 2> 1107045 T5949 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[t!19]} 0 5
[junit4:junit4] 2> 1107048 T5915 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[u!20 (1438964836915478528)]} 0 1
[junit4:junit4] 2> 1107054 T5982 C1904 P53107 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:44490/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[u!20 (1438964836920721408)]} 0 0
[junit4:junit4] 2> 1107055 T5950 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[u!20 (1438964836920721408)]} 0 3
[junit4:junit4] 2> 1107055 T5932 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[u!20]} 0 5
[junit4:junit4] 2> 1107057 T5913 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[v!21 (1438964836925964288)]} 0 0
[junit4:junit4] 2> 1107062 T5967 C1905 P47177 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[v!21 (1438964836928061440)]} 0 1
[junit4:junit4] 2> 1107062 T5935 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[v!21 (1438964836928061440)]} 0 3
[junit4:junit4] 2> 1107064 T5912 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[w!22 (1438964836933304320)]} 0 0
[junit4:junit4] 2> 1107071 T5964 C1905 P47177 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[w!22 (1438964836937498624)]} 0 1
[junit4:junit4] 2> 1107071 T5934 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:44490/ukvke/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[w!22 (1438964836937498624)]} 0 3
[junit4:junit4] 2> 1107072 T5951 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[w!22]} 0 6
[junit4:junit4] 2> 1107074 T5914 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[x!23 (1438964836943790080)]} 0 0
[junit4:junit4] 2> 1107080 T5984 C1904 P53107 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:44490/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[x!23 (1438964836947984384)]} 0 0
[junit4:junit4] 2> 1107081 T5948 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[x!23 (1438964836947984384)]} 0 3
[junit4:junit4] 2> 1107081 T5933 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[x!23]} 0 5
[junit4:junit4] 2> 1107084 T5915 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[y!24 (1438964836954275840)]} 0 1
[junit4:junit4] 2> 1107088 T5981 C1904 P53107 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:44490/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[y!24 (1438964836956372992)]} 0 0
[junit4:junit4] 2> 1107089 T5949 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[y!24 (1438964836956372992)]} 0 3
[junit4:junit4] 2> 1107091 T5913 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[z!25 (1438964836961615872)]} 0 1
[junit4:junit4] 2> 1107095 T5965 C1905 P47177 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[z!25 (1438964836963713024)]} 0 0
[junit4:junit4] 2> 1107096 T5932 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[z!25 (1438964836963713024)]} 0 3
[junit4:junit4] 2> 1107098 T5912 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[a!26 (1438964836968955904)]} 0 0
[junit4:junit4] 2> 1107102 T5983 C1904 P53107 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:44490/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!26 (1438964836971053056)]} 0 0
[junit4:junit4] 2> 1107102 T5950 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[a!26 (1438964836971053056)]} 0 2
[junit4:junit4] 2> 1107105 T5914 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[b!27 (1438964836975247360)]} 0 1
[junit4:junit4] 2> 1107111 T5966 C1905 P47177 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!27 (1438964836980490240)]} 0 1
[junit4:junit4] 2> 1107111 T5935 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:44490/ukvke/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[b!27 (1438964836980490240)]} 0 3
[junit4:junit4] 2> 1107112 T5951 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[b!27]} 0 5
[junit4:junit4] 2> 1107114 T5915 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[c!28 (1438964836985733120)]} 0 0
[junit4:junit4] 2> 1107120 T5967 C1905 P47177 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!28 (1438964836989927424)]} 0 0
[junit4:junit4] 2> 1107121 T5934 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:44490/ukvke/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[c!28 (1438964836989927424)]} 0 3
[junit4:junit4] 2> 1107121 T5948 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[c!28]} 0 5
[junit4:junit4] 2> 1107124 T5913 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[d!29 (1438964836995170304)]} 0 1
[junit4:junit4] 2> 1107130 T5982 C1904 P53107 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:44490/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!29 (1438964836999364608)]} 0 1
[junit4:junit4] 2> 1107130 T5949 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[d!29 (1438964836999364608)]} 0 3
[junit4:junit4] 2> 1107131 T5933 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[d!29]} 0 5
[junit4:junit4] 2> 1107133 T5912 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[e!30 (1438964837005656064)]} 0 0
[junit4:junit4] 2> 1107140 T5984 C1904 P53107 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:44490/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!30 (1438964837009850368)]} 0 1
[junit4:junit4] 2> 1107140 T5950 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[e!30 (1438964837009850368)]} 0 3
[junit4:junit4] 2> 1107141 T5932 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[e!30]} 0 5
[junit4:junit4] 2> 1107143 T5914 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[f!31 (1438964837016141824)]} 0 0
[junit4:junit4] 2> 1107149 T5981 C1904 P53107 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:44490/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!31 (1438964837020336128)]} 0 1
[junit4:junit4] 2> 1107149 T5951 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[f!31 (1438964837020336128)]} 0 2
[junit4:junit4] 2> 1107150 T5935 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[f!31]} 0 5
[junit4:junit4] 2> 1107152 T5915 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[g!32 (1438964837025579008)]} 0 0
[junit4:junit4] 2> 1107159 T5964 C1905 P47177 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!32 (1438964837029773312)]} 0 1
[junit4:junit4] 2> 1107159 T5934 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:44490/ukvke/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[g!32 (1438964837029773312)]} 0 3
[junit4:junit4] 2> 1107160 T5948 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[g!32]} 0 6
[junit4:junit4] 2> 1107162 T5913 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[h!33 (1438964837036064768)]} 0 0
[junit4:junit4] 2> 1107169 T5965 C1905 P47177 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!33 (1438964837040259072)]} 0 1
[junit4:junit4] 2> 1107170 T5933 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:44490/ukvke/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[h!33 (1438964837040259072)]} 0 4
[junit4:junit4] 2> 1107170 T5949 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[h!33]} 0 6
[junit4:junit4] 2> 1107173 T5912 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[i!34 (1438964837047599104)]} 0 0
[junit4:junit4] 2> 1107180 T5966 C1905 P47177 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!34 (1438964837051793408)]} 0 1
[junit4:junit4] 2> 1107180 T5932 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:44490/ukvke/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[i!34 (1438964837051793408)]} 0 3
[junit4:junit4] 2> 1107181 T5950 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[i!34]} 0 5
[junit4:junit4] 2> 1107184 T5914 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[j!35 (1438964837058084864)]} 0 1
[junit4:junit4] 2> 1107188 T5967 C1905 P47177 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!35 (1438964837061230592)]} 0 0
[junit4:junit4] 2> 1107189 T5935 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[j!35 (1438964837061230592)]} 0 3
[junit4:junit4] 2> 1107192 T5915 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[k!36 (1438964837066473472)]} 0 1
[junit4:junit4] 2> 1107196 T5964 C1905 P47177 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[k!36 (1438964837069619200)]} 0 0
[junit4:junit4] 2> 1107197 T5934 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[k!36 (1438964837069619200)]} 0 3
[junit4:junit4] 2> 1107199 T5913 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[l!37 (1438964837074862080)]} 0 0
[junit4:junit4] 2> 1107204 T5983 C1904 P53107 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:44490/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[l!37 (1438964837078007808)]} 0 0
[junit4:junit4] 2> 1107205 T5951 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[l!37 (1438964837078007808)]} 0 3
[junit4:junit4] 2> 1107207 T5912 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[m!38 (1438964837083250688)]} 0 0
[junit4:junit4] 2> 1107214 T5982 C1904 P53107 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:44490/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[m!38 (1438964837087444992)]} 0 1
[junit4:junit4] 2> 1107215 T5948 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[m!38 (1438964837087444992)]} 0 4
[junit4:junit4] 2> 1107215 T5933 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[m!38]} 0 6
[junit4:junit4] 2> 1107218 T5914 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[n!39 (1438964837093736448)]} 0 1
[junit4:junit4] 2> 1107222 T5965 C1905 P47177 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[n!39 (1438964837096882176)]} 0 1
[junit4:junit4] 2> 1107222 T5932 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[n!39 (1438964837096882176)]} 0 2
[junit4:junit4] 2> 1107225 T5915 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[o!40 (1438964837101076480)]} 0 1
[junit4:junit4] 2> 1107229 T5984 C1904 P53107 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:44490/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[o!40 (1438964837104222208)]} 0 1
[junit4:junit4] 2> 1107230 T5949 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[o!40 (1438964837104222208)]} 0 4
[junit4:junit4] 2> 1107232 T5913 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[p!41 (1438964837109465088)]} 0 0
[junit4:junit4] 2> 1107238 T5966 C1905 P47177 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[p!41 (1438964837113659392)]} 0 1
[junit4:junit4] 2> 1107239 T5935 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:44490/ukvke/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[p!41 (1438964837113659392)]} 0 4
[junit4:junit4] 2> 1107239 T5950 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[p!41]} 0 5
[junit4:junit4] 2> 1107241 T5912 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[q!42 (1438964837118902272)]} 0 0
[junit4:junit4] 2> 1107247 T5967 C1905 P47177 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[q!42 (1438964837123096576)]} 0 0
[junit4:junit4] 2> 1107247 T5934 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:44490/ukvke/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[q!42 (1438964837123096576)]} 0 2
[junit4:junit4] 2> 1107248 T5951 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[q!42]} 0 5
[junit4:junit4] 2> 1107250 T5914 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[r!43 (1438964837128339456)]} 0 1
[junit4:junit4] 2> 1107254 T5981 C1904 P53107 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:44490/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[r!43 (1438964837130436608)]} 0 1
[junit4:junit4] 2> 1107254 T5948 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[r!43 (1438964837130436608)]} 0 2
[junit4:junit4] 2> 1107256 T5915 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[s!44 (1438964837134630912)]} 0 0
[junit4:junit4] 2> 1107260 T5964 C1905 P47177 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[s!44 (1438964837136728064)]} 0 0
[junit4:junit4] 2> 1107261 T5932 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[s!44 (1438964837136728064)]} 0 3
[junit4:junit4] 2> 1107263 T5913 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[t!45 (1438964837141970944)]} 0 0
[junit4:junit4] 2> 1107267 T5967 C1905 P47177 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[t!45 (1438964837144068096)]} 0 0
[junit4:junit4] 2> 1107268 T5934 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[t!45 (1438964837144068096)]} 0 3
[junit4:junit4] 2> 1107270 T5912 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[u!46 (1438964837149310976)]} 0 0
[junit4:junit4] 2> 1107274 T5983 C1904 P53107 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:44490/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[u!46 (1438964837151408128)]} 0 0
[junit4:junit4] 2> 1107275 T5949 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[u!46 (1438964837151408128)]} 0 3
[junit4:junit4] 2> 1107277 T5915 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[v!47 (1438964837156651008)]} 0 0
[junit4:junit4] 2> 1107281 T5965 C1905 P47177 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[v!47 (1438964837158748160)]} 0 0
[junit4:junit4] 2> 1107282 T5933 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[v!47 (1438964837158748160)]} 0 3
[junit4:junit4] 2> 1107284 T5913 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[w!48 (1438964837163991040)]} 0 1
[junit4:junit4] 2> 1107288 T5964 C1905 P47177 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[w!48 (1438964837166088192)]} 0 0
[junit4:junit4] 2> 1107289 T5932 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[w!48 (1438964837166088192)]} 0 3
[junit4:junit4] 2> 1107291 T5914 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[x!49 (1438964837171331072)]} 0 0
[junit4:junit4] 2> 1107297 T5984 C1904 P53107 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:44490/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[x!49 (1438964837175525376)]} 0 1
[junit4:junit4] 2> 1107297 T5951 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[x!49 (1438964837175525376)]} 0 3
[junit4:junit4] 2> 1107298 T5935 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[x!49]} 0 5
[junit4:junit4] 2> 1107300 T5912 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[y!50 (1438964837180768256)]} 0 0
[junit4:junit4] 2> 1107304 T5981 C1904 P53107 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:44490/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[y!50 (1438964837182865408)]} 0 0
[junit4:junit4] 2> 1107305 T5948 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[y!50 (1438964837182865408)]} 0 3
[junit4:junit4] 2> 1107307 T5915 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[z!51 (1438964837188108288)]} 0 0
[junit4:junit4] 2> 1107311 T5966 C1905 P47177 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[z!51 (1438964837190205440)]} 0 0
[junit4:junit4] 2> 1107312 T5934 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[z!51 (1438964837190205440)]} 0 3
[junit4:junit4] 2> 1107314 T5913 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[a!52 (1438964837195448320)]} 0 0
[junit4:junit4] 2> 1107318 T5982 C1904 P53107 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:44490/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!52 (1438964837197545472)]} 0 0
[junit4:junit4] 2> 1107319 T5949 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[a!52 (1438964837197545472)]} 0 3
[junit4:junit4] 2> 1107321 T5914 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[b!53 (1438964837202788352)]} 0 1
[junit4:junit4] 2> 1107327 T5967 C1905 P47177 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!53 (1438964837206982656)]} 0 0
[junit4:junit4] 2> 1107328 T5933 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:44490/ukvke/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[b!53 (1438964837206982656)]} 0 4
[junit4:junit4] 2> 1107328 T5950 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[b!53]} 0 5
[junit4:junit4] 2> 1107331 T5912 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[c!54 (1438964837213274112)]} 0 0
[junit4:junit4] 2> 1107337 T5965 C1905 P47177 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!54 (1438964837217468416)]} 0 0
[junit4:junit4] 2> 1107337 T5932 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:44490/ukvke/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[c!54 (1438964837217468416)]} 0 2
[junit4:junit4] 2> 1107338 T5951 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[c!54]} 0 5
[junit4:junit4] 2> 1107340 T5915 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[d!55 (1438964837222711296)]} 0 0
[junit4:junit4] 2> 1107346 T5983 C1904 P53107 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:44490/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!55 (1438964837226905600)]} 0 0
[junit4:junit4] 2> 1107347 T5948 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[d!55 (1438964837226905600)]} 0 3
[junit4:junit4] 2> 1107347 T5935 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[d!55]} 0 5
[junit4:junit4] 2> 1107349 T5913 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[e!56 (1438964837232148480)]} 0 0
[junit4:junit4] 2> 1107354 T5984 C1904 P53107 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:44490/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!56 (1438964837234245632)]} 0 1
[junit4:junit4] 2> 1107354 T5949 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[e!56 (1438964837234245632)]} 0 3
[junit4:junit4] 2> 1107356 T5914 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[f!57 (1438964837239488512)]} 0 0
[junit4:junit4] 2> 1107361 T5981 C1904 P53107 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:44490/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!57 (1438964837241585664)]} 0 1
[junit4:junit4] 2> 1107361 T5950 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[f!57 (1438964837241585664)]} 0 3
[junit4:junit4] 2> 1107364 T5912 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[g!58 (1438964837246828544)]} 0 1
[junit4:junit4] 2> 1107368 T5964 C1905 P47177 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!58 (1438964837249974272)]} 0 0
[junit4:junit4] 2> 1107369 T5934 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[g!58 (1438964837249974272)]} 0 3
[junit4:junit4] 2> 1107371 T5915 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[h!59 (1438964837255217152)]} 0 0
[junit4:junit4] 2> 1107377 T5966 C1905 P47177 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!59 (1438964837259411456)]} 0 0
[junit4:junit4] 2> 1107378 T5933 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:44490/ukvke/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[h!59 (1438964837259411456)]} 0 3
[junit4:junit4] 2> 1107379 T5951 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[h!59]} 0 6
[junit4:junit4] 2> 1107381 T5913 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[i!60 (1438964837265702912)]} 0 1
[junit4:junit4] 2> 1107387 T5967 C1905 P47177 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!60 (1438964837269897216)]} 0 0
[junit4:junit4] 2> 1107388 T5932 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:44490/ukvke/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[i!60 (1438964837269897216)]} 0 4
[junit4:junit4] 2> 1107388 T5948 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[i!60]} 0 5
[junit4:junit4] 2> 1107391 T5914 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[j!61 (1438964837275140096)]} 0 1
[junit4:junit4] 2> 1107396 T5965 C1905 P47177 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!61 (1438964837278285824)]} 0 1
[junit4:junit4] 2> 1107397 T5935 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[j!61 (1438964837278285824)]} 0 4
[junit4:junit4] 2> 1107399 T5912 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[k!62 (1438964837284577280)]} 0 0
[junit4:junit4] 2> 1107405 T5964 C1905 P47177 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[k!62 (1438964837288771584)]} 0 0
[junit4:junit4] 2> 1107406 T5934 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:44490/ukvke/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[k!62 (1438964837288771584)]} 0 3
[junit4:junit4] 2> 1107407 T5949 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[k!62]} 0 6
[junit4:junit4] 2> 1107409 T5915 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[l!63 (1438964837295063040)]} 0 1
[junit4:junit4] 2> 1107415 T5982 C1904 P53107 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:44490/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[l!63 (1438964837299257344)]} 0 0
[junit4:junit4] 2> 1107416 T5950 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[l!63 (1438964837299257344)]} 0 3
[junit4:junit4] 2> 1107416 T5933 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[l!63]} 0 5
[junit4:junit4] 2> 1107418 T5913 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[m!64 (1438964837304500224)]} 0 0
[junit4:junit4] 2> 1107423 T5983 C1904 P53107 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:44490/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[m!64 (1438964837306597376)]} 0 1
[junit4:junit4] 2> 1107424 T5951 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[m!64 (1438964837306597376)]} 0 4
[junit4:junit4] 2> 1107426 T5914 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[n!65 (1438964837312888832)]} 0 0
[junit4:junit4] 2> 1107431 T5966 C1905 P47177 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[n!65 (1438964837314985984)]} 0 1
[junit4:junit4] 2> 1107431 T5932 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[n!65 (1438964837314985984)]} 0 3
[junit4:junit4] 2> 1107434 T5912 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[o!66 (1438964837320228864)]} 0 1
[junit4:junit4] 2> 1107440 T5984 C1904 P53107 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:44490/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[o!66 (1438964837324423168)]} 0 1
[junit4:junit4] 2> 1107441 T5948 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[o!66 (1438964837324423168)]} 0 4
[junit4:junit4] 2> 1107441 T5935 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[o!66]} 0 5
[junit4:junit4] 2> 1107443 T5915 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[p!67 (1438964837330714624)]} 0 0
[junit4:junit4] 2> 1107449 T5967 C1905 P47177 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[p!67 (1438964837334908928)]} 0 0
[junit4:junit4] 2> 1107450 T5934 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:44490/ukvke/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[p!67 (1438964837334908928)]} 0 3
[junit4:junit4] 2> 1107451 T5949 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[p!67]} 0 6
[junit4:junit4] 2> 1107453 T5913 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[q!68 (1438964837341200384)]} 0 0
[junit4:junit4] 2> 1107457 T5965 C1905 P47177 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[q!68 (1438964837343297536)]} 0 0
[junit4:junit4] 2> 1107458 T5933 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[q!68 (1438964837343297536)]} 0 3
[junit4:junit4] 2> 1107460 T5914 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[r!69 (1438964837348540416)]} 0 0
[junit4:junit4] 2> 1107464 T5981 C1904 P53107 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:44490/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[r!69 (1438964837350637568)]} 0 0
[junit4:junit4] 2> 1107465 T5950 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[r!69 (1438964837350637568)]} 0 3
[junit4:junit4] 2> 1107467 T5912 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[s!70 (1438964837355880448)]} 0 0
[junit4:junit4] 2> 1107473 T5964 C1905 P47177 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[s!70 (1438964837360074752)]} 0 0
[junit4:junit4] 2> 1107474 T5932 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:44490/ukvke/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[s!70 (1438964837360074752)]} 0 3
[junit4:junit4] 2> 1107475 T5951 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[s!70]} 0 6
[junit4:junit4] 2> 1107477 T5915 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[t!71 (1438964837366366208)]} 0 0
[junit4:junit4] 2> 1107481 T5966 C1905 P47177 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[t!71 (1438964837368463360)]} 0 0
[junit4:junit4] 2> 1107482 T5935 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[t!71 (1438964837368463360)]} 0 3
[junit4:junit4] 2> 1107484 T5913 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[u!72 (1438964837373706240)]} 0 0
[junit4:junit4] 2> 1107490 T5982 C1904 P53107 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:44490/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[u!72 (1438964837377900544)]} 0 0
[junit4:junit4] 2> 1107491 T5948 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[u!72 (1438964837377900544)]} 0 3
[junit4:junit4] 2> 1107491 T5934 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[u!72]} 0 5
[junit4:junit4] 2> 1107494 T5914 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[v!73 (1438964837383143424)]} 0 1
[junit4:junit4] 2> 1107498 T5967 C1905 P47177 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[v!73 (1438964837386289152)]} 0 0
[junit4:junit4] 2> 1107499 T5933 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[v!73 (1438964837386289152)]} 0 3
[junit4:junit4] 2> 1107501 T5912 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[w!74 (1438964837391532032)]} 0 0
[junit4:junit4] 2> 1107507 T5965 C1905 P47177 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[w!74 (1438964837395726336)]} 0 0
[junit4:junit4] 2> 1107508 T5932 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:44490/ukvke/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[w!74 (1438964837395726336)]} 0 3
[junit4:junit4] 2> 1107509 T5949 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[w!74]} 0 6
[junit4:junit4] 2> 1107511 T5915 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[x!75 (1438964837402017792)]} 0 0
[junit4:junit4] 2> 1107517 T5983 C1904 P53107 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:44490/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[x!75 (1438964837406212096)]} 0 0
[junit4:junit4] 2> 1107518 T5950 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[x!75 (1438964837406212096)]} 0 3
[junit4:junit4] 2> 1107518 T5935 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[x!75]} 0 5
[junit4:junit4] 2> 1107521 T5913 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[y!76 (1438964837411454976)]} 0 1
[junit4:junit4] 2> 1107525 T5984 C1904 P53107 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:44490/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[y!76 (1438964837414600704)]} 0 1
[junit4:junit4] 2> 1107526 T5951 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[y!76 (1438964837414600704)]} 0 4
[junit4:junit4] 2> 1107528 T5914 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[z!77 (1438964837419843584)]} 0 0
[junit4:junit4] 2> 1107532 T5964 C1905 P47177 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[z!77 (1438964837421940736)]} 0 0
[junit4:junit4] 2> 1107533 T5934 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[z!77 (1438964837421940736)]} 0 3
[junit4:junit4] 2> 1107535 T5912 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[a!78 (1438964837427183616)]} 0 0
[junit4:junit4] 2> 1107540 T5981 C1904 P53107 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:44490/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!78 (1438964837429280768)]} 0 1
[junit4:junit4] 2> 1107540 T5948 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[a!78 (1438964837429280768)]} 0 3
[junit4:junit4] 2> 1107542 T5915 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[b!79 (1438964837434523648)]} 0 0
[junit4:junit4] 2> 1107549 T5966 C1905 P47177 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!79 (1438964837438717952)]} 0 1
[junit4:junit4] 2> 1107549 T5933 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:44490/ukvke/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[b!79 (1438964837438717952)]} 0 3
[junit4:junit4] 2> 1107550 T5949 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[b!79]} 0 6
[junit4:junit4] 2> 1107552 T5913 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[c!80 (1438964837445009408)]} 0 0
[junit4:junit4] 2> 1107559 T5967 C1905 P47177 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!80 (1438964837449203712)]} 0 1
[junit4:junit4] 2> 1107559 T5932 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:44490/ukvke/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[c!80 (1438964837449203712)]} 0 3
[junit4:junit4] 2> 1107560 T5950 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[c!80]} 0 6
[junit4:junit4] 2> 1107562 T5914 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[d!81 (1438964837455495168)]} 0 0
[junit4:junit4] 2> 1107569 T5982 C1904 P53107 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:44490/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!81 (1438964837459689472)]} 0 1
[junit4:junit4] 2> 1107569 T5951 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[d!81 (1438964837459689472)]} 0 3
[junit4:junit4] 2> 1107570 T5935 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[d!81]} 0 6
[junit4:junit4] 2> 1107572 T5912 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[e!82 (1438964837465980928)]} 0 0
[junit4:junit4] 2> 1107577 T5983 C1904 P53107 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:44490/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!82 (1438964837468078080)]} 0 0
[junit4:junit4] 2> 1107578 T5948 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[e!82 (1438964837468078080)]} 0 4
[junit4:junit4] 2> 1107581 T5915 C1908 P42978 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[f!83 (1438964837474369536)]} 0 1
[junit4:junit4] 2> 1107587 T5984 C1904 P53107 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:44490/ukvke/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!83 (1438964837478563840)]} 0 1
[junit4:junit4] 2> 1107587 T5949 C1907 P44490 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={distrib.from=http://127.0.0.1:47055/ukvke/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[f!83 (1438964837478563840)]} 0 3
[junit4:junit4] 2> 1107588 T5934 C1906 P47055 oasup.LogUpdateProcessor.finish [collection1] webapp=/ukvke/l path=/update params={wt=javabin&version=2} {add=[f!83]} 0 5
[...truncated too long message...]
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4:junit4] 2> at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)
[junit4:junit4] 2> at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:724)
[junit4:junit4] 2> 208730 T5896 ccr.ThreadLeakControl.tryToInterruptAll Starting to interrupt leaked threads:
[junit4:junit4] 2> 1) Thread[id=6021, name=IPC Parameter Sending Thread #4, state=TIMED_WAITING, group=TGRP-HdfsBasicDistributedZk2Test]
[junit4:junit4] 2> 211736 T5896 ccr.ThreadLeakControl.tryToInterruptAll SEVERE There are still zombie threads that couldn't be terminated:
[junit4:junit4] 2> 1) Thread[id=6021, name=IPC Parameter Sending Thread #4, state=TIMED_WAITING, group=TGRP-HdfsBasicDistributedZk2Test]
[junit4:junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4:junit4] 2> at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
[junit4:junit4] 2> at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4:junit4] 2> at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)
[junit4:junit4] 2> at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:724)
[junit4:junit4] 2> NOTE: test params are: codec=HighCompressionCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=HIGH_COMPRESSION, chunkSize=350), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=HIGH_COMPRESSION, chunkSize=350)), sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=sr_BA_#Latn, timezone=Europe/Riga
[junit4:junit4] 2> NOTE: Linux 3.2.0-48-generic amd64/Oracle Corporation 1.7.0_25 (64-bit)/cpus=8,threads=1,free=275743656,total=518979584
[junit4:junit4] 2> NOTE: All tests run in this JVM: [TestUniqueKeyFieldResource, TestClassNameShortening, TestJmxMonitoredMap, TestFieldCollectionResource, CachingDirectoryFactoryTest, StandardRequestHandlerTest, HighlighterTest, UpdateParamsTest, TestWordDelimiterFilterFactory, HdfsBasicDistributedZk2Test, JSONWriterTest, TestZkChroot, DateMathParserTest, TestIndexSearcher, TestCoreDiscovery, BadIndexSchemaTest, TestFastOutputStream, SolrIndexConfigTest, TestRecovery, XmlUpdateRequestHandlerTest, XsltUpdateRequestHandlerTest, TestStressLucene, TestSchemaSimilarityResource, TestRangeQuery, HdfsSyncSliceTest, TestNumberUtils, ShardRoutingCustomTest, URLClassifyProcessorTest, TermVectorComponentDistributedTest, BasicDistributedZk2Test, CopyFieldTest, FileUtilsTest, TestRTGBase, DOMUtilTest, DebugComponentTest, TestManagedSchema, TestBM25SimilarityFactory, NotRequiredUniqueKeyTest, TestMergePolicyConfig, TestPropInject, SpellPossibilityIteratorTest, FieldAnalysisRequestHandlerTest, TestStressReorder, NoCacheHeaderTest, SuggesterTSTTest, TestLMJelinekMercerSimilarityFactory, TestElisionMultitermQuery, DocumentAnalysisRequestHandlerTest, SolrTestCaseJ4Test, PingRequestHandlerTest, SolrCmdDistributorTest, TestLuceneMatchVersion, TestDistributedSearch, HdfsUnloadDistributedZkTest, TestJmxIntegration, OpenCloseCoreStressTest, TestHashPartitioner, TestRecoveryHdfs, CurrencyFieldOpenExchangeTest, ZkNodePropsTest, HdfsRecoveryZkTest, TestSchemaResource, MultiTermTest, TestReload, TestUpdate, SolrPluginUtilsTest, OpenExchangeRatesOrgProviderTest, EchoParamsTest, TestOmitPositions, SolrRequestParserTest, TestLazyCores, RequestHandlersTest, ChaosMonkeySafeLeaderTest, SyncSliceTest, OverseerTest, ShardRoutingTest, FullSolrCloudDistribCmdsTest, ClusterStateUpdateTest, TestRandomFaceting, ZkCLITest, TestDistributedGrouping, TestFaceting, DistributedSpellCheckComponentTest, ZkControllerTest, TestRealTimeGet, TestMultiCoreConfBootstrap, HardAutoCommitTest, TestSolr4Spatial, SolrCoreTest, StatsComponentTest, SpellCheckComponentTest, QueryElevationComponentTest, PeerSyncTest, ConvertedLegacyTest, TestSort, TestFiltering, TestCSVLoader, WordBreakSolrSpellCheckerTest, TestAtomicUpdateErrorCases, DirectUpdateHandlerOptimizeTest, TestRemoteStreaming, DistanceFunctionTest, CacheHeaderTest, DisMaxRequestHandlerTest, TestQueryUtils, DirectSolrSpellCheckerTest, FileBasedSpellCheckerTest, DocumentBuilderTest, TestIndexingPerformance, RequiredFieldsTest, TestArbitraryIndexDir, RegexBoostProcessorTest, TestCollationField, TestCSVResponseWriter, UniqFieldsUpdateProcessorFactoryTest, BinaryUpdateRequestHandlerTest, TestComponentsName, CoreContainerCoreInitFailuresTest, TestLFUCache, SOLR749Test, IndexReaderFactoryTest, SampleTest, TestConfig, ExternalFileFieldSortTest, TestSolrCoreProperties, TestPostingsSolrHighlighter, TestDFRSimilarityFactory, TestDefaultSimilarityFactory, TimeZoneUtilsTest, TestSolrXMLSerializer, PrimUtilsTest, DateFieldTest, ClusterStateTest, TestLRUCache, TestDocumentBuilder, CircularListTest, ShardSplitTest]
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ShardSplitTest -Dtests.seed=D1E748F718300E16 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sr_BA_#Latn -Dtests.timezone=Europe/Riga -Dtests.file.encoding=US-ASCII
[junit4:junit4] ERROR 0.00s J1 | ShardSplitTest (suite) <<<
[junit4:junit4] > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.ShardSplitTest:
[junit4:junit4] > 1) Thread[id=6021, name=IPC Parameter Sending Thread #4, state=TIMED_WAITING, group=TGRP-HdfsBasicDistributedZk2Test]
[junit4:junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4:junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
[junit4:junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4:junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)
[junit4:junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)
[junit4:junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
[junit4:junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
[junit4:junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:724)
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([D1E748F718300E16]:0)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
[junit4:junit4] > 1) Thread[id=6021, name=IPC Parameter Sending Thread #4, state=TIMED_WAITING, group=TGRP-HdfsBasicDistributedZk2Test]
[junit4:junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4:junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
[junit4:junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4:junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)
[junit4:junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)
[junit4:junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
[junit4:junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
[junit4:junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:724)
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([D1E748F718300E16]:0)
[junit4:junit4] Completed on J1 in 211.88s, 1 test, 2 errors <<< FAILURES!
[...truncated 10 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:386: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:366: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:190: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:443: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1243: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:887: There were test failures: 312 suites, 1315 tests, 2 suite-level errors, 21 ignored (14 assumptions)
Total time: 41 minutes 5 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0_25 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.7.0_25) - Build #
6327 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/6327/
Java: 64bit/jdk1.7.0_25 -XX:-UseCompressedOops -XX:+UseSerialGC
All tests passed
Build Log:
[...truncated 34444 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:386: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:325: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:120: The following files are missing svn:eol-style (or binary svn:mime-type):
* dev-tools/idea/.idea/libraries/Solr_test_framework_library.xml
Total time: 47 minutes 56 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0_25 -XX:-UseCompressedOops -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.7.0_25) - Build #
6326 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/6326/
Java: 32bit/jdk1.7.0_25 -server -XX:+UseG1GC
All tests passed
Build Log:
[...truncated 31022 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:386: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:325: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:120: The following files are missing svn:eol-style (or binary svn:mime-type):
* dev-tools/idea/.idea/libraries/Solr_test_framework_library.xml
Total time: 44 minutes 13 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.7.0_25 -server -XX:+UseG1GC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
Re: [JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.8.0-ea-b94) - Build # 6325 - Failure!
Posted by Mark Miller <ma...@gmail.com>.
Seems this cannot pick up the assume from it's super class. I've added the assume to HdfsUnloadDistributedZkTest as well.
- Mark
On Jun 26, 2013, at 7:09 PM, Policeman Jenkins Server <je...@thetaphi.de> wrote:
> Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/6325/
> Java: 32bit/jdk1.8.0-ea-b94 -server -XX:+UseSerialGC
>
> 3 tests failed.
> FAILED: junit.framework.TestSuite.org.apache.solr.cloud.hdfs.HdfsUnloadDistributedZkTest
>
> Error Message:
> FIXME: This test fails under Java 8 all the time, see SOLR-4711
>
> Stack Trace:
> com.carrotsearch.randomizedtesting.InternalAssumptionViolatedException: FIXME: This test fails under Java 8 all the time, see SOLR-4711
> at __randomizedtesting.SeedInfo.seed([7CA5FD4E6AE27A7]:0)
> at com.carrotsearch.randomizedtesting.RandomizedTest.assumeTrue(RandomizedTest.java:598)
> at com.carrotsearch.randomizedtesting.RandomizedTest.assumeFalse(RandomizedTest.java:606)
> at org.apache.lucene.util.LuceneTestCase.assumeFalse(LuceneTestCase.java:672)
> at org.apache.solr.cloud.UnloadDistributedZkTest.beforeThisClass3(UnloadDistributedZkTest.java:54)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:491)
> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
> at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
> at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:677)
> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
> at java.lang.Thread.run(Thread.java:724)
>
>
> FAILED: junit.framework.TestSuite.org.apache.solr.cloud.hdfs.HdfsUnloadDistributedZkTest
>
> Error Message:
> Can't set default locale to NULL
>
> Stack Trace:
> java.lang.NullPointerException: Can't set default locale to NULL
> at __randomizedtesting.SeedInfo.seed([7CA5FD4E6AE27A7]:0)
> at java.util.Locale.setDefault(Locale.java:971)
> at java.util.Locale.setDefault(Locale.java:933)
> at org.apache.solr.cloud.hdfs.HdfsTestUtil.teardownClass(HdfsTestUtil.java:69)
> at org.apache.solr.cloud.hdfs.HdfsUnloadDistributedZkTest.teardownClass(HdfsUnloadDistributedZkTest.java:48)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:491)
> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
> at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:700)
> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
> at java.lang.Thread.run(Thread.java:724)
>
>
> REGRESSION: org.apache.solr.cloud.SyncSliceTest.testDistribSearch
>
> Error Message:
> shard1 is not consistent. Got 305 from http://127.0.0.1:35711/us/dl/collection1lastClient and got 250 from http://127.0.0.1:40897/us/dl/collection1
>
> Stack Trace:
> java.lang.AssertionError: shard1 is not consistent. Got 305 from http://127.0.0.1:35711/us/dl/collection1lastClient and got 250 from http://127.0.0.1:40897/us/dl/collection1
> at __randomizedtesting.SeedInfo.seed([7CA5FD4E6AE27A7:862CD1CC91F1479B]:0)
> at org.junit.Assert.fail(Assert.java:93)
> at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1045)
> at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:237)
> at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:491)
> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
> at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
> at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
> at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
> at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
> at java.lang.Thread.run(Thread.java:724)
>
>
>
>
> Build Log:
> [...truncated 9181 lines...]
> [junit4:junit4] Suite: org.apache.solr.cloud.hdfs.HdfsUnloadDistributedZkTest
> [junit4:junit4] 2> log4j:WARN No such property [conversionPattern] in org.apache.solr.util.SolrLogLayout.
> [junit4:junit4] 2> 734 T10 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
> [junit4:junit4] 2> 747 T10 oas.SolrTestCaseJ4.deleteCore ###deleteCore
> [junit4:junit4] 2> NOTE: test params are: codec=DummyCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=DUMMY, chunkSize=388), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=DUMMY, chunkSize=388)), sim=DefaultSimilarity, locale=it_CH, timezone=America/Hermosillo
> [junit4:junit4] 2> NOTE: Linux 3.2.0-48-generic i386/Oracle Corporation 1.8.0-ea (32-bit)/cpus=8,threads=1,free=56375784,total=64880640
> [junit4:junit4] 2> NOTE: All tests run in this JVM: [HdfsUnloadDistributedZkTest]
> [junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=HdfsUnloadDistributedZkTest -Dtests.seed=7CA5FD4E6AE27A7 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=it_CH -Dtests.timezone=America/Hermosillo -Dtests.file.encoding=UTF-8
> [junit4:junit4] ERROR 0.00s J0 | HdfsUnloadDistributedZkTest (suite) <<<
> [junit4:junit4] > Assumption #1: FIXME: This test fails under Java 8 all the time, see SOLR-4711Throwable #2: java.lang.NullPointerException: Can't set default locale to NULL
> [junit4:junit4] > at __randomizedtesting.SeedInfo.seed([7CA5FD4E6AE27A7]:0)
> [junit4:junit4] > at java.util.Locale.setDefault(Locale.java:971)
> [junit4:junit4] > at java.util.Locale.setDefault(Locale.java:933)
> [junit4:junit4] > at org.apache.solr.cloud.hdfs.HdfsTestUtil.teardownClass(HdfsTestUtil.java:69)
> [junit4:junit4] > at org.apache.solr.cloud.hdfs.HdfsUnloadDistributedZkTest.teardownClass(HdfsUnloadDistributedZkTest.java:48)
> [junit4:junit4] > at java.lang.Thread.run(Thread.java:724)
> [junit4:junit4] Completed on J0 in 1.07s, 0 tests, 1 error <<< FAILURES!
>
> [...truncated 413 lines...]
> [junit4:junit4] Suite: org.apache.solr.cloud.SyncSliceTest
> [junit4:junit4] 2> 474485 T3373 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /us/dl
> [junit4:junit4] 2> 474504 T3373 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
> [junit4:junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-SyncSliceTest-1372287629334
> [junit4:junit4] 2> 474505 T3373 oasc.ZkTestServer.run STARTING ZK TEST SERVER
> [junit4:junit4] 2> 474505 T3374 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
> [junit4:junit4] 2> 474605 T3373 oasc.ZkTestServer.run start zk server on port:41964
> [junit4:junit4] 2> 474606 T3373 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4] 2> 474711 T3380 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1573e33 name:ZooKeeperConnection Watcher:127.0.0.1:41964 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4] 2> 474711 T3373 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4] 2> 474712 T3373 oascc.SolrZkClient.makePath makePath: /solr
> [junit4:junit4] 2> 474716 T3373 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4] 2> 474717 T3382 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@190dae9 name:ZooKeeperConnection Watcher:127.0.0.1:41964/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4] 2> 474718 T3373 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4] 2> 474718 T3373 oascc.SolrZkClient.makePath makePath: /collections/collection1
> [junit4:junit4] 2> 474720 T3373 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
> [junit4:junit4] 2> 474722 T3373 oascc.SolrZkClient.makePath makePath: /collections/control_collection
> [junit4:junit4] 2> 474724 T3373 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
> [junit4:junit4] 2> 474726 T3373 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
> [junit4:junit4] 2> 474727 T3373 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
> [junit4:junit4] 2> 474731 T3373 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
> [junit4:junit4] 2> 474731 T3373 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
> [junit4:junit4] 2> 474734 T3373 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
> [junit4:junit4] 2> 474735 T3373 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
> [junit4:junit4] 2> 474737 T3373 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
> [junit4:junit4] 2> 474737 T3373 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
> [junit4:junit4] 2> 474741 T3373 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
> [junit4:junit4] 2> 474742 T3373 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
> [junit4:junit4] 2> 474745 T3373 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
> [junit4:junit4] 2> 474745 T3373 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
> [junit4:junit4] 2> 474747 T3373 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
> [junit4:junit4] 2> 474748 T3373 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
> [junit4:junit4] 2> 474750 T3373 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
> [junit4:junit4] 2> 474751 T3373 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
> [junit4:junit4] 2> 474753 T3373 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
> [junit4:junit4] 2> 474754 T3373 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
> [junit4:junit4] 2> 474851 T3373 oejs.Server.doStart jetty-8.1.10.v20130312
> [junit4:junit4] 2> 474855 T3373 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:45318
> [junit4:junit4] 2> 474855 T3373 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
> [junit4:junit4] 2> 474856 T3373 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
> [junit4:junit4] 2> 474856 T3373 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1372287629585
> [junit4:junit4] 2> 474856 T3373 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1372287629585/solr.xml
> [junit4:junit4] 2> 474857 T3373 oasc.CoreContainer.<init> New CoreContainer 31038023
> [junit4:junit4] 2> 474857 T3373 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1372287629585/'
> [junit4:junit4] 2> 474857 T3373 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1372287629585/'
> [junit4:junit4] 2> 474924 T3373 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
> [junit4:junit4] 2> 474925 T3373 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
> [junit4:junit4] 2> 474925 T3373 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
> [junit4:junit4] 2> 474926 T3373 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
> [junit4:junit4] 2> 474926 T3373 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
> [junit4:junit4] 2> 474927 T3373 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
> [junit4:junit4] 2> 474927 T3373 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
> [junit4:junit4] 2> 474928 T3373 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
> [junit4:junit4] 2> 474928 T3373 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
> [junit4:junit4] 2> 474928 T3373 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
> [junit4:junit4] 2> 474931 T3373 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
> [junit4:junit4] 2> 474932 T3373 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:41964/solr
> [junit4:junit4] 2> 474932 T3373 oasc.ZkController.checkChrootPath zkHost includes chroot
> [junit4:junit4] 2> 474933 T3373 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4] 2> 474934 T3393 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6b99d3 name:ZooKeeperConnection Watcher:127.0.0.1:41964 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4] 2> 474934 T3373 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4] 2> 474936 T3373 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
> [junit4:junit4] 2> 474938 T3373 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4] 2> 474940 T3395 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@179382c name:ZooKeeperConnection Watcher:127.0.0.1:41964/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4] 2> 474940 T3373 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4] 2> 474942 T3373 oascc.SolrZkClient.makePath makePath: /overseer/queue
> [junit4:junit4] 2> 474945 T3373 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
> [junit4:junit4] 2> 474953 T3373 oascc.SolrZkClient.makePath makePath: /live_nodes
> [junit4:junit4] 2> 474955 T3373 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45318_us%2Fdl
> [junit4:junit4] 2> 474956 T3373 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:45318_us%2Fdl
> [junit4:junit4] 2> 474958 T3373 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
> [junit4:junit4] 2> 474963 T3373 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
> [junit4:junit4] 2> 474970 T3373 oasc.Overseer.start Overseer (id=89934242076164099-127.0.0.1:45318_us%2Fdl-n_0000000000) starting
> [junit4:junit4] 2> 474973 T3373 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
> [junit4:junit4] 2> 474977 T3397 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
> [junit4:junit4] 2> 474978 T3373 oascc.SolrZkClient.makePath makePath: /clusterstate.json
> [junit4:junit4] 2> 474981 T3373 oascc.SolrZkClient.makePath makePath: /aliases.json
> [junit4:junit4] 2> 474982 T3373 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
> [junit4:junit4] 2> 474987 T3396 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
> [junit4:junit4] 2> 474989 T3398 oasc.ZkController.publish publishing core=collection1 state=down
> [junit4:junit4] 2> 474990 T3398 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4] 2> 474991 T3398 oasc.ZkController.waitForCoreNodeName look for our core node name
> [junit4:junit4] 2> 476491 T3396 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 476492 T3396 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
> [junit4:junit4] 2> "operation":"state",
> [junit4:junit4] 2> "core_node_name":"core_node1",
> [junit4:junit4] 2> "numShards":"1",
> [junit4:junit4] 2> "shard":null,
> [junit4:junit4] 2> "roles":null,
> [junit4:junit4] 2> "state":"down",
> [junit4:junit4] 2> "shard_state":"active",
> [junit4:junit4] 2> "core":"collection1",
> [junit4:junit4] 2> "collection":"control_collection",
> [junit4:junit4] 2> "shard_range":null,
> [junit4:junit4] 2> "node_name":"127.0.0.1:45318_us%2Fdl",
> [junit4:junit4] 2> "base_url":"http://127.0.0.1:45318/us/dl"}
> [junit4:junit4] 2> 476492 T3396 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
> [junit4:junit4] 2> 476492 T3396 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
> [junit4:junit4] 2> 476494 T3395 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
> [junit4:junit4] 2> 476991 T3398 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
> [junit4:junit4] 2> 476992 T3398 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1372287629585/collection1
> [junit4:junit4] 2> 476992 T3398 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
> [junit4:junit4] 2> 476993 T3398 oasc.ZkController.createCollectionZkNode Collection zkNode exists
> [junit4:junit4] 2> 476993 T3398 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
> [junit4:junit4] 2> 476994 T3398 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1372287629585/collection1/'
> [junit4:junit4] 2> 476995 T3398 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1372287629585/collection1/lib/README' to classloader
> [junit4:junit4] 2> 476995 T3398 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1372287629585/collection1/lib/classes/' to classloader
> [junit4:junit4] 2> 477026 T3398 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
> [junit4:junit4] 2> 477060 T3398 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
> [junit4:junit4] 2> 477062 T3398 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
> [junit4:junit4] 2> 477065 T3398 oass.IndexSchema.readSchema [collection1] Schema name=test
> [junit4:junit4] 2> 477464 T3398 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
> [junit4:junit4] 2> 477470 T3398 oass.IndexSchema.readSchema default search field in schema is text
> [junit4:junit4] 2> 477473 T3398 oass.IndexSchema.readSchema unique key field: id
> [junit4:junit4] 2> 477486 T3398 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4:junit4] 2> 477489 T3398 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4:junit4] 2> 477492 T3398 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4:junit4] 2> 477493 T3398 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
> [junit4:junit4] 2> 477493 T3398 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
> [junit4:junit4] 2> 477494 T3398 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4:junit4] 2> 477494 T3398 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
> [junit4:junit4] 2> 477495 T3398 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
> [junit4:junit4] 2> 477495 T3398 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
> [junit4:junit4] 2> 477495 T3398 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1372287629585/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1372287629333/control/data/
> [junit4:junit4] 2> 477495 T3398 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6652b6
> [junit4:junit4] 2> 477496 T3398 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1372287629333/control/data
> [junit4:junit4] 2> 477496 T3398 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1372287629333/control/data/index/
> [junit4:junit4] 2> 477496 T3398 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1372287629333/control/data/index' doesn't exist. Creating new index...
> [junit4:junit4] 2> 477496 T3398 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1372287629333/control/data/index
> [junit4:junit4] 2> 477498 T3398 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
> [junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@87873b lockFactory=org.apache.lucene.store.NativeFSLockFactory@1362817),segFN=segments_1,generation=1}
> [junit4:junit4] 2> 477498 T3398 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
> [junit4:junit4] 2> 477499 T3398 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
> [junit4:junit4] 2> 477500 T3398 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
> [junit4:junit4] 2> 477500 T3398 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
> [junit4:junit4] 2> 477500 T3398 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
> [junit4:junit4] 2> 477501 T3398 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
> [junit4:junit4] 2> 477501 T3398 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
> [junit4:junit4] 2> 477501 T3398 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
> [junit4:junit4] 2> 477501 T3398 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
> [junit4:junit4] 2> 477502 T3398 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
> [junit4:junit4] 2> 477503 T3398 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
> [junit4:junit4] 2> 477505 T3398 oass.SolrIndexSearcher.<init> Opening Searcher@14fe04d main
> [junit4:junit4] 2> 477506 T3398 oasu.CommitTracker.<init> Hard AutoCommit: disabled
> [junit4:junit4] 2> 477506 T3398 oasu.CommitTracker.<init> Soft AutoCommit: disabled
> [junit4:junit4] 2> 477509 T3399 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@14fe04d main{StandardDirectoryReader(segments_1:1)}
> [junit4:junit4] 2> 477510 T3398 oasc.CoreContainer.registerCore registering core: collection1
> [junit4:junit4] 2> 477510 T3398 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:45318/us/dl collection:control_collection shard:shard1
> [junit4:junit4] 2> 477511 T3398 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
> [junit4:junit4] 2> 477519 T3398 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
> [junit4:junit4] 2> 477521 T3398 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
> [junit4:junit4] 2> 477521 T3398 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
> [junit4:junit4] 2> 477522 T3398 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:45318/us/dl/collection1/
> [junit4:junit4] 2> 477522 T3398 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
> [junit4:junit4] 2> 477522 T3398 oasc.SyncStrategy.syncToMe http://127.0.0.1:45318/us/dl/collection1/ has no replicas
> [junit4:junit4] 2> 477522 T3398 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:45318/us/dl/collection1/ shard1
> [junit4:junit4] 2> 477522 T3398 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
> [junit4:junit4] 2> 477997 T3396 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 478002 T3395 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
> [junit4:junit4] 2> 478029 T3398 oasc.ZkController.register We are http://127.0.0.1:45318/us/dl/collection1/ and leader is http://127.0.0.1:45318/us/dl/collection1/
> [junit4:junit4] 2> 478030 T3398 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:45318/us/dl
> [junit4:junit4] 2> 478030 T3398 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
> [junit4:junit4] 2> 478030 T3398 oasc.ZkController.publish publishing core=collection1 state=active
> [junit4:junit4] 2> 478030 T3398 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4] 2> 478031 T3398 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 478032 T3373 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
> [junit4:junit4] 2> 478033 T3373 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
> [junit4:junit4] 2> 478033 T3373 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4] 2> 478036 T3373 oascsi.HttpClientUtil.createClient Creating new http client, config:
> [junit4:junit4] 2> 478037 T3373 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4] 2> 478038 T3402 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f7eb06 name:ZooKeeperConnection Watcher:127.0.0.1:41964/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4] 2> 478039 T3373 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4] 2> 478039 T3373 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
> [junit4:junit4] 2> 478041 T3373 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
> [junit4:junit4] 2> 478132 T3373 oejs.Server.doStart jetty-8.1.10.v20130312
> [junit4:junit4] 2> 478133 T3373 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:35711
> [junit4:junit4] 2> 478134 T3373 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
> [junit4:junit4] 2> 478134 T3373 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
> [junit4:junit4] 2> 478135 T3373 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1372287632871
> [junit4:junit4] 2> 478135 T3373 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1372287632871/solr.xml
> [junit4:junit4] 2> 478135 T3373 oasc.CoreContainer.<init> New CoreContainer 20012095
> [junit4:junit4] 2> 478136 T3373 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1372287632871/'
> [junit4:junit4] 2> 478136 T3373 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1372287632871/'
> [junit4:junit4] 2> 478183 T3373 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
> [junit4:junit4] 2> 478183 T3373 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
> [junit4:junit4] 2> 478184 T3373 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
> [junit4:junit4] 2> 478184 T3373 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
> [junit4:junit4] 2> 478184 T3373 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
> [junit4:junit4] 2> 478185 T3373 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
> [junit4:junit4] 2> 478185 T3373 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
> [junit4:junit4] 2> 478185 T3373 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
> [junit4:junit4] 2> 478186 T3373 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
> [junit4:junit4] 2> 478186 T3373 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
> [junit4:junit4] 2> 478190 T3373 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
> [junit4:junit4] 2> 478191 T3373 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:41964/solr
> [junit4:junit4] 2> 478191 T3373 oasc.ZkController.checkChrootPath zkHost includes chroot
> [junit4:junit4] 2> 478192 T3373 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4] 2> 478193 T3413 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6e23da name:ZooKeeperConnection Watcher:127.0.0.1:41964 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4] 2> 478193 T3373 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4] 2> 478194 T3373 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
> [junit4:junit4] 2> 478197 T3373 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4] 2> 478199 T3415 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@19d6811 name:ZooKeeperConnection Watcher:127.0.0.1:41964/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4] 2> 478199 T3373 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4] 2> 478202 T3373 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
> [junit4:junit4] 2> 479204 T3373 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35711_us%2Fdl
> [junit4:junit4] 2> 479206 T3373 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:35711_us%2Fdl
> [junit4:junit4] 2> 479208 T3395 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
> [junit4:junit4] 2> 479208 T3402 oascc.ZkStateReader$3.process Updating live nodes... (2)
> [junit4:junit4] 2> 479208 T3415 oascc.ZkStateReader$3.process Updating live nodes... (2)
> [junit4:junit4] 2> 479209 T3395 oascc.ZkStateReader$3.process Updating live nodes... (2)
> [junit4:junit4] 2> 479213 T3416 oasc.ZkController.publish publishing core=collection1 state=down
> [junit4:junit4] 2> 479213 T3416 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4] 2> 479214 T3416 oasc.ZkController.waitForCoreNodeName look for our core node name
> [junit4:junit4] 2> 479507 T3396 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 479508 T3396 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
> [junit4:junit4] 2> "operation":"state",
> [junit4:junit4] 2> "core_node_name":"core_node1",
> [junit4:junit4] 2> "numShards":"1",
> [junit4:junit4] 2> "shard":"shard1",
> [junit4:junit4] 2> "roles":null,
> [junit4:junit4] 2> "state":"active",
> [junit4:junit4] 2> "shard_state":"active",
> [junit4:junit4] 2> "core":"collection1",
> [junit4:junit4] 2> "collection":"control_collection",
> [junit4:junit4] 2> "shard_range":null,
> [junit4:junit4] 2> "node_name":"127.0.0.1:45318_us%2Fdl",
> [junit4:junit4] 2> "base_url":"http://127.0.0.1:45318/us/dl"}
> [junit4:junit4] 2> 479510 T3396 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
> [junit4:junit4] 2> "operation":"state",
> [junit4:junit4] 2> "core_node_name":"core_node1",
> [junit4:junit4] 2> "numShards":"1",
> [junit4:junit4] 2> "shard":null,
> [junit4:junit4] 2> "roles":null,
> [junit4:junit4] 2> "state":"down",
> [junit4:junit4] 2> "shard_state":"active",
> [junit4:junit4] 2> "core":"collection1",
> [junit4:junit4] 2> "collection":"collection1",
> [junit4:junit4] 2> "shard_range":null,
> [junit4:junit4] 2> "node_name":"127.0.0.1:35711_us%2Fdl",
> [junit4:junit4] 2> "base_url":"http://127.0.0.1:35711/us/dl"}
> [junit4:junit4] 2> 479510 T3396 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 1
> [junit4:junit4] 2> 479511 T3396 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
> [junit4:junit4] 2> 479514 T3402 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4:junit4] 2> 479514 T3415 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4:junit4] 2> 479514 T3395 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4:junit4] 2> 480214 T3416 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
> [junit4:junit4] 2> 480215 T3416 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1372287632871/collection1
> [junit4:junit4] 2> 480215 T3416 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
> [junit4:junit4] 2> 480215 T3416 oasc.ZkController.createCollectionZkNode Collection zkNode exists
> [junit4:junit4] 2> 480216 T3416 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
> [junit4:junit4] 2> 480217 T3416 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1372287632871/collection1/'
> [junit4:junit4] 2> 480217 T3416 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty1-1372287632871/collection1/lib/README' to classloader
> [junit4:junit4] 2> 480218 T3416 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty1-1372287632871/collection1/lib/classes/' to classloader
> [junit4:junit4] 2> 480248 T3416 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
> [junit4:junit4] 2> 480298 T3416 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
> [junit4:junit4] 2> 480300 T3416 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
> [junit4:junit4] 2> 480303 T3416 oass.IndexSchema.readSchema [collection1] Schema name=test
> [junit4:junit4] 2> 480684 T3416 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
> [junit4:junit4] 2> 480690 T3416 oass.IndexSchema.readSchema default search field in schema is text
> [junit4:junit4] 2> 480692 T3416 oass.IndexSchema.readSchema unique key field: id
> [junit4:junit4] 2> 480706 T3416 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4:junit4] 2> 480708 T3416 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4:junit4] 2> 480711 T3416 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4:junit4] 2> 480712 T3416 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
> [junit4:junit4] 2> 480712 T3416 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
> [junit4:junit4] 2> 480713 T3416 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4:junit4] 2> 480713 T3416 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
> [junit4:junit4] 2> 480714 T3416 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
> [junit4:junit4] 2> 480714 T3416 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
> [junit4:junit4] 2> 480714 T3416 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1372287632871/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1372287629333/jetty1/
> [junit4:junit4] 2> 480714 T3416 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6652b6
> [junit4:junit4] 2> 480715 T3416 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1372287629333/jetty1
> [junit4:junit4] 2> 480715 T3416 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1372287629333/jetty1/index/
> [junit4:junit4] 2> 480715 T3416 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1372287629333/jetty1/index' doesn't exist. Creating new index...
> [junit4:junit4] 2> 480716 T3416 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1372287629333/jetty1/index
> [junit4:junit4] 2> 480717 T3416 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
> [junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1377ac4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@122d2d4),segFN=segments_1,generation=1}
> [junit4:junit4] 2> 480717 T3416 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
> [junit4:junit4] 2> 480719 T3416 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
> [junit4:junit4] 2> 480719 T3416 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
> [junit4:junit4] 2> 480720 T3416 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
> [junit4:junit4] 2> 480720 T3416 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
> [junit4:junit4] 2> 480720 T3416 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
> [junit4:junit4] 2> 480721 T3416 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
> [junit4:junit4] 2> 480721 T3416 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
> [junit4:junit4] 2> 480721 T3416 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
> [junit4:junit4] 2> 480722 T3416 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
> [junit4:junit4] 2> 480723 T3416 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
> [junit4:junit4] 2> 480726 T3416 oass.SolrIndexSearcher.<init> Opening Searcher@2f393d main
> [junit4:junit4] 2> 480727 T3416 oasu.CommitTracker.<init> Hard AutoCommit: disabled
> [junit4:junit4] 2> 480727 T3416 oasu.CommitTracker.<init> Soft AutoCommit: disabled
> [junit4:junit4] 2> 480730 T3417 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2f393d main{StandardDirectoryReader(segments_1:1)}
> [junit4:junit4] 2> 480732 T3416 oasc.CoreContainer.registerCore registering core: collection1
> [junit4:junit4] 2> 480732 T3416 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:35711/us/dl collection:collection1 shard:shard1
> [junit4:junit4] 2> 480733 T3416 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
> [junit4:junit4] 2> 480737 T3416 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
> [junit4:junit4] 2> 480739 T3416 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
> [junit4:junit4] 2> 480739 T3416 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
> [junit4:junit4] 2> 480739 T3416 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:35711/us/dl/collection1/
> [junit4:junit4] 2> 480740 T3416 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
> [junit4:junit4] 2> 480740 T3416 oasc.SyncStrategy.syncToMe http://127.0.0.1:35711/us/dl/collection1/ has no replicas
> [junit4:junit4] 2> 480740 T3416 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:35711/us/dl/collection1/ shard1
> [junit4:junit4] 2> 480740 T3416 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
> [junit4:junit4] 2> 481018 T3396 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 481023 T3395 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4:junit4] 2> 481023 T3415 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4:junit4] 2> 481023 T3402 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4:junit4] 2> 481046 T3416 oasc.ZkController.register We are http://127.0.0.1:35711/us/dl/collection1/ and leader is http://127.0.0.1:35711/us/dl/collection1/
> [junit4:junit4] 2> 481046 T3416 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:35711/us/dl
> [junit4:junit4] 2> 481046 T3416 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
> [junit4:junit4] 2> 481046 T3416 oasc.ZkController.publish publishing core=collection1 state=active
> [junit4:junit4] 2> 481047 T3416 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4] 2> 481048 T3416 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 481049 T3373 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
> [junit4:junit4] 2> 481049 T3373 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
> [junit4:junit4] 2> 481050 T3373 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4] 2> 481119 T3373 oejs.Server.doStart jetty-8.1.10.v20130312
> [junit4:junit4] 2> 481120 T3373 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:34479
> [junit4:junit4] 2> 481121 T3373 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
> [junit4:junit4] 2> 481121 T3373 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
> [junit4:junit4] 2> 481121 T3373 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1372287635882
> [junit4:junit4] 2> 481122 T3373 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1372287635882/solr.xml
> [junit4:junit4] 2> 481122 T3373 oasc.CoreContainer.<init> New CoreContainer 21929590
> [junit4:junit4] 2> 481122 T3373 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1372287635882/'
> [junit4:junit4] 2> 481123 T3373 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1372287635882/'
> [junit4:junit4] 2> 481173 T3373 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
> [junit4:junit4] 2> 481173 T3373 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
> [junit4:junit4] 2> 481174 T3373 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
> [junit4:junit4] 2> 481174 T3373 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
> [junit4:junit4] 2> 481174 T3373 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
> [junit4:junit4] 2> 481175 T3373 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
> [junit4:junit4] 2> 481175 T3373 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
> [junit4:junit4] 2> 481175 T3373 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
> [junit4:junit4] 2> 481175 T3373 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
> [junit4:junit4] 2> 481176 T3373 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
> [junit4:junit4] 2> 481179 T3373 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
> [junit4:junit4] 2> 481179 T3373 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:41964/solr
> [junit4:junit4] 2> 481180 T3373 oasc.ZkController.checkChrootPath zkHost includes chroot
> [junit4:junit4] 2> 481180 T3373 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4] 2> 481182 T3429 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@106d5f0 name:ZooKeeperConnection Watcher:127.0.0.1:41964 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4] 2> 481182 T3373 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4] 2> 481184 T3373 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
> [junit4:junit4] 2> 481188 T3373 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4] 2> 481190 T3431 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@afc5a0 name:ZooKeeperConnection Watcher:127.0.0.1:41964/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4] 2> 481190 T3373 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4] 2> 481193 T3373 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
> [junit4:junit4] 2> 482196 T3373 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34479_us%2Fdl
> [junit4:junit4] 2> 482197 T3373 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:34479_us%2Fdl
> [junit4:junit4] 2> 482199 T3395 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
> [junit4:junit4] 2> 482199 T3415 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
> [junit4:junit4] 2> 482200 T3402 oascc.ZkStateReader$3.process Updating live nodes... (3)
> [junit4:junit4] 2> 482200 T3402 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
> [junit4:junit4] 2> 482201 T3431 oascc.ZkStateReader$3.process Updating live nodes... (3)
> [junit4:junit4] 2> 482202 T3395 oascc.ZkStateReader$3.process Updating live nodes... (3)
> [junit4:junit4] 2> 482202 T3415 oascc.ZkStateReader$3.process Updating live nodes... (3)
> [junit4:junit4] 2> 482205 T3432 oasc.ZkController.publish publishing core=collection1 state=down
> [junit4:junit4] 2> 482205 T3432 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4] 2> 482206 T3432 oasc.ZkController.waitForCoreNodeName look for our core node name
> [junit4:junit4] 2> 482527 T3396 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 482528 T3396 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
> [junit4:junit4] 2> "operation":"state",
> [junit4:junit4] 2> "core_node_name":"core_node1",
> [junit4:junit4] 2> "numShards":"1",
> [junit4:junit4] 2> "shard":"shard1",
> [junit4:junit4] 2> "roles":null,
> [junit4:junit4] 2> "state":"active",
> [junit4:junit4] 2> "shard_state":"active",
> [junit4:junit4] 2> "core":"collection1",
> [junit4:junit4] 2> "collection":"collection1",
> [junit4:junit4] 2> "shard_range":null,
> [junit4:junit4] 2> "node_name":"127.0.0.1:35711_us%2Fdl",
> [junit4:junit4] 2> "base_url":"http://127.0.0.1:35711/us/dl"}
> [junit4:junit4] 2> 482531 T3396 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
> [junit4:junit4] 2> "operation":"state",
> [junit4:junit4] 2> "core_node_name":"core_node2",
> [junit4:junit4] 2> "numShards":"1",
> [junit4:junit4] 2> "shard":null,
> [junit4:junit4] 2> "roles":null,
> [junit4:junit4] 2> "state":"down",
> [junit4:junit4] 2> "shard_state":"active",
> [junit4:junit4] 2> "core":"collection1",
> [junit4:junit4] 2> "collection":"collection1",
> [junit4:junit4] 2> "shard_range":null,
> [junit4:junit4] 2> "node_name":"127.0.0.1:34479_us%2Fdl",
> [junit4:junit4] 2> "base_url":"http://127.0.0.1:34479/us/dl"}
> [junit4:junit4] 2> 482531 T3396 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
> [junit4:junit4] 2> 482531 T3396 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
> [junit4:junit4] 2> 482533 T3402 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4] 2> 482533 T3431 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4] 2> 482533 T3415 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4] 2> 482533 T3395 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4] 2> 483206 T3432 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
> [junit4:junit4] 2> 483207 T3432 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1372287635882/collection1
> [junit4:junit4] 2> 483207 T3432 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
> [junit4:junit4] 2> 483208 T3432 oasc.ZkController.createCollectionZkNode Collection zkNode exists
> [junit4:junit4] 2> 483208 T3432 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
> [junit4:junit4] 2> 483209 T3432 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1372287635882/collection1/'
> [junit4:junit4] 2> 483210 T3432 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty2-1372287635882/collection1/lib/README' to classloader
> [junit4:junit4] 2> 483210 T3432 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty2-1372287635882/collection1/lib/classes/' to classloader
> [junit4:junit4] 2> 483241 T3432 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
> [junit4:junit4] 2> 483271 T3432 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
> [junit4:junit4] 2> 483273 T3432 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
> [junit4:junit4] 2> 483276 T3432 oass.IndexSchema.readSchema [collection1] Schema name=test
> [junit4:junit4] 2> 483650 T3432 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
> [junit4:junit4] 2> 483659 T3432 oass.IndexSchema.readSchema default search field in schema is text
> [junit4:junit4] 2> 483662 T3432 oass.IndexSchema.readSchema unique key field: id
> [junit4:junit4] 2> 483675 T3432 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4:junit4] 2> 483677 T3432 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4:junit4] 2> 483680 T3432 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4:junit4] 2> 483681 T3432 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
> [junit4:junit4] 2> 483681 T3432 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
> [junit4:junit4] 2> 483681 T3432 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4:junit4] 2> 483682 T3432 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
> [junit4:junit4] 2> 483682 T3432 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
> [junit4:junit4] 2> 483682 T3432 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
> [junit4:junit4] 2> 483682 T3432 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1372287635882/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1372287629333/jetty2/
> [junit4:junit4] 2> 483683 T3432 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6652b6
> [junit4:junit4] 2> 483683 T3432 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1372287629333/jetty2
> [junit4:junit4] 2> 483683 T3432 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1372287629333/jetty2/index/
> [junit4:junit4] 2> 483684 T3432 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1372287629333/jetty2/index' doesn't exist. Creating new index...
> [junit4:junit4] 2> 483684 T3432 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1372287629333/jetty2/index
> [junit4:junit4] 2> 483685 T3432 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
> [junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1e1c9c1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@846e50),segFN=segments_1,generation=1}
> [junit4:junit4] 2> 483685 T3432 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
> [junit4:junit4] 2> 483687 T3432 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
> [junit4:junit4] 2> 483687 T3432 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
> [junit4:junit4] 2> 483688 T3432 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
> [junit4:junit4] 2> 483688 T3432 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
> [junit4:junit4] 2> 483688 T3432 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
> [junit4:junit4] 2> 483689 T3432 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
> [junit4:junit4] 2> 483689 T3432 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
> [junit4:junit4] 2> 483689 T3432 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
> [junit4:junit4] 2> 483690 T3432 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
> [junit4:junit4] 2> 483691 T3432 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
> [junit4:junit4] 2> 483693 T3432 oass.SolrIndexSearcher.<init> Opening Searcher@1e7a1f9 main
> [junit4:junit4] 2> 483694 T3432 oasu.CommitTracker.<init> Hard AutoCommit: disabled
> [junit4:junit4] 2> 483694 T3432 oasu.CommitTracker.<init> Soft AutoCommit: disabled
> [junit4:junit4] 2> 483699 T3433 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1e7a1f9 main{StandardDirectoryReader(segments_1:1)}
> [junit4:junit4] 2> 483701 T3432 oasc.CoreContainer.registerCore registering core: collection1
> [junit4:junit4] 2> 483701 T3432 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:34479/us/dl collection:collection1 shard:shard1
> [junit4:junit4] 2> 483704 T3432 oasc.ZkController.register We are http://127.0.0.1:34479/us/dl/collection1/ and leader is http://127.0.0.1:35711/us/dl/collection1/
> [junit4:junit4] 2> 483704 T3432 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:34479/us/dl
> [junit4:junit4] 2> 483704 T3432 oasc.ZkController.checkRecovery Core needs to recover:collection1
> [junit4:junit4] 2> 483704 T3432 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
> [junit4:junit4] 2> ASYNC NEW_CORE C2622 name=collection1 org.apache.solr.core.SolrCore@f6c3fe url=http://127.0.0.1:34479/us/dl/collection1 node=127.0.0.1:34479_us%2Fdl C2622_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, node_name=127.0.0.1:34479_us%2Fdl, base_url=http://127.0.0.1:34479/us/dl}
> [junit4:junit4] 2> 483705 T3434 C2622 P34479 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
> [junit4:junit4] 2> 483705 T3432 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 483705 T3434 C2622 P34479 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
> [junit4:junit4] 2> 483706 T3434 C2622 P34479 oasc.ZkController.publish publishing core=collection1 state=recovering
> [junit4:junit4] 2> 483706 T3434 C2622 P34479 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4] 2> 483707 T3373 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
> [junit4:junit4] 2> 483707 T3373 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
> [junit4:junit4] 2> 483707 T3434 C2622 P34479 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4] 2> 483708 T3373 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4] 2> 483713 T3411 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: core_node2, state: recovering, checkLive: true, onlyIfLeader: true
> [junit4:junit4] 2> 483783 T3373 oejs.Server.doStart jetty-8.1.10.v20130312
> [junit4:junit4] 2> 483785 T3373 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:40897
> [junit4:junit4] 2> 483785 T3373 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
> [junit4:junit4] 2> 483786 T3373 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
> [junit4:junit4] 2> 483786 T3373 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1372287638540
> [junit4:junit4] 2> 483787 T3373 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1372287638540/solr.xml
> [junit4:junit4] 2> 483787 T3373 oasc.CoreContainer.<init> New CoreContainer 6329101
> [junit4:junit4] 2> 483788 T3373 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1372287638540/'
> [junit4:junit4] 2> 483788 T3373 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1372287638540/'
> [junit4:junit4] 2> 483830 T3373 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
> [junit4:junit4] 2> 483830 T3373 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
> [junit4:junit4] 2> 483831 T3373 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
> [junit4:junit4] 2> 483831 T3373 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
> [junit4:junit4] 2> 483831 T3373 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
> [junit4:junit4] 2> 483832 T3373 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
> [junit4:junit4] 2> 483832 T3373 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
> [junit4:junit4] 2> 483832 T3373 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
> [junit4:junit4] 2> 483832 T3373 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
> [junit4:junit4] 2> 483833 T3373 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
> [junit4:junit4] 2> 483836 T3373 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
> [junit4:junit4] 2> 483836 T3373 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:41964/solr
> [junit4:junit4] 2> 483836 T3373 oasc.ZkController.checkChrootPath zkHost includes chroot
> [junit4:junit4] 2> 483837 T3373 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4] 2> 483839 T3446 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b0c5b4 name:ZooKeeperConnection Watcher:127.0.0.1:41964 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4] 2> 483839 T3373 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4] 2> 483840 T3373 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
> [junit4:junit4] 2> 483843 T3373 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4] 2> 483844 T3448 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f385f2 name:ZooKeeperConnection Watcher:127.0.0.1:41964/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4] 2> 483844 T3373 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4] 2> 483850 T3373 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
> [junit4:junit4] 2> 484038 T3396 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 484039 T3396 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
> [junit4:junit4] 2> "operation":"state",
> [junit4:junit4] 2> "core_node_name":"core_node2",
> [junit4:junit4] 2> "numShards":"1",
> [junit4:junit4] 2> "shard":"shard1",
> [junit4:junit4] 2> "roles":null,
> [junit4:junit4] 2> "state":"recovering",
> [junit4:junit4] 2> "shard_state":"active",
> [junit4:junit4] 2> "core":"collection1",
> [junit4:junit4] 2> "collection":"collection1",
> [junit4:junit4] 2> "shard_range":null,
> [junit4:junit4] 2> "node_name":"127.0.0.1:34479_us%2Fdl",
> [junit4:junit4] 2> "base_url":"http://127.0.0.1:34479/us/dl"}
> [junit4:junit4] 2> 484043 T3395 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4] 2> 484043 T3448 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4] 2> 484043 T3415 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4] 2> 484043 T3431 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4] 2> 484043 T3402 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4] 2> 484714 T3411 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: core_node2, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
> [junit4:junit4] 2> 484715 T3411 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=core_node2&state=recovering&nodeName=127.0.0.1:34479_us%252Fdl&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1002
> [junit4:junit4] 2> 484853 T3373 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40897_us%2Fdl
> [junit4:junit4] 2> 484854 T3373 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:40897_us%2Fdl
> [junit4:junit4] 2> 484856 T3395 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
> [junit4:junit4] 2> 484856 T3431 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
> [junit4:junit4] 2> 484856 T3415 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
> [junit4:junit4] 2> 484856 T3448 oascc.ZkStateReader$3.process Updating live nodes... (4)
> [junit4:junit4] 2> 484857 T3448 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
> [junit4:junit4] 2> 484857 T3402 oascc.ZkStateReader$3.process Updating live nodes... (4)
> [junit4:junit4] 2> 484857 T3402 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
> [junit4:junit4] 2> 484858 T3415 oascc.ZkStateReader$3.process Updating live nodes... (4)
> [junit4:junit4] 2> 484859 T3395 oascc.ZkStateReader$3.process Updating live nodes... (4)
> [junit4:junit4] 2> 484859 T3431 oascc.ZkStateReader$3.process Updating live nodes... (4)
> [junit4:junit4] 2> 484862 T3449 oasc.ZkController.publish publishing core=collection1 state=down
> [junit4:junit4] 2> 484862 T3449 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4] 2> 484863 T3449 oasc.ZkController.waitForCoreNodeName look for our core node name
> [junit4:junit4] 2> 485547 T3396 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 485548 T3396 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
> [junit4:junit4] 2> "operation":"state",
> [junit4:junit4] 2> "core_node_name":"core_node3",
> [junit4:junit4] 2> "numShards":"1",
> [junit4:junit4] 2> "shard":null,
> [junit4:junit4] 2> "roles":null,
> [junit4:junit4] 2> "state":"down",
> [junit4:junit4] 2> "shard_state":"active",
> [junit4:junit4] 2> "core":"collection1",
> [junit4:junit4] 2> "collection":"collection1",
> [junit4:junit4] 2> "shard_range":null,
> [junit4:junit4] 2> "node_name":"127.0.0.1:40897_us%2Fdl",
> [junit4:junit4] 2> "base_url":"http://127.0.0.1:40897/us/dl"}
> [junit4:junit4] 2> 485548 T3396 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
> [junit4:junit4] 2> 485548 T3396 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
> [junit4:junit4] 2> 485552 T3415 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4] 2> 485552 T3448 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4] 2> 485552 T3395 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4] 2> 485552 T3431 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4] 2> 485552 T3402 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4] 2> 485863 T3449 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
> [junit4:junit4] 2> 485864 T3449 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1372287638540/collection1
> [junit4:junit4] 2> 485864 T3449 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
> [junit4:junit4] 2> 485865 T3449 oasc.ZkController.createCollectionZkNode Collection zkNode exists
> [junit4:junit4] 2> 485865 T3449 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
> [junit4:junit4] 2> 485866 T3449 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1372287638540/collection1/'
> [junit4:junit4] 2> 485867 T3449 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty3-1372287638540/collection1/lib/README' to classloader
> [junit4:junit4] 2> 485867 T3449 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty3-1372287638540/collection1/lib/classes/' to classloader
> [junit4:junit4] 2> 485896 T3449 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
> [junit4:junit4] 2> 485937 T3449 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
> [junit4:junit4] 2> 485938 T3449 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
> [junit4:junit4] 2> 485942 T3449 oass.IndexSchema.readSchema [collection1] Schema name=test
> [junit4:junit4] 2> 486275 T3449 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
> [junit4:junit4] 2> 486280 T3449 oass.IndexSchema.readSchema default search field in schema is text
> [junit4:junit4] 2> 486283 T3449 oass.IndexSchema.readSchema unique key field: id
> [junit4:junit4] 2> 486295 T3449 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4:junit4] 2> 486298 T3449 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4:junit4] 2> 486301 T3449 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4:junit4] 2> 486302 T3449 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
> [junit4:junit4] 2> 486302 T3449 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
> [junit4:junit4] 2> 486302 T3449 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4:junit4] 2> 486303 T3449 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
> [junit4:junit4] 2> 486303 T3449 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
> [junit4:junit4] 2> 486303 T3449 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
> [junit4:junit4] 2> 486303 T3449 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1372287638540/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1372287629333/jetty3/
> [junit4:junit4] 2> 486303 T3449 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6652b6
> [junit4:junit4] 2> 486304 T3449 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1372287629333/jetty3
> [junit4:junit4] 2> 486304 T3449 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1372287629333/jetty3/index/
> [junit4:junit4] 2> 486304 T3449 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1372287629333/jetty3/index' doesn't exist. Creating new index...
> [junit4:junit4] 2> 486305 T3449 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1372287629333/jetty3/index
> [junit4:junit4] 2> 486306 T3449 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
> [junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1e84352 lockFactory=org.apache.lucene.store.NativeFSLockFactory@9388e),segFN=segments_1,generation=1}
> [junit4:junit4] 2> 486306 T3449 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
> [junit4:junit4] 2> 486307 T3449 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
> [junit4:junit4] 2> 486308 T3449 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
> [junit4:junit4] 2> 486308 T3449 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
> [junit4:junit4] 2> 486309 T3449 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
> [junit4:junit4] 2> 486309 T3449 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
> [junit4:junit4] 2> 486309 T3449 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
> [junit4:junit4] 2> 486309 T3449 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
> [junit4:junit4] 2> 486310 T3449 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
> [junit4:junit4] 2> 486310 T3449 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
> [junit4:junit4] 2> 486312 T3449 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
> [junit4:junit4] 2> 486314 T3449 oass.SolrIndexSearcher.<init> Opening Searcher@3b5a1 main
> [junit4:junit4] 2> 486314 T3449 oasu.CommitTracker.<init> Hard AutoCommit: disabled
> [junit4:junit4] 2> 486314 T3449 oasu.CommitTracker.<init> Soft AutoCommit: disabled
> [junit4:junit4] 2> 486318 T3450 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3b5a1 main{StandardDirectoryReader(segments_1:1)}
> [junit4:junit4] 2> 486319 T3449 oasc.CoreContainer.registerCore registering core: collection1
> [junit4:junit4] 2> 486319 T3449 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:40897/us/dl collection:collection1 shard:shard1
> [junit4:junit4] 2> 486323 T3449 oasc.ZkController.register We are http://127.0.0.1:40897/us/dl/collection1/ and leader is http://127.0.0.1:35711/us/dl/collection1/
> [junit4:junit4] 2> 486323 T3449 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:40897/us/dl
> [junit4:junit4] 2> 486323 T3449 oasc.ZkController.checkRecovery Core needs to recover:collection1
> [junit4:junit4] 2> 486323 T3449 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
> [junit4:junit4] 2> ASYNC NEW_CORE C2623 name=collection1 org.apache.solr.core.SolrCore@1b84571 url=http://127.0.0.1:40897/us/dl/collection1 node=127.0.0.1:40897_us%2Fdl C2623_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, node_name=127.0.0.1:40897_us%2Fdl, base_url=http://127.0.0.1:40897/us/dl}
> [junit4:junit4] 2> 486323 T3451 C2623 P40897 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
> [junit4:junit4] 2> 486324 T3449 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 486324 T3451 C2623 P40897 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
> [junit4:junit4] 2> 486324 T3451 C2623 P40897 oasc.ZkController.publish publishing core=collection1 state=recovering
> [junit4:junit4] 2> 486324 T3451 C2623 P40897 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4] 2> 486325 T3373 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
> [junit4:junit4] 2> 486325 T3373 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
> [junit4:junit4] 2> 486325 T3451 C2623 P40897 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4] 2> 486326 T3373 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4] 2> 486329 T3408 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: core_node3, state: recovering, checkLive: true, onlyIfLeader: true
> [junit4:junit4] 2> 486402 T3373 oejs.Server.doStart jetty-8.1.10.v20130312
> [junit4:junit4] 2> 486404 T3373 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:35810
> [junit4:junit4] 2> 486404 T3373 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
> [junit4:junit4] 2> 486405 T3373 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
> [junit4:junit4] 2> 486405 T3373 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1372287641157
> [junit4:junit4] 2> 486405 T3373 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1372287641157/solr.xml
> [junit4:junit4] 2> 486406 T3373 oasc.CoreContainer.<init> New CoreContainer 24034591
> [junit4:junit4] 2> 486406 T3373 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1372287641157/'
> [junit4:junit4] 2> 486406 T3373 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1372287641157/'
> [junit4:junit4] 2> 486460 T3373 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
> [junit4:junit4] 2> 486461 T3373 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
> [junit4:junit4] 2> 486461 T3373 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
> [junit4:junit4] 2> 486461 T3373 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
> [junit4:junit4] 2> 486461 T3373 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
> [junit4:junit4] 2> 486462 T3373 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
> [junit4:junit4] 2> 486462 T3373 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
> [junit4:junit4] 2> 486462 T3373 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
> [junit4:junit4] 2> 486463 T3373 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
> [junit4:junit4] 2> 486463 T3373 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
> [junit4:junit4] 2> 486466 T3373 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
> [junit4:junit4] 2> 486466 T3373 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:41964/solr
> [junit4:junit4] 2> 486467 T3373 oasc.ZkController.checkChrootPath zkHost includes chroot
> [junit4:junit4] 2> 486467 T3373 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4] 2> 486469 T3463 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b70ed4 name:ZooKeeperConnection Watcher:127.0.0.1:41964 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4] 2> 486469 T3373 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4] 2> 486470 T3373 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
> [junit4:junit4] 2> 486473 T3373 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
> [junit4:junit4] 2> 486474 T3465 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b30f29 name:ZooKeeperConnection Watcher:127.0.0.1:41964/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
> [junit4:junit4] 2> 486475 T3373 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
> [junit4:junit4] 2> 486478 T3373 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
> [junit4:junit4] 2> ASYNC NEW_CORE C2624 name=collection1 org.apache.solr.core.SolrCore@f6c3fe url=http://127.0.0.1:34479/us/dl/collection1 node=127.0.0.1:34479_us%2Fdl C2624_STATE=coll:collection1 core:collection1 props:{state=recovering, core=collection1, node_name=127.0.0.1:34479_us%2Fdl, base_url=http://127.0.0.1:34479/us/dl}
> [junit4:junit4] 2> 486715 T3434 C2624 P34479 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:35711/us/dl/collection1/ core=collection1 - recoveringAfterStartup=true
> [junit4:junit4] 2> 486716 T3434 C2624 P34479 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:34479/us/dl START replicas=[http://127.0.0.1:35711/us/dl/collection1/] nUpdates=100
> [junit4:junit4] 2> 486716 T3434 C2624 P34479 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
> [junit4:junit4] 2> 486716 T3434 C2624 P34479 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
> [junit4:junit4] 2> 486716 T3434 C2624 P34479 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
> [junit4:junit4] 2> 486716 T3434 C2624 P34479 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
> [junit4:junit4] 2> 486716 T3434 C2624 P34479 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
> [junit4:junit4] 2> 486717 T3434 C2624 P34479 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:35711/us/dl/collection1/. core=collection1
> [junit4:junit4] 2> 486717 T3434 C2624 P34479 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4] 2> ASYNC NEW_CORE C2625 name=collection1 org.apache.solr.core.SolrCore@66be85 url=http://127.0.0.1:35711/us/dl/collection1 node=127.0.0.1:35711_us%2Fdl C2625_STATE=coll:collection1 core:collection1 props:{state=active, core=collection1, node_name=127.0.0.1:35711_us%2Fdl, base_url=http://127.0.0.1:35711/us/dl, leader=true}
> [junit4:junit4] 2> 486722 T3409 C2625 P35711 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
> [junit4:junit4] 2> 486727 T3411 C2625 P35711 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
> [junit4:junit4] 2> 486778 T3411 C2625 P35711 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
> [junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1377ac4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@122d2d4),segFN=segments_1,generation=1}
> [junit4:junit4] 2> 486779 T3411 C2625 P35711 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
> [junit4:junit4] 2> 486779 T3411 C2625 P35711 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
> [junit4:junit4] 2> 486780 T3411 C2625 P35711 oass.SolrIndexSearcher.<init> Opening Searcher@10909c1 realtime
> [junit4:junit4] 2> 486780 T3411 C2625 P35711 oasu.DirectUpdateHandler2.commit end_commit_flush
> [junit4:junit4] 2> 486780 T3411 C2625 P35711 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 54
> [junit4:junit4] 2> 486781 T3434 C2624 P34479 oash.ReplicationHandler.inform Commits will be reserved for 10000
> [junit4:junit4] 2> 486781 T3434 C2624 P34479 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
> [junit4:junit4] 2> 486785 T3411 C2625 P35711 oash.ReplicationHandler.inform Commits will be reserved for 10000
> [junit4:junit4] 2> 486786 T3411 C2625 P35711 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=4
> [junit4:junit4] 2> 486786 T3434 C2624 P34479 oasc.RecoveryStrategy.replay No replay needed. core=collection1
> [junit4:junit4] 2> 486787 T3434 C2624 P34479 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
> [junit4:junit4] 2> 486787 T3434 C2624 P34479 oasc.ZkController.publish publishing core=collection1 state=active
> [junit4:junit4] 2> 486787 T3434 C2624 P34479 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4] 2> 486788 T3434 C2624 P34479 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
> [junit4:junit4] 2> 487056 T3396 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 487057 T3396 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
> [junit4:junit4] 2> "operation":"state",
> [junit4:junit4] 2> "core_node_name":"core_node3",
> [junit4:junit4] 2> "numShards":"1",
> [junit4:junit4] 2> "shard":"shard1",
> [junit4:junit4] 2> "roles":null,
> [junit4:junit4] 2> "state":"recovering",
> [junit4:junit4] 2> "shard_state":"active",
> [junit4:junit4] 2> "core":"collection1",
> [junit4:junit4] 2> "collection":"collection1",
> [junit4:junit4] 2> "shard_range":null,
> [junit4:junit4] 2> "node_name":"127.0.0.1:40897_us%2Fdl",
> [junit4:junit4] 2> "base_url":"http://127.0.0.1:40897/us/dl"}
> [junit4:junit4] 2> 487060 T3396 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
> [junit4:junit4] 2> "operation":"state",
> [junit4:junit4] 2> "core_node_name":"core_node2",
> [junit4:junit4] 2> "numShards":"1",
> [junit4:junit4] 2> "shard":"shard1",
> [junit4:junit4] 2> "roles":null,
> [junit4:junit4] 2> "state":"active",
> [junit4:junit4] 2> "shard_state":"active",
> [junit4:junit4] 2> "core":"collection1",
> [junit4:junit4] 2> "collection":"collection1",
> [junit4:junit4] 2> "shard_range":null,
> [junit4:junit4] 2> "node_name":"127.0.0.1:34479_us%2Fdl",
> [junit4:junit4] 2> "base_url":"http://127.0.0.1:34479/us/dl"}
> [junit4:junit4] 2> 487063 T3465 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4] 2> 487063 T3402 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4] 2> 487063 T3431 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4] 2> 487063 T3415 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4] 2> 487063 T3448 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4] 2> 487063 T3395 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
> [junit4:junit4] 2> 487330 T3408 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: core_node3, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
> [junit4:junit4] 2> 487330 T3408 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=core_node3&state=recovering&nodeName=127.0.0.1:40897_us%252Fdl&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1001
> [junit4:junit4] 2> 487481 T3373 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35810_us%2Fdl
> [junit4:junit4] 2> 487482 T3373 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:35810_us%2Fdl
> [junit4:junit4] 2> 487485 T3395 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
> [junit4:junit4] 2> 487485 T3431 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
> [junit4:junit4] 2> 487485 T3465 oascc.ZkStateReader$3.process Updating live nodes... (5)
> [junit4:junit4] 2> 487485 T3415 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
> [junit4:junit4] 2> 487486 T3448 oascc.ZkStateReader$3.process Updating live nodes... (5)
> [junit4:junit4] 2> 487485 T3465 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 487486 T3448 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 487486 T3402 oascc.ZkStateReader$3.process Updating live nodes... (5)
> [junit4:junit4] 2> 487487 T3402 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 487487 T3395 oascc.ZkStateReader$3.process Updating live nodes... (5)
> [junit4:junit4] 2> 487488 T3415 oascc.ZkStateReader$3.process Updating live nodes... (5)
> [junit4:junit4] 2> 487488 T3431 oascc.ZkStateReader$3.process Updating live nodes... (5)
> [junit4:junit4] 2> 487492 T3467 oasc.ZkController.publish publishing core=collection1 state=down
> [junit4:junit4] 2> 487492 T3467 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4] 2> 487494 T3467 oasc.ZkController.waitForCoreNodeName look for our core node name
> [junit4:junit4] 2> 488569 T3396 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 488570 T3396 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
> [junit4:junit4] 2> "operation":"state",
> [junit4:junit4] 2> "core_node_name":"core_node4",
> [junit4:junit4] 2> "numShards":"1",
> [junit4:junit4] 2> "shard":null,
> [junit4:junit4] 2> "roles":null,
> [junit4:junit4] 2> "state":"down",
> [junit4:junit4] 2> "shard_state":"active",
> [junit4:junit4] 2> "core":"collection1",
> [junit4:junit4] 2> "collection":"collection1",
> [junit4:junit4] 2> "shard_range":null,
> [junit4:junit4] 2> "node_name":"127.0.0.1:35810_us%2Fdl",
> [junit4:junit4] 2> "base_url":"http://127.0.0.1:35810/us/dl"}
> [junit4:junit4] 2> 488570 T3396 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
> [junit4:junit4] 2> 488570 T3396 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
> [junit4:junit4] 2> 488572 T3465 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 488573 T3415 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 488573 T3402 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 488573 T3395 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 488573 T3448 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 488573 T3431 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> ASYNC NEW_CORE C2626 name=collection1 org.apache.solr.core.SolrCore@1b84571 url=http://127.0.0.1:40897/us/dl/collection1 node=127.0.0.1:40897_us%2Fdl C2626_STATE=coll:collection1 core:collection1 props:{state=recovering, core=collection1, node_name=127.0.0.1:40897_us%2Fdl, base_url=http://127.0.0.1:40897/us/dl}
> [junit4:junit4] 2> 489331 T3451 C2626 P40897 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:35711/us/dl/collection1/ core=collection1 - recoveringAfterStartup=true
> [junit4:junit4] 2> 489331 T3451 C2626 P40897 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:40897/us/dl START replicas=[http://127.0.0.1:35711/us/dl/collection1/] nUpdates=100
> [junit4:junit4] 2> 489331 T3451 C2626 P40897 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
> [junit4:junit4] 2> 489332 T3451 C2626 P40897 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
> [junit4:junit4] 2> 489332 T3451 C2626 P40897 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
> [junit4:junit4] 2> 489332 T3451 C2626 P40897 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
> [junit4:junit4] 2> 489332 T3451 C2626 P40897 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
> [junit4:junit4] 2> 489332 T3451 C2626 P40897 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:35711/us/dl/collection1/. core=collection1
> [junit4:junit4] 2> 489332 T3451 C2626 P40897 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4] 2> 489333 T3409 C2625 P35711 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
> [junit4:junit4] 2> 489336 T3410 C2625 P35711 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
> [junit4:junit4] 2> 489336 T3410 C2625 P35711 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
> [junit4:junit4] 2> 489337 T3410 C2625 P35711 oasu.DirectUpdateHandler2.commit end_commit_flush
> [junit4:junit4] 2> 489337 T3410 C2625 P35711 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 1
> [junit4:junit4] 2> 489338 T3451 C2626 P40897 oash.ReplicationHandler.inform Commits will be reserved for 10000
> [junit4:junit4] 2> 489338 T3451 C2626 P40897 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
> [junit4:junit4] 2> 489340 T3409 C2625 P35711 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
> [junit4:junit4] 2> 489340 T3451 C2626 P40897 oasc.RecoveryStrategy.replay No replay needed. core=collection1
> [junit4:junit4] 2> 489340 T3451 C2626 P40897 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
> [junit4:junit4] 2> 489340 T3451 C2626 P40897 oasc.ZkController.publish publishing core=collection1 state=active
> [junit4:junit4] 2> 489341 T3451 C2626 P40897 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4] 2> 489342 T3451 C2626 P40897 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
> [junit4:junit4] 2> 489494 T3467 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
> [junit4:junit4] 2> 489494 T3467 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1372287641157/collection1
> [junit4:junit4] 2> 489494 T3467 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
> [junit4:junit4] 2> 489495 T3467 oasc.ZkController.createCollectionZkNode Collection zkNode exists
> [junit4:junit4] 2> 489495 T3467 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
> [junit4:junit4] 2> 489497 T3467 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1372287641157/collection1/'
> [junit4:junit4] 2> 489497 T3467 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty4-1372287641157/collection1/lib/README' to classloader
> [junit4:junit4] 2> 489497 T3467 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty4-1372287641157/collection1/lib/classes/' to classloader
> [junit4:junit4] 2> 489521 T3467 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
> [junit4:junit4] 2> 489551 T3467 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
> [junit4:junit4] 2> 489553 T3467 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
> [junit4:junit4] 2> 489556 T3467 oass.IndexSchema.readSchema [collection1] Schema name=test
> [junit4:junit4] 2> 489929 T3467 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
> [junit4:junit4] 2> 489937 T3467 oass.IndexSchema.readSchema default search field in schema is text
> [junit4:junit4] 2> 489941 T3467 oass.IndexSchema.readSchema unique key field: id
> [junit4:junit4] 2> 489953 T3467 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4:junit4] 2> 489956 T3467 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
> [junit4:junit4] 2> 489960 T3467 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4:junit4] 2> 489961 T3467 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
> [junit4:junit4] 2> 489961 T3467 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
> [junit4:junit4] 2> 489961 T3467 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
> [junit4:junit4] 2> 489962 T3467 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
> [junit4:junit4] 2> 489962 T3467 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
> [junit4:junit4] 2> 489962 T3467 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
> [junit4:junit4] 2> 489963 T3467 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1372287641157/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1372287629333/jetty4/
> [junit4:junit4] 2> 489963 T3467 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6652b6
> [junit4:junit4] 2> 489964 T3467 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1372287629333/jetty4
> [junit4:junit4] 2> 489964 T3467 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1372287629333/jetty4/index/
> [junit4:junit4] 2> 489964 T3467 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1372287629333/jetty4/index' doesn't exist. Creating new index...
> [junit4:junit4] 2> 489965 T3467 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1372287629333/jetty4/index
> [junit4:junit4] 2> 489966 T3467 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
> [junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@910690 lockFactory=org.apache.lucene.store.NativeFSLockFactory@63a241),segFN=segments_1,generation=1}
> [junit4:junit4] 2> 489967 T3467 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
> [junit4:junit4] 2> 489969 T3467 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
> [junit4:junit4] 2> 489969 T3467 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
> [junit4:junit4] 2> 489970 T3467 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
> [junit4:junit4] 2> 489971 T3467 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
> [junit4:junit4] 2> 489971 T3467 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
> [junit4:junit4] 2> 489972 T3467 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
> [junit4:junit4] 2> 489972 T3467 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
> [junit4:junit4] 2> 489973 T3467 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
> [junit4:junit4] 2> 489973 T3467 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
> [junit4:junit4] 2> 489976 T3467 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
> [junit4:junit4] 2> 489979 T3467 oass.SolrIndexSearcher.<init> Opening Searcher@9817d main
> [junit4:junit4] 2> 489980 T3467 oasu.CommitTracker.<init> Hard AutoCommit: disabled
> [junit4:junit4] 2> 489980 T3467 oasu.CommitTracker.<init> Soft AutoCommit: disabled
> [junit4:junit4] 2> 489985 T3469 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@9817d main{StandardDirectoryReader(segments_1:1)}
> [junit4:junit4] 2> 489987 T3467 oasc.CoreContainer.registerCore registering core: collection1
> [junit4:junit4] 2> 489987 T3467 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:35810/us/dl collection:collection1 shard:shard1
> [junit4:junit4] 2> 489989 T3467 oasc.ZkController.register We are http://127.0.0.1:35810/us/dl/collection1/ and leader is http://127.0.0.1:35711/us/dl/collection1/
> [junit4:junit4] 2> 489990 T3467 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:35810/us/dl
> [junit4:junit4] 2> 489990 T3467 oasc.ZkController.checkRecovery Core needs to recover:collection1
> [junit4:junit4] 2> 489990 T3467 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
> [junit4:junit4] 2> ASYNC NEW_CORE C2627 name=collection1 org.apache.solr.core.SolrCore@1bbb354 url=http://127.0.0.1:35810/us/dl/collection1 node=127.0.0.1:35810_us%2Fdl C2627_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, node_name=127.0.0.1:35810_us%2Fdl, base_url=http://127.0.0.1:35810/us/dl}
> [junit4:junit4] 2> 489990 T3470 C2627 P35810 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
> [junit4:junit4] 2> 489991 T3470 C2627 P35810 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
> [junit4:junit4] 2> 489991 T3467 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 489992 T3470 C2627 P35810 oasc.ZkController.publish publishing core=collection1 state=recovering
> [junit4:junit4] 2> 489992 T3470 C2627 P35810 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4] 2> 489993 T3373 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
> [junit4:junit4] 2> 489993 T3373 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
> [junit4:junit4] 2> 489993 T3470 C2627 P35810 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4] 2> 489994 T3373 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4] 2> 489998 T3373 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 489998 T3408 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: core_node4, state: recovering, checkLive: true, onlyIfLeader: true
> [junit4:junit4] 2> 489999 T3373 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 30 for each attempt
> [junit4:junit4] 2> 489999 T3373 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):30
> [junit4:junit4] 2> 490000 T3373 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 490076 T3396 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 490077 T3396 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
> [junit4:junit4] 2> "operation":"state",
> [junit4:junit4] 2> "core_node_name":"core_node3",
> [junit4:junit4] 2> "numShards":"1",
> [junit4:junit4] 2> "shard":"shard1",
> [junit4:junit4] 2> "roles":null,
> [junit4:junit4] 2> "state":"active",
> [junit4:junit4] 2> "shard_state":"active",
> [junit4:junit4] 2> "core":"collection1",
> [junit4:junit4] 2> "collection":"collection1",
> [junit4:junit4] 2> "shard_range":null,
> [junit4:junit4] 2> "node_name":"127.0.0.1:40897_us%2Fdl",
> [junit4:junit4] 2> "base_url":"http://127.0.0.1:40897/us/dl"}
> [junit4:junit4] 2> 490080 T3396 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
> [junit4:junit4] 2> "operation":"state",
> [junit4:junit4] 2> "core_node_name":"core_node4",
> [junit4:junit4] 2> "numShards":"1",
> [junit4:junit4] 2> "shard":"shard1",
> [junit4:junit4] 2> "roles":null,
> [junit4:junit4] 2> "state":"recovering",
> [junit4:junit4] 2> "shard_state":"active",
> [junit4:junit4] 2> "core":"collection1",
> [junit4:junit4] 2> "collection":"collection1",
> [junit4:junit4] 2> "shard_range":null,
> [junit4:junit4] 2> "node_name":"127.0.0.1:35810_us%2Fdl",
> [junit4:junit4] 2> "base_url":"http://127.0.0.1:35810/us/dl"}
> [junit4:junit4] 2> 490083 T3465 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 490084 T3431 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 490084 T3395 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 490083 T3448 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 490083 T3415 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 490083 T3402 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 490999 T3408 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: core_node4, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
> [junit4:junit4] 2> 490999 T3408 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=core_node4&state=recovering&nodeName=127.0.0.1:35810_us%252Fdl&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1001
> [junit4:junit4] 2> 491002 T3373 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 492003 T3373 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> C2627_STATE=coll:collection1 core:collection1 props:{state=recovering, core=collection1, node_name=127.0.0.1:35810_us%2Fdl, base_url=http://127.0.0.1:35810/us/dl}
> [junit4:junit4] 2> 493000 T3470 C2627 P35810 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:35711/us/dl/collection1/ core=collection1 - recoveringAfterStartup=true
> [junit4:junit4] 2> 493001 T3470 C2627 P35810 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:35810/us/dl START replicas=[http://127.0.0.1:35711/us/dl/collection1/] nUpdates=100
> [junit4:junit4] 2> 493001 T3470 C2627 P35810 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
> [junit4:junit4] 2> 493001 T3470 C2627 P35810 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
> [junit4:junit4] 2> 493002 T3470 C2627 P35810 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
> [junit4:junit4] 2> 493002 T3470 C2627 P35810 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
> [junit4:junit4] 2> 493002 T3470 C2627 P35810 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
> [junit4:junit4] 2> 493002 T3470 C2627 P35810 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:35711/us/dl/collection1/. core=collection1
> [junit4:junit4] 2> 493002 T3470 C2627 P35810 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4] 2> ASYNC NEW_CORE C2628 name=collection1 org.apache.solr.core.SolrCore@66be85 url=http://127.0.0.1:35711/us/dl/collection1 node=127.0.0.1:35711_us%2Fdl C2628_STATE=coll:collection1 core:collection1 props:{state=active, core=collection1, node_name=127.0.0.1:35711_us%2Fdl, base_url=http://127.0.0.1:35711/us/dl, leader=true}
> [junit4:junit4] 2> 493003 T3408 C2628 P35711 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
> [junit4:junit4] 2> 493005 T3373 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 493007 T3409 C2628 P35711 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
> [junit4:junit4] 2> 493007 T3409 C2628 P35711 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
> [junit4:junit4] 2> 493007 T3409 C2628 P35711 oasu.DirectUpdateHandler2.commit end_commit_flush
> [junit4:junit4] 2> 493008 T3409 C2628 P35711 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 1
> [junit4:junit4] 2> 493008 T3470 C2627 P35810 oash.ReplicationHandler.inform Commits will be reserved for 10000
> [junit4:junit4] 2> 493008 T3470 C2627 P35810 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
> [junit4:junit4] 2> 493010 T3411 C2628 P35711 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
> [junit4:junit4] 2> 493011 T3470 C2627 P35810 oasc.RecoveryStrategy.replay No replay needed. core=collection1
> [junit4:junit4] 2> 493011 T3470 C2627 P35810 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
> [junit4:junit4] 2> 493011 T3470 C2627 P35810 oasc.ZkController.publish publishing core=collection1 state=active
> [junit4:junit4] 2> 493011 T3470 C2627 P35810 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4] 2> 493012 T3470 C2627 P35810 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
> [junit4:junit4] 2> 493091 T3396 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 493092 T3396 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
> [junit4:junit4] 2> "operation":"state",
> [junit4:junit4] 2> "core_node_name":"core_node4",
> [junit4:junit4] 2> "numShards":"1",
> [junit4:junit4] 2> "shard":"shard1",
> [junit4:junit4] 2> "roles":null,
> [junit4:junit4] 2> "state":"active",
> [junit4:junit4] 2> "shard_state":"active",
> [junit4:junit4] 2> "core":"collection1",
> [junit4:junit4] 2> "collection":"collection1",
> [junit4:junit4] 2> "shard_range":null,
> [junit4:junit4] 2> "node_name":"127.0.0.1:35810_us%2Fdl",
> [junit4:junit4] 2> "base_url":"http://127.0.0.1:35810/us/dl"}
> [junit4:junit4] 2> 493095 T3465 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 493095 T3402 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 493096 T3431 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 493096 T3448 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 493095 T3415 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 493096 T3395 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 494007 T3373 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 494008 T3373 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
> [junit4:junit4] 2> ASYNC NEW_CORE C2629 name=collection1 org.apache.solr.core.SolrCore@c9abaa url=http://127.0.0.1:45318/us/dl/collection1 node=127.0.0.1:45318_us%2Fdl C2629_STATE=coll:control_collection core:collection1 props:{state=active, core=collection1, node_name=127.0.0.1:45318_us%2Fdl, base_url=http://127.0.0.1:45318/us/dl, leader=true}
> [junit4:junit4] 2> 494015 T3389 C2629 P45318 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
> [junit4:junit4] 2> 494067 T3389 C2629 P45318 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
> [junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@87873b lockFactory=org.apache.lucene.store.NativeFSLockFactory@1362817),segFN=segments_1,generation=1}
> [junit4:junit4] 2> 494068 T3389 C2629 P45318 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
> [junit4:junit4] 2> 494068 T3389 C2629 P45318 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
> [junit4:junit4] 2> 494069 T3389 C2629 P45318 oass.SolrIndexSearcher.<init> Opening Searcher@1b6266f main
> [junit4:junit4] 2> 494069 T3389 C2629 P45318 oasu.DirectUpdateHandler2.commit end_commit_flush
> [junit4:junit4] 2> 494070 T3399 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1b6266f main{StandardDirectoryReader(segments_1:1:nrt)}
> [junit4:junit4] 2> 494070 T3389 C2629 P45318 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 55
> [junit4:junit4] 2> C2627_STATE=coll:collection1 core:collection1 props:{state=active, core=collection1, node_name=127.0.0.1:35810_us%2Fdl, base_url=http://127.0.0.1:35810/us/dl}
> [junit4:junit4] 2> 494077 T3459 C2627 P35810 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:35711/us/dl/collection1/, StdNode: http://127.0.0.1:34479/us/dl/collection1/, StdNode: http://127.0.0.1:40897/us/dl/collection1/, StdNode: http://127.0.0.1:35810/us/dl/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
> [junit4:junit4] 2> 494081 T3458 C2627 P35810 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
> [junit4:junit4] 2> 494082 T3408 C2628 P35711 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
> [junit4:junit4] 2> 494082 T3408 C2628 P35711 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
> [junit4:junit4] 2> 494083 T3408 C2628 P35711 oass.SolrIndexSearcher.<init> Opening Searcher@18a7f21 main
> [junit4:junit4] 2> 494083 T3408 C2628 P35711 oasu.DirectUpdateHandler2.commit end_commit_flush
> [junit4:junit4] 2> 494084 T3417 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@18a7f21 main{StandardDirectoryReader(segments_1:1:nrt)}
> [junit4:junit4] 2> 494084 T3408 C2628 P35711 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 2
> [junit4:junit4] 2> ASYNC NEW_CORE C2630 name=collection1 org.apache.solr.core.SolrCore@1b84571 url=http://127.0.0.1:40897/us/dl/collection1 node=127.0.0.1:40897_us%2Fdl C2630_STATE=coll:collection1 core:collection1 props:{state=active, core=collection1, node_name=127.0.0.1:40897_us%2Fdl, base_url=http://127.0.0.1:40897/us/dl}
> [junit4:junit4] 2> 494085 T3442 C2630 P40897 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
> [junit4:junit4] 2> 494086 T3442 C2630 P40897 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
> [junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1e84352 lockFactory=org.apache.lucene.store.NativeFSLockFactory@9388e),segFN=segments_1,generation=1}
> [junit4:junit4] 2> 494087 T3442 C2630 P40897 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
> [junit4:junit4] 2> 494088 T3442 C2630 P40897 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
> [junit4:junit4] 2> 494088 T3442 C2630 P40897 oass.SolrIndexSearcher.<init> Opening Searcher@aa0b98 main
> [junit4:junit4] 2> 494088 T3442 C2630 P40897 oasu.DirectUpdateHandler2.commit end_commit_flush
> [junit4:junit4] 2> ASYNC NEW_CORE C2631 name=collection1 org.apache.solr.core.SolrCore@f6c3fe url=http://127.0.0.1:34479/us/dl/collection1 node=127.0.0.1:34479_us%2Fdl C2631_STATE=coll:collection1 core:collection1 props:{state=active, core=collection1, node_name=127.0.0.1:34479_us%2Fdl, base_url=http://127.0.0.1:34479/us/dl}
> [junit4:junit4] 2> 494089 T3427 C2631 P34479 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
> [junit4:junit4] 2> 494089 T3450 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@aa0b98 main{StandardDirectoryReader(segments_1:1:nrt)}
> [junit4:junit4] 2> 494090 T3442 C2630 P40897 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 5
> [junit4:junit4] 2> 494133 T3458 C2627 P35810 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
> [junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@910690 lockFactory=org.apache.lucene.store.NativeFSLockFactory@63a241),segFN=segments_1,generation=1}
> [junit4:junit4] 2> 494134 T3458 C2627 P35810 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
> [junit4:junit4] 2> 494134 T3458 C2627 P35810 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
> [junit4:junit4] 2> 494135 T3458 C2627 P35810 oass.SolrIndexSearcher.<init> Opening Searcher@1faf813 main
> [junit4:junit4] 2> 494135 T3458 C2627 P35810 oasu.DirectUpdateHandler2.commit end_commit_flush
> [junit4:junit4] 2> 494136 T3469 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1faf813 main{StandardDirectoryReader(segments_1:1:nrt)}
> [junit4:junit4] 2> 494136 T3458 C2627 P35810 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 55
> [junit4:junit4] 2> 494140 T3427 C2631 P34479 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
> [junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1e1c9c1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@846e50),segFN=segments_1,generation=1}
> [junit4:junit4] 2> 494141 T3427 C2631 P34479 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
> [junit4:junit4] 2> 494142 T3427 C2631 P34479 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
> [junit4:junit4] 2> 494142 T3427 C2631 P34479 oass.SolrIndexSearcher.<init> Opening Searcher@1988262 main
> [junit4:junit4] 2> 494143 T3427 C2631 P34479 oasu.DirectUpdateHandler2.commit end_commit_flush
> [junit4:junit4] 2> 494143 T3433 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1988262 main{StandardDirectoryReader(segments_1:1:nrt)}
> [junit4:junit4] 2> 494144 T3427 C2631 P34479 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 56
> [junit4:junit4] 2> 494145 T3459 C2627 P35810 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 68
> [junit4:junit4] 2> 494145 T3373 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 494147 T3410 C2628 P35711 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
> [junit4:junit4] 2> 494149 T3426 C2631 P34479 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
> [junit4:junit4] 2> 494151 T3443 C2630 P40897 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
> [junit4:junit4] 2> 494152 T3460 C2627 P35810 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
> [junit4:junit4] 2> 496156 T3389 C2629 P45318 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1438947895918198784)} 0 1
> [junit4:junit4] 2> 496163 T3461 C2627 P35810 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={update.distrib=FROMLEADER&_version_=-1438947895922393088&update.from=http://127.0.0.1:35711/us/dl/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1438947895922393088)} 0 1
> [junit4:junit4] 2> 496163 T3425 C2631 P34479 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={update.distrib=FROMLEADER&_version_=-1438947895922393088&update.from=http://127.0.0.1:35711/us/dl/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1438947895922393088)} 0 1
> [junit4:junit4] 2> 496163 T3443 C2630 P40897 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={update.distrib=FROMLEADER&_version_=-1438947895922393088&update.from=http://127.0.0.1:35711/us/dl/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1438947895922393088)} 0 1
> [junit4:junit4] 2> 496164 T3411 C2628 P35711 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={update.distrib=TOLEADER&wt=javabin&version=2} {deleteByQuery=*:* (-1438947895922393088)} 0 5
> [junit4:junit4] 2> 496165 T3426 C2631 P34479 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={wt=javabin&version=2} {deleteByQuery=*:*} 0 8
> [junit4:junit4] 2> 496168 T3391 C2629 P45318 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={wt=javabin&version=2} {add=[0 (1438947895930781696)]} 0 1
> [junit4:junit4] 2> 496173 T3458 C2627 P35810 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={distrib.from=http://127.0.0.1:35711/us/dl/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1438947895933927424)]} 0 1
> [junit4:junit4] 2> 496173 T3427 C2631 P34479 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={distrib.from=http://127.0.0.1:35711/us/dl/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1438947895933927424)]} 0 1
> [junit4:junit4] 2> 496173 T3441 C2630 P40897 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={distrib.from=http://127.0.0.1:35711/us/dl/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1438947895933927424)]} 0 1
> [junit4:junit4] 2> 496174 T3408 C2628 P35711 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={distrib.from=http://127.0.0.1:40897/us/dl/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[0 (1438947895933927424)]} 0 4
> [junit4:junit4] 2> 496174 T3442 C2630 P40897 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={wt=javabin&version=2} {add=[0]} 0 5
> [junit4:junit4] 2> 496177 T3390 C2629 P45318 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={wt=javabin&version=2} {add=[1 (1438947895940218880)]} 0 1
> [junit4:junit4] 2> 496184 T3459 C2627 P35810 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={distrib.from=http://127.0.0.1:35711/us/dl/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1438947895945461760)]} 0 1
> [junit4:junit4] 2> 496184 T3424 C2631 P34479 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={distrib.from=http://127.0.0.1:35711/us/dl/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1438947895945461760)]} 0 1
> [junit4:junit4] 2> 496184 T3444 C2630 P40897 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={distrib.from=http://127.0.0.1:35711/us/dl/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1438947895945461760)]} 0 1
> [junit4:junit4] 2> 496185 T3409 C2628 P35711 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={distrib.from=http://127.0.0.1:40897/us/dl/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[1 (1438947895945461760)]} 0 4
> [junit4:junit4] 2> 496185 T3443 C2630 P40897 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={wt=javabin&version=2} {add=[1]} 0 6
> [junit4:junit4] 2> 496188 T3388 C2629 P45318 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={wt=javabin&version=2} {add=[2 (1438947895951753216)]} 0 1
> [junit4:junit4] 2> 496192 T3410 C2628 P35711 oasup.DistributedUpdateProcessor.setupRequest test.distrib.skip.servers was found and contains:[http://127.0.0.1:34479/us/dl/collection1/]
> [junit4:junit4] 2> 496192 T3410 C2628 P35711 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:34479/us/dl/collection1/ against:[http://127.0.0.1:34479/us/dl/collection1/] result:true
> [junit4:junit4] 2> 496192 T3410 C2628 P35711 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:40897/us/dl/collection1/ against:[http://127.0.0.1:34479/us/dl/collection1/] result:false
> [junit4:junit4] 2> 496193 T3410 C2628 P35711 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:35810/us/dl/collection1/ against:[http://127.0.0.1:34479/us/dl/collection1/] result:false
> [junit4:junit4] 2> 496196 T3441 C2630 P40897 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={distrib.from=http://127.0.0.1:35711/us/dl/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:34479/us/dl/collection1/&wt=javabin&version=2} {add=[2 (1438947895958044672)]} 0 1
> [junit4:junit4] 2> 496196 T3460 C2627 P35810 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={distrib.from=http://127.0.0.1:35711/us/dl/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:34479/us/dl/collection1/&wt=javabin&version=2} {add=[2 (1438947895958044672)]} 0 1
> [junit4:junit4] 2> 496196 T3410 C2628 P35711 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={distrib.from=http://127.0.0.1:34479/us/dl/collection1/&update.distrib=TOLEADER&test.distrib.skip.servers=http://127.0.0.1:34479/us/dl/collection1/&wt=javabin&version=2} {add=[2 (1438947895958044672)]} 0 4
> [junit4:junit4] 2> 496197 T3425 C2631 P34479 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={test.distrib.skip.servers=http://127.0.0.1:34479/us/dl/collection1/&wt=javabin&version=2} {add=[2]} 0 7
> [junit4:junit4] 2> 496199 T3389 C2629 P45318 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={wt=javabin&version=2} {add=[3 (1438947895964336128)]} 0 0
> [junit4:junit4] 2> 496204 T3411 C2628 P35711 oasup.DistributedUpdateProcessor.setupRequest test.distrib.skip.servers was found and contains:[http://127.0.0.1:34479/us/dl/collection1/]
> [junit4:junit4] 2> 496204 T3411 C2628 P35711 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:34479/us/dl/collection1/ against:[http://127.0.0.1:34479/us/dl/collection1/] result:true
> [junit4:junit4] 2> 496204 T3411 C2628 P35711 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:40897/us/dl/collection1/ against:[http://127.0.0.1:34479/us/dl/collection1/] result:false
> [junit4:junit4] 2> 496205 T3411 C2628 P35711 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:35810/us/dl/collection1/ against:[http://127.0.0.1:34479/us/dl/collection1/] result:false
> [junit4:junit4] 2> 496208 T3459 C2627 P35810 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={distrib.from=http://127.0.0.1:35711/us/dl/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:34479/us/dl/collection1/&wt=javabin&version=2} {add=[3 (1438947895970627584)]} 0 1
> [junit4:junit4] 2> 496208 T3442 C2630 P40897 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={distrib.from=http://127.0.0.1:35711/us/dl/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:34479/us/dl/collection1/&wt=javabin&version=2} {add=[3 (1438947895970627584)]} 0 1
> [junit4:junit4] 2> 496209 T3411 C2628 P35711 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={distrib.from=http://127.0.0.1:35810/us/dl/collection1/&update.distrib=TOLEADER&test.distrib.skip.servers=http://127.0.0.1:34479/us/dl/collection1/&wt=javabin&version=2} {add=[3 (1438947895970627584)]} 0 5
> [junit4:junit4] 2> 496209 T3461 C2627 P35810 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={test.distrib.skip.servers=http://127.0.0.1:34479/us/dl/collection1/&test.distrib.skip.servers=http://127.0.0.1:40897/us/dl/collection1/&wt=javabin&version=2} {add=[3]} 0 7
> [junit4:junit4] 2> 496211 T3391 C2629 P45318 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
> [junit4:junit4] 2> 496216 T3391 C2629 P45318 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
> [junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@87873b lockFactory=org.apache.lucene.store.NativeFSLockFactory@1362817),segFN=segments_1,generation=1}
> [junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@87873b lockFactory=org.apache.lucene.store.NativeFSLockFactory@1362817),segFN=segments_2,generation=2}
> [junit4:junit4] 2> 496216 T3391 C2629 P45318 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
> [junit4:junit4] 2> 496222 T3391 C2629 P45318 oass.SolrIndexSearcher.<init> Opening Searcher@16309fb main
> [junit4:junit4] 2> 496223 T3391 C2629 P45318 oasu.DirectUpdateHandler2.commit end_commit_flush
> [junit4:junit4] 2> 496224 T3399 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@16309fb main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):c4)}
> [junit4:junit4] 2> 496225 T3391 C2629 P45318 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 14
> [junit4:junit4] 2> 496228 T3444 C2630 P40897 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:35711/us/dl/collection1/, StdNode: http://127.0.0.1:34479/us/dl/collection1/, StdNode: http://127.0.0.1:40897/us/dl/collection1/, StdNode: http://127.0.0.1:35810/us/dl/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
> [junit4:junit4] 2> 496230 T3408 C2628 P35711 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
> [junit4:junit4] 2> 496231 T3426 C2631 P34479 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
> [junit4:junit4] 2> 496231 T3458 C2627 P35810 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
> [junit4:junit4] 2> 496233 T3441 C2630 P40897 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
> [junit4:junit4] 2> 496233 T3408 C2628 P35711 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
> [junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1377ac4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@122d2d4),segFN=segments_1,generation=1}
> [junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1377ac4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@122d2d4),segFN=segments_2,generation=2}
> [junit4:junit4] 2> 496234 T3408 C2628 P35711 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
> [junit4:junit4] 2> 496234 T3426 C2631 P34479 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
> [junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1e1c9c1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@846e50),segFN=segments_1,generation=1}
> [junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1e1c9c1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@846e50),segFN=segments_2,generation=2}
> [junit4:junit4] 2> 496234 T3408 C2628 P35711 oass.SolrIndexSearcher.<init> Opening Searcher@16159f9 main
> [junit4:junit4] 2> 496235 T3426 C2631 P34479 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
> [junit4:junit4] 2> 496234 T3458 C2627 P35810 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
> [junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@910690 lockFactory=org.apache.lucene.store.NativeFSLockFactory@63a241),segFN=segments_1,generation=1}
> [junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@910690 lockFactory=org.apache.lucene.store.NativeFSLockFactory@63a241),segFN=segments_2,generation=2}
> [junit4:junit4] 2> 496235 T3417 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@16159f9 main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):c4)}
> [junit4:junit4] 2> 496235 T3441 C2630 P40897 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
> [junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1e84352 lockFactory=org.apache.lucene.store.NativeFSLockFactory@9388e),segFN=segments_1,generation=1}
> [junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1e84352 lockFactory=org.apache.lucene.store.NativeFSLockFactory@9388e),segFN=segments_2,generation=2}
> [junit4:junit4] 2> 496236 T3441 C2630 P40897 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
> [junit4:junit4] 2> 496235 T3408 C2628 P35711 oasu.DirectUpdateHandler2.commit end_commit_flush
> [junit4:junit4] 2> 496236 T3426 C2631 P34479 oass.SolrIndexSearcher.<init> Opening Searcher@b0167c main
> [junit4:junit4] 2> 496235 T3458 C2627 P35810 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
> [junit4:junit4] 2> 496237 T3426 C2631 P34479 oasu.DirectUpdateHandler2.commit end_commit_flush
> [junit4:junit4] 2> 496238 T3433 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@b0167c main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):c2)}
> [junit4:junit4] 2> 496237 T3441 C2630 P40897 oass.SolrIndexSearcher.<init> Opening Searcher@137690f main
> [junit4:junit4] 2> 496237 T3408 C2628 P35711 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
> [junit4:junit4] 2> 496238 T3441 C2630 P40897 oasu.DirectUpdateHandler2.commit end_commit_flush
> [junit4:junit4] 2> 496238 T3426 C2631 P34479 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
> [junit4:junit4] 2> 496238 T3458 C2627 P35810 oass.SolrIndexSearcher.<init> Opening Searcher@1a48514 main
> [junit4:junit4] 2> 496239 T3450 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@137690f main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):c4)}
> [junit4:junit4] 2> 496239 T3458 C2627 P35810 oasu.DirectUpdateHandler2.commit end_commit_flush
> [junit4:junit4] 2> 496240 T3441 C2630 P40897 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
> [junit4:junit4] 2> 496240 T3469 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1a48514 main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):c4)}
> [junit4:junit4] 2> 496240 T3458 C2627 P35810 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 9
> [junit4:junit4] 2> 496241 T3444 C2630 P40897 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 13
> [junit4:junit4] 2> 496241 T3373 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):330
> [junit4:junit4] 2> 496242 T3373 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 496243 T3373 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
> [junit4:junit4] 2> 496245 T3409 C2628 P35711 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=0
> [junit4:junit4] 2> 496247 T3427 C2631 P34479 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=2 status=0 QTime=0
> [junit4:junit4] 2> 496249 T3442 C2630 P40897 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=0
> [junit4:junit4] 2> 496251 T3459 C2627 P35810 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=0
> [junit4:junit4] 2> 496253 T3373 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4] 2> 496258 T3443 oasha.CollectionsHandler.handleSyncShardAction Syncing shard : shard=shard1&action=SYNCSHARD&collection=collection1&wt=javabin&version=2
> [junit4:junit4] 2> 496258 T3443 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4] 2> 496263 T3410 oasha.CoreAdminHandler.handleRequestSyncAction I have been requested to sync up my shard
> [junit4:junit4] 2> 496263 T3410 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:35711/us/dl/collection1/
> [junit4:junit4] 2> 496264 T3410 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:35711/us/dl START replicas=[http://127.0.0.1:34479/us/dl/collection1/, http://127.0.0.1:40897/us/dl/collection1/, http://127.0.0.1:35810/us/dl/collection1/] nUpdates=100
> [junit4:junit4] 2> 496265 T3424 C2631 P34479 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
> [junit4:junit4] 2> 496265 T3444 C2630 P40897 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
> [junit4:junit4] 2> 496265 T3410 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:35711/us/dl Received 3 versions from 127.0.0.1:34479/us/dl/collection1/
> [junit4:junit4] 2> 496265 T3460 C2627 P35810 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
> [junit4:junit4] 2> 496266 T3410 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:35711/us/dl Our versions are newer. ourLowThreshold=1438947895922393088 otherHigh=1438947895945461760
> [junit4:junit4] 2> 496266 T3410 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:35711/us/dl Received 5 versions from 127.0.0.1:40897/us/dl/collection1/
> [junit4:junit4] 2> 496267 T3410 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:35711/us/dl Our versions are newer. ourLowThreshold=1438947895922393088 otherHigh=1438947895958044672
> [junit4:junit4] 2> 496267 T3410 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:35711/us/dl Received 5 versions from 127.0.0.1:35810/us/dl/collection1/
> [junit4:junit4] 2> 496267 T3410 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:35711/us/dl Our versions are newer. ourLowThreshold=1438947895922393088 otherHigh=1438947895958044672
> [junit4:junit4] 2> 496267 T3410 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:35711/us/dl DONE. sync succeeded
> [junit4:junit4] 2> 496267 T3410 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
> [junit4:junit4] 2> 496268 T3410 oasc.SyncStrategy.syncToMe http://127.0.0.1:35711/us/dl/collection1/: try and ask http://127.0.0.1:34479/us/dl/collection1/ to sync
> [junit4:junit4] 2> 496268 T3410 oasc.SyncStrategy.syncToMe http://127.0.0.1:35711/us/dl/collection1/: try and ask http://127.0.0.1:40897/us/dl/collection1/ to sync
> [junit4:junit4] 2> 496268 T3410 oasc.SyncStrategy.syncToMe http://127.0.0.1:35711/us/dl/collection1/: try and ask http://127.0.0.1:35810/us/dl/collection1/ to sync
> [junit4:junit4] 2> 496269 T3426 C2631 P34479 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:34479/us/dl START replicas=[http://127.0.0.1:35711/us/dl/collection1/] nUpdates=100
> [junit4:junit4] 2> 496270 T3442 C2630 P40897 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:40897/us/dl START replicas=[http://127.0.0.1:35711/us/dl/collection1/] nUpdates=100
> [junit4:junit4] 2> 496270 T3458 C2627 P35810 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:35810/us/dl START replicas=[http://127.0.0.1:35711/us/dl/collection1/] nUpdates=100
> [junit4:junit4] 2> 496271 T3411 C2628 P35711 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
> [junit4:junit4] 2> 496271 T3408 C2628 P35711 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
> [junit4:junit4] 2> 496272 T3409 C2628 P35711 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
> [junit4:junit4] 2> 496272 T3442 C2630 P40897 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:40897/us/dl Received 5 versions from 127.0.0.1:35711/us/dl/collection1/
> [junit4:junit4] 2> 496272 T3426 C2631 P34479 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:34479/us/dl Received 5 versions from 127.0.0.1:35711/us/dl/collection1/
> [junit4:junit4] 2> 496272 T3458 C2627 P35810 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:35810/us/dl Received 5 versions from 127.0.0.1:35711/us/dl/collection1/
> [junit4:junit4] 2> 496272 T3426 C2631 P34479 oasu.PeerSync.requestUpdates PeerSync: core=collection1 url=http://127.0.0.1:34479/us/dl Requesting updates from 127.0.0.1:35711/us/dl/collection1/n=2 versions=[1438947895970627584, 1438947895958044672]
> [junit4:junit4] 2> 496272 T3442 C2630 P40897 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:40897/us/dl Our versions are newer. ourLowThreshold=1438947895922393088 otherHigh=1438947895958044672
> [junit4:junit4] 2> 496273 T3458 C2627 P35810 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:35810/us/dl Our versions are newer. ourLowThreshold=1438947895922393088 otherHigh=1438947895958044672
> [junit4:junit4] 2> 496273 T3442 C2630 P40897 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:40897/us/dl DONE. sync succeeded
> [junit4:junit4] 2> 496274 T3458 C2627 P35810 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:35810/us/dl DONE. sync succeeded
> [junit4:junit4] 2> 496274 T3442 C2630 P40897 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/get params={sync=http://127.0.0.1:35711/us/dl/collection1/&getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=4
> [junit4:junit4] 2> 496274 T3458 C2627 P35810 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/get params={sync=http://127.0.0.1:35711/us/dl/collection1/&getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=4
> [junit4:junit4] 2> 496275 T3410 oasc.SyncStrategy.syncToMe http://127.0.0.1:35711/us/dl/collection1/: sync completed with http://127.0.0.1:40897/us/dl/collection1/
> [junit4:junit4] 2> 496275 T3411 C2628 P35711 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/get params={distrib=false&getUpdates=1438947895970627584,1438947895958044672&wt=javabin&qt=/get&version=2} status=0 QTime=0
> [junit4:junit4] 2> 496275 T3410 oasc.SyncStrategy.syncToMe http://127.0.0.1:35711/us/dl/collection1/: sync completed with http://127.0.0.1:35810/us/dl/collection1/
> [junit4:junit4] 2> 496278 T3426 C2631 P34479 oasup.LogUpdateProcessor.finish [collection1] {add=[2 (1438947895958044672), 3 (1438947895970627584)]} 0 2
> [junit4:junit4] 2> 496278 T3426 C2631 P34479 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:34479/us/dl DONE. sync succeeded
> [junit4:junit4] 2> 496278 T3426 C2631 P34479 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/get params={sync=http://127.0.0.1:35711/us/dl/collection1/&getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=9
> [junit4:junit4] 2> 496279 T3410 oasc.SyncStrategy.syncToMe http://127.0.0.1:35711/us/dl/collection1/: sync completed with http://127.0.0.1:34479/us/dl/collection1/
> [junit4:junit4] 2> 496279 T3410 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={shard=shard1&action=REQUESTSYNCSHARD&core=collection1&collection=collection1&wt=javabin&version=2} status=0 QTime=16
> [junit4:junit4] 2> 496280 T3443 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/collections params={shard=shard1&action=SYNCSHARD&collection=collection1&wt=javabin&version=2} status=0 QTime=24
> [junit4:junit4] 2> 496280 T3373 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
> [junit4:junit4] 2> 496280 T3373 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
> [junit4:junit4] 2> 496281 T3373 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 496282 T3373 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
> [junit4:junit4] 2> 496284 T3390 C2629 P45318 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
> [junit4:junit4] 2> 496284 T3390 C2629 P45318 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
> [junit4:junit4] 2> 496285 T3390 C2629 P45318 oass.SolrIndexSearcher.<init> Opening Searcher@fe1fae main
> [junit4:junit4] 2> 496285 T3390 C2629 P45318 oasu.DirectUpdateHandler2.commit end_commit_flush
> [junit4:junit4] 2> 496286 T3399 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@fe1fae main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):c4)}
> [junit4:junit4] 2> 496286 T3390 C2629 P45318 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 2
> [junit4:junit4] 2> 496288 T3441 C2630 P40897 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:35711/us/dl/collection1/, StdNode: http://127.0.0.1:34479/us/dl/collection1/, StdNode: http://127.0.0.1:40897/us/dl/collection1/, StdNode: http://127.0.0.1:35810/us/dl/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
> [junit4:junit4] 2> 496290 T3408 C2628 P35711 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
> [junit4:junit4] 2> 496290 T3408 C2628 P35711 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
> [junit4:junit4] 2> 496290 T3427 C2631 P34479 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
> [junit4:junit4] 2> 496290 T3459 C2627 P35810 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
> [junit4:junit4] 2> 496290 T3444 C2630 P40897 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
> [junit4:junit4] 2> 496291 T3444 C2630 P40897 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
> [junit4:junit4] 2> 496291 T3459 C2627 P35810 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
> [junit4:junit4] 2> 496290 T3408 C2628 P35711 oass.SolrIndexSearcher.<init> Opening Searcher@f9b6e main
> [junit4:junit4] 2> 496292 T3459 C2627 P35810 oass.SolrIndexSearcher.<init> Opening Searcher@1696bd main
> [junit4:junit4] 2> 496292 T3444 C2630 P40897 oass.SolrIndexSearcher.<init> Opening Searcher@10b75ce main
> [junit4:junit4] 2> 496294 T3427 C2631 P34479 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
> [junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1e1c9c1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@846e50),segFN=segments_2,generation=2}
> [junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1e1c9c1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@846e50),segFN=segments_3,generation=3}
> [junit4:junit4] 2> 496295 T3469 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1696bd main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):c4)}
> [junit4:junit4] 2> 496295 T3427 C2631 P34479 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
> [junit4:junit4] 2> 496295 T3444 C2630 P40897 oasu.DirectUpdateHandler2.commit end_commit_flush
> [junit4:junit4] 2> 496293 T3417 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@f9b6e main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):c4)}
> [junit4:junit4] 2> 496293 T3459 C2627 P35810 oasu.DirectUpdateHandler2.commit end_commit_flush
> [junit4:junit4] 2> 496292 T3408 C2628 P35711 oasu.DirectUpdateHandler2.commit end_commit_flush
> [junit4:junit4] 2> 496296 T3459 C2627 P35810 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
> [junit4:junit4] 2> 496296 T3427 C2631 P34479 oass.SolrIndexSearcher.<init> Opening Searcher@1328fcc main
> [junit4:junit4] 2> 496295 T3450 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@10b75ce main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):c4)}
> [junit4:junit4] 2> 496298 T3427 C2631 P34479 oasu.DirectUpdateHandler2.commit end_commit_flush
> [junit4:junit4] 2> 496297 T3408 C2628 P35711 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
> [junit4:junit4] 2> 496298 T3433 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1328fcc main{StandardDirectoryReader(segments_3:5:nrt _0(5.0):c2 _1(5.0):c2)}
> [junit4:junit4] 2> 496298 T3444 C2630 P40897 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 8
> [junit4:junit4] 2> 496299 T3427 C2631 P34479 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 9
> [junit4:junit4] 2> 496300 T3441 C2630 P40897 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 12
> [junit4:junit4] 2> 496301 T3373 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 496304 T3409 C2628 P35711 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=0
> [junit4:junit4] 2> 496306 T3424 C2631 P34479 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=0
> [junit4:junit4] 2> 496309 T3442 C2630 P40897 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=1
> [junit4:junit4] 2> 496311 T3461 C2627 P35810 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=0
> [junit4:junit4] 2> 498312 T3373 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> check const of shard1
> [junit4:junit4] 2> client0
> [junit4:junit4] 2> PROPS:core_node1:{"state":"active","core":"collection1","node_name":"127.0.0.1:35711_us%2Fdl","base_url":"http://127.0.0.1:35711/us/dl","leader":"true"}
> [junit4:junit4] 2> 498315 T3408 C2628 P35711 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=0
> [junit4:junit4] 2> live:true
> [junit4:junit4] 2> num:4
> [junit4:junit4] 2>
> [junit4:junit4] 2> client1
> [junit4:junit4] 2> PROPS:core_node2:{"state":"active","core":"collection1","node_name":"127.0.0.1:34479_us%2Fdl","base_url":"http://127.0.0.1:34479/us/dl"}
> [junit4:junit4] 2> 498317 T3427 C2631 P34479 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=0
> [junit4:junit4] 2> live:true
> [junit4:junit4] 2> num:4
> [junit4:junit4] 2>
> [junit4:junit4] 2> client2
> [junit4:junit4] 2> PROPS:core_node3:{"state":"active","core":"collection1","node_name":"127.0.0.1:40897_us%2Fdl","base_url":"http://127.0.0.1:40897/us/dl"}
> [junit4:junit4] 2> 498319 T3441 C2630 P40897 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=0
> [junit4:junit4] 2> live:true
> [junit4:junit4] 2> num:4
> [junit4:junit4] 2>
> [junit4:junit4] 2> client3
> [junit4:junit4] 2> PROPS:core_node4:{"state":"active","core":"collection1","node_name":"127.0.0.1:35810_us%2Fdl","base_url":"http://127.0.0.1:35810/us/dl"}
> [junit4:junit4] 2> 498321 T3459 C2627 P35810 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=0
> [junit4:junit4] 2> live:true
> [junit4:junit4] 2> num:4
> [junit4:junit4] 2>
> [junit4:junit4] 2> 498323 T3425 C2631 P34479 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/select params={q=*:*&wt=javabin&version=2} hits=4 status=0 QTime=0
> [junit4:junit4] 2> 498329 T3390 C2629 P45318 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={wt=javabin&version=2} {add=[4 (1438947898195705856)]} 0 2
> [junit4:junit4] 2> 498332 T3409 C2628 P35711 oasup.DistributedUpdateProcessor.setupRequest test.distrib.skip.servers was found and contains:[http://127.0.0.1:40897/us/dl/collection1/]
> [junit4:junit4] 2> 498333 T3409 C2628 P35711 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:34479/us/dl/collection1/ against:[http://127.0.0.1:40897/us/dl/collection1/] result:false
> [junit4:junit4] 2> 498333 T3409 C2628 P35711 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:40897/us/dl/collection1/ against:[http://127.0.0.1:40897/us/dl/collection1/] result:true
> [junit4:junit4] 2> 498333 T3409 C2628 P35711 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:35810/us/dl/collection1/ against:[http://127.0.0.1:40897/us/dl/collection1/] result:false
> [junit4:junit4] 2> 498338 T3458 C2627 P35810 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={distrib.from=http://127.0.0.1:35711/us/dl/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:40897/us/dl/collection1/&wt=javabin&version=2} {add=[4 (1438947898203045888)]} 0 1
> [junit4:junit4] 2> 498338 T3424 C2631 P34479 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={distrib.from=http://127.0.0.1:35711/us/dl/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:40897/us/dl/collection1/&wt=javabin&version=2} {add=[4 (1438947898203045888)]} 0 1
> [junit4:junit4] 2> 498339 T3409 C2628 P35711 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={distrib.from=http://127.0.0.1:35810/us/dl/collection1/&update.distrib=TOLEADER&test.distrib.skip.servers=http://127.0.0.1:40897/us/dl/collection1/&wt=javabin&version=2} {add=[4 (1438947898203045888)]} 0 7
> [junit4:junit4] 2> 498339 T3460 C2627 P35810 oasup.LogUpdateProcessor.finish [collection1] webapp=/us/dl path=/update params={test.distrib.skip.servers=http://127.0.0.1:40897/us/dl/collection1/&wt=javabin&version=2} {add=[4]} 0 8
> [junit4:junit4] 2> 498340 T3373 oasc.ChaosMonkey.monkeyLog monkey: kill shard! 35711
> [junit4:junit4] 2> 498361 T3373 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=20012095
> [junit4:junit4] 2> 499105 T3396 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
> [junit4:junit4] 2> 499106 T3396 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
> [junit4:junit4] 2> "operation":"state",
> [junit4:junit4] 2> "core_node_name":"core_node1",
> [junit4:junit4] 2> "shard":null,
> [junit4:junit4] 2> "roles":null,
> [junit4:junit4] 2> "state":"down",
> [junit4:junit4] 2> "core":"collection1",
> [junit4:junit4] 2> "collection":"collection1",
> [junit4:junit4] 2> "node_name":"127.0.0.1:35711_us%2Fdl",
> [junit4:junit4] 2> "base_url":"http://127.0.0.1:35711/us/dl"}
> [junit4:junit4] 2> 499106 T3396 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
> [junit4:junit4] 2> 499109 T3465 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 499109 T3448 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 499109 T3431 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 499109 T3415 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 499109 T3402 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 499109 T3395 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 500363 T3373 oasc.ZkController.publish publishing core=collection1 state=down
> [junit4:junit4] 2> 500363 T3373 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
> [junit4:junit4] 2> 500366 T3373 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@66be85
> [junit4:junit4] 2> 500369 T3373 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=6,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=1,adds=1,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=5,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0}
> [junit4:junit4] 2> 500369 T3373 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
> [junit4:junit4] 2> 500369 T3373 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
> [junit4:junit4] 2> 500370 T3373 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
> [junit4:junit4] 2> C2628_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, node_name=127.0.0.1:35711_us%2Fdl, base_url=http://127.0.0.1:35711/us/dl, leader=true}
> [junit4:junit4] 2> 500372 T3373 C2628 P35711 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=3
> [junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1377ac4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@122d2d4),segFN=segments_1,generation=1}
> [junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1377ac4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@122d2d4),segFN=segments_2,generation=2}
> [junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1377ac4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@122d2d4),segFN=segments_3,generation=3}
> [junit4:junit4] 2> 500373 T3373 C2628 P35711 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
> [junit4:junit4] 2> 500374 T3373 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
> [junit4:junit4] 2> 500374 T3373 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
> [junit4:junit4] 2> 500375 T3373 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.SyncSliceTest-1372287629333/jetty1/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.SyncSliceTest-1372287629333/jetty1/index;done=false>>]
> [junit4:junit4] 2> 500375 T3373 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.SyncSliceTest-1372287629333/jetty1/index
> [junit4:junit4] 2> 500375 T3373 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.SyncSliceTest-1372287629333/jetty1 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.SyncSliceTest-1372287629333/jetty1;done=false>>]
> [junit4:junit4] 2> 500376 T3373 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.SyncSliceTest-1372287629333/jetty1
> [junit4:junit4] 2> 500377 T3415 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 500377 T3431 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 500377 T3395 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
> [junit4:junit4] 2> 500378 T3465 oascc.ZkStateReader$3.process Updating live nodes... (4)
> [junit4:junit4] 2> 500378 T3402 oascc.ZkStateReader$3.process Updating live nodes... (4)
> [junit4:junit4] 2> 500378 T3448 oascc.ZkStateReader$3.process Updating live nodes... (4)
> [junit4:junit4] 2> 500378 T3402 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
> [junit4:junit4] 2> 500378 T3465 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
> [junit4:junit4] 2> 500378 T3448 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
> [junit4:junit4] 2> 500379 T3431 oascc.ZkStateReader$3.process Updating live nodes... (4)
> [junit4:junit4] 2> 500380 T3395 oascc.ZkStateReader$3.process Updating live nodes... (4)
> [junit4:junit4] 2> 500379 T3373 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/us/dl,null}
> [junit4:junit4] 2> 500380 T3431 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
> [junit4:junit4] 2> 500382 T3431 oasc.ShardLeaderElectionContext.shouldIBeLeader Checking if I should try and be the leader.
> [junit4:junit4] 2> 500383 T3431 oasc.ShardLeaderElectionContext.shouldIBeLeader My last published State was Active, it's okay to be the leader.
> [junit4:junit4] 2> 500383 T3431 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
> [junit4:junit4] 2> 500383 T3431 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:34479/us/dl/collection1/
> [junit4:junit4] 2> 500383 T3431 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:34479/us/dl START replicas=[http://127.0.0.1:40897/us/dl/collection1/, http://127.0.0.1:35810/us/dl/collection1/] nUpdates=100
> [junit4:junit4] 2> 500385 T3460 C2627 P35810 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
> [junit4:junit4] 2> 500385 T3443 C2630 P40897 oasc.SolrCore.execute [collection1] webapp=/us/dl path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
> [junit4:junit4] 2> 500386 T3431 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:34479/us/dl Received 6 versions from 127.0.0.1:35810/us/dl/collection1/
> [junit4:junit4] 2> 500386 T3431 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:34479/us/dl Our versions are newer. ourLowThreshold=1438947895933927424 otherHigh=1438947895970627584
> [junit4:junit4] 2> 500402 T3431 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:34479/us/dl Received 5 versions from 127.0.0.1:40897/us/dl/collection1/
> [junit4:junit4] 2> 500403 T3431 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:34479/us/dl Our versions are newer. ourLowThreshold=1438947895933927424 otherHigh=1438947895958044672
> [junit4:junit4] 2> 500403 T3431 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:34479/us/dl DONE. sync succeeded
> [junit4:junit4] 2> 500403 T3431 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
> [junit4:junit4] 2> 500403 T3431 oasc.SyncStrategy.syncToMe http://127.0.0.1:34479/us/dl/collection1/: try and ask http://127.0.0.1:40897/us/dl/collection1/ to sync
> [junit4:junit4] 2> 500403 T3431 oasc.SyncStrategy.syncToMe http://127.0.0.1:34479/us/dl/collection1/: try and ask http://127.0.0.1:35810/us/dl/collection1/ to sync
> [junit4:junit4] 2> ASYNC NEW_CORE C2632 name=collection1 org.apache.solr.core.SolrCore@1b84571 url=http://127.0.0.1:40897/us/dl/collection1 node=127.0.0.1:40897_us%2Fdl C2632_STATE=coll:collection1 core:collection1 props:{state=active, core=collection1, node_name=127.0.0.1:40897_us%2Fdl, base_url=http://127.0.0.1:40897/us/dl}
> [junit4:junit4] 2> 500405 T3444 C2632 P40897 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:40897/us/dl START replicas=[http://127.0.0.1:34479/us/dl/collection1/] nUpdates=100
> [junit4:junit4] 2> ASYNC NEW_CORE C2633 name=collection1 org.apache.solr.core.SolrCore@1bbb354 url=http://127.0.0.1:35810/us/dl/collection1 node=127.0.0.1:35810_us%2Fdl C2633_STATE=coll:collection1 core:collection1 props:{state=active, core=collection1, node_name=127.0.0.1:35810_us%2Fdl, base_url=http://127.0.0.1:35810/us/dl}
> [junit4:junit4] 2> 500405 T3459 C2633 P35810 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:35810/us/dl START replicas=[http://127.0.0.1:34479/us/dl/collection1/] nUpdates=100
> [junit4:junit4] 2> ASYNC NEW_CORE C2634 name=collection1 org.apache.solr.core.SolrCore@f6c3fe url=http://127.0.0.1:34479/us/dl/collection1 node=127.0.0.1:34479_us%2Fdl C2634_STATE=coll:collecti
>
> [...truncated too long message...]
>
> "leader":"true"},
> [junit4:junit4] 1> "core_node4":{
> [junit4:junit4] 1> "state":"active",
> [junit4:junit4] 1> "core":"collection1",
> [junit4:junit4] 1> "node_name":"127.0.0.1:35810_us%2Fdl",
> [junit4:junit4] 1> "base_url":"http://127.0.0.1:35810/us/dl"}}}},
> [junit4:junit4] 1> "router":"compositeId"},
> [junit4:junit4] 1> "control_collection":{
> [junit4:junit4] 1> "shards":{"shard1":{
> [junit4:junit4] 1> "range":"80000000-7fffffff",
> [junit4:junit4] 1> "state":"active",
> [junit4:junit4] 1> "replicas":{"core_node1":{
> [junit4:junit4] 1> "state":"active",
> [junit4:junit4] 1> "core":"collection1",
> [junit4:junit4] 1> "node_name":"127.0.0.1:45318_us%2Fdl",
> [junit4:junit4] 1> "base_url":"http://127.0.0.1:45318/us/dl",
> [junit4:junit4] 1> "leader":"true"}}}},
> [junit4:junit4] 1> "router":"compositeId"}}
> [junit4:junit4] 1> /solr/aliases.json (0)
> [junit4:junit4] 1> /solr/live_nodes (4)
> [junit4:junit4] 1> /solr/live_nodes/127.0.0.1:35810_us%2Fdl (0)
> [junit4:junit4] 1> /solr/live_nodes/127.0.0.1:45318_us%2Fdl (0)
> [junit4:junit4] 1> /solr/live_nodes/127.0.0.1:35711_us%2Fdl (0)
> [junit4:junit4] 1> /solr/live_nodes/127.0.0.1:40897_us%2Fdl (0)
> [junit4:junit4] 1> /solr/overseer (3)
> [junit4:junit4] 1> DATA:
> [junit4:junit4] 1>
> [junit4:junit4] 1> /solr/overseer/queue (0)
> [junit4:junit4] 1> /solr/overseer/queue-work (0)
> [junit4:junit4] 1> /solr/overseer/collection-queue-work (0)
> [junit4:junit4] 1> /solr/collections (2)
> [junit4:junit4] 1> /solr/collections/collection1 (3)
> [junit4:junit4] 1> DATA:
> [junit4:junit4] 1> {"configName":"conf1"}
> [junit4:junit4] 1> /solr/collections/collection1/shards (0)
> [junit4:junit4] 1> /solr/collections/collection1/leader_elect (1)
> [junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard1 (1)
> [junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard1/election (3)
> [junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard1/election/89934242076164106-core_node3-n_0000000002 (0)
> [junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard1/election/89934242076164108-core_node4-n_0000000003 (0)
> [junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard1/election/89934242076164110-core_node1-n_0000000004 (0)
> [junit4:junit4] 1> /solr/collections/collection1/leaders (1)
> [junit4:junit4] 1> /solr/collections/collection1/leaders/shard1 (0)
> [junit4:junit4] 1> DATA:
> [junit4:junit4] 1> {
> [junit4:junit4] 1> "core":"collection1",
> [junit4:junit4] 1> "node_name":"127.0.0.1:40897_us%2Fdl",
> [junit4:junit4] 1> "base_url":"http://127.0.0.1:40897/us/dl"}
> [junit4:junit4] 1> /solr/collections/control_collection (3)
> [junit4:junit4] 1> DATA:
> [junit4:junit4] 1> {"configName":"conf1"}
> [junit4:junit4] 1> /solr/collections/control_collection/shards (0)
> [junit4:junit4] 1> /solr/collections/control_collection/leader_elect (1)
> [junit4:junit4] 1> /solr/collections/control_collection/leader_elect/shard1 (1)
> [junit4:junit4] 1> /solr/collections/control_collection/leader_elect/shard1/election (1)
> [junit4:junit4] 1> /solr/collections/control_collection/leader_elect/shard1/election/89934242076164099-core_node1-n_0000000000 (0)
> [junit4:junit4] 1> /solr/collections/control_collection/leaders (1)
> [junit4:junit4] 1> /solr/collections/control_collection/leaders/shard1 (0)
> [junit4:junit4] 1> DATA:
> [junit4:junit4] 1> {
> [junit4:junit4] 1> "core":"collection1",
> [junit4:junit4] 1> "node_name":"127.0.0.1:45318_us%2Fdl",
> [junit4:junit4] 1> "base_url":"http://127.0.0.1:45318/us/dl"}
> [junit4:junit4] 1> /solr/overseer_elect (2)
> [junit4:junit4] 1> /solr/overseer_elect/election (4)
> [junit4:junit4] 1> /solr/overseer_elect/election/89934242076164106-127.0.0.1:40897_us%2Fdl-n_0000000003 (0)
> [junit4:junit4] 1> /solr/overseer_elect/election/89934242076164110-127.0.0.1:35711_us%2Fdl-n_0000000005 (0)
> [junit4:junit4] 1> /solr/overseer_elect/election/89934242076164099-127.0.0.1:45318_us%2Fdl-n_0000000000 (0)
> [junit4:junit4] 1> /solr/overseer_elect/election/89934242076164108-127.0.0.1:35810_us%2Fdl-n_0000000004 (0)
> [junit4:junit4] 1> /solr/overseer_elect/leader (0)
> [junit4:junit4] 1> DATA:
> [junit4:junit4] 1> {"id":"89934242076164099-127.0.0.1:45318_us%2Fdl-n_0000000000"}
> [junit4:junit4] 1> /zookeeper (1)
> [junit4:junit4] 1> DATA:
> [junit4:junit4] 1>
> [junit4:junit4] 1>
> [junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=SyncSliceTest -Dtests.method=testDistribSearch -Dtests.seed=7CA5FD4E6AE27A7 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=es_BO -Dtests.timezone=Atlantic/Reykjavik -Dtests.file.encoding=UTF-8
> [junit4:junit4] FAILURE 99.0s J0 | SyncSliceTest.testDistribSearch <<<
> [junit4:junit4] > Throwable #1: java.lang.AssertionError: shard1 is not consistent. Got 305 from http://127.0.0.1:35711/us/dl/collection1lastClient and got 250 from http://127.0.0.1:40897/us/dl/collection1
> [junit4:junit4] > at __randomizedtesting.SeedInfo.seed([7CA5FD4E6AE27A7:862CD1CC91F1479B]:0)
> [junit4:junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1045)
> [junit4:junit4] > at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:237)
> [junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
> [junit4:junit4] > at java.lang.Thread.run(Thread.java:724)
> [junit4:junit4] 2> 573480 T3373 oas.SolrTestCaseJ4.deleteCore ###deleteCore
> [junit4:junit4] 2> 99016 T3372 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 4 leaked thread(s).
> [junit4:junit4] 2> 573617 T3448 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
> [junit4:junit4] 2> 573617 T3448 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
> [junit4:junit4] 2> 573617 T3448 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
> [junit4:junit4] 2> 574704 T3465 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
> [junit4:junit4] 2> 574704 T3465 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
> [junit4:junit4] 2> 574705 T3465 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
> [junit4:junit4] 2> NOTE: test params are: codec=Lucene40, sim=RandomSimilarityProvider(queryNorm=false,coord=yes): {}, locale=es_BO, timezone=Atlantic/Reykjavik
> [junit4:junit4] 2> NOTE: Linux 3.2.0-48-generic i386/Oracle Corporation 1.8.0-ea (32-bit)/cpus=8,threads=1,free=110056424,total=420458496
> [junit4:junit4] 2> NOTE: All tests run in this JVM: [HdfsUnloadDistributedZkTest, DirectSolrConnectionTest, SpatialFilterTest, TestReplicationHandler, TestSchemaSimilarityResource, RecoveryZkTest, SchemaVersionSpecificBehaviorTest, LeaderElectionTest, TestQuerySenderListener, TestRemoteStreaming, HdfsLockFactoryTest, PolyFieldTest, HdfsBasicDistributedZk2Test, TestCharFilters, SolrCoreTest, ScriptEngineTest, HdfsCollectionsAPIDistributedZkTest, TestIBSimilarityFactory, AutoCommitTest, TestSolrCoreProperties, TestStressRecovery, TestSweetSpotSimilarityFactory, TestQueryUtils, TestSolrIndexConfig, SuggesterFSTTest, TestRandomDVFaceting, TestReversedWildcardFilterFactory, MoreLikeThisHandlerTest, DirectUpdateHandlerOptimizeTest, PrimUtilsTest, ResponseLogComponentTest, TermVectorComponentTest, TestUniqueKeyFieldResource, LegacyHTMLStripCharFilterTest, TestRecoveryHdfs, HdfsRecoveryZkTest, FieldMutatingUpdateProcessorTest, SoftAutoCommitTest, TestPHPSerializedResponseWriter, BasicDistributedZkTest, UnloadDistributedZkTest, LoggingHandlerTest, PeerSyncTest, TestLMDirichletSimilarityFactory, OverseerCollectionProcessorTest, RAMDirectoryFactoryTest, SolrTestCaseJ4Test, UUIDFieldTest, IndexSchemaTest, TestJoin, SyncSliceTest]
> [junit4:junit4] Completed on J0 in 100.34s, 1 test, 1 failure <<< FAILURES!
>
> [...truncated 553 lines...]
> BUILD FAILED
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:386: The following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:366: The following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:39: The following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:190: The following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:443: The following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1243: The following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:887: There were test failures: 311 suites, 1281 tests, 2 suite-level errors, 1 failure, 23 ignored (11 assumptions)
>
> Total time: 39 minutes 33 seconds
> Build step 'Invoke Ant' marked build as failure
> Description set: Java: 32bit/jdk1.8.0-ea-b94 -server -XX:+UseSerialGC
> Archiving artifacts
> Recording test results
> Email was triggered for: Failure
> Sending email for trigger: Failure
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org