You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/02/08 10:27:51 UTC
[JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.7.0) - Build # 1308
- Failure!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-MacOSX/1308/
Java: 64bit/jdk1.7.0 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC
2 tests failed.
REGRESSION: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.testDistribSearch
Error Message:
No live SolrServers available to handle this request:[http://127.0.0.1:55271/oca/collection1, http://127.0.0.1:55301/oca/collection1, http://127.0.0.1:55255/oca/collection1, http://127.0.0.1:55252/oca/collection1, http://127.0.0.1:55258/oca/collection1, http://127.0.0.1:55283/oca/collection1, http://127.0.0.1:55265/oca/collection1, http://127.0.0.1:55261/oca/collection1]
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:55271/oca/collection1, http://127.0.0.1:55301/oca/collection1, http://127.0.0.1:55255/oca/collection1, http://127.0.0.1:55252/oca/collection1, http://127.0.0.1:55258/oca/collection1, http://127.0.0.1:55283/oca/collection1, http://127.0.0.1:55265/oca/collection1, http://127.0.0.1:55261/oca/collection1]
at __randomizedtesting.SeedInfo.seed([4233015F598AF4F6:C3D58F472ED594CA]:0)
at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:352)
at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:640)
at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:90)
at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:301)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1170)
at org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.doTest(ChaosMonkeySafeLeaderTest.java:149)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:867)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:744)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:55252/oca/collection1, http://127.0.0.1:55261/oca/collection1]
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:495)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:199)
at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:283)
... 46 more
REGRESSION: org.apache.solr.cloud.ShardSplitTest.testDistribSearch
Error Message:
Timeout occured while waiting response from server at: http://127.0.0.1:56188
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:56188
at __randomizedtesting.SeedInfo.seed([4233015F598AF4F6:C3D58F472ED594CA]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:503)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:199)
at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:537)
at org.apache.solr.cloud.ShardSplitTest.incompleteOrOverlappingCustomRangeTest(ShardSplitTest.java:147)
at org.apache.solr.cloud.ShardSplitTest.doTest(ShardSplitTest.java:112)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:867)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:744)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:152)
at java.net.SocketInputStream.read(SocketInputStream.java:122)
at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:260)
at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:271)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:123)
at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:682)
at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:486)
at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:863)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:106)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:57)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:395)
... 45 more
Build Log:
[...truncated 10182 lines...]
[junit4] Suite: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
[junit4] 2> 855726 T2561 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /oca/
[junit4] 2> 855734 T2561 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ChaosMonkeySafeLeaderTest-1391848850574
[junit4] 2> 855735 T2561 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 855746 T2562 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 855847 T2561 oasc.ZkTestServer.run start zk server on port:55245
[junit4] 2> 855849 T2561 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 855856 T2568 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@30f523f5 name:ZooKeeperConnection Watcher:127.0.0.1:55245 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 855857 T2561 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 855857 T2561 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 855868 T2561 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 855872 T2570 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@63f513c6 name:ZooKeeperConnection Watcher:127.0.0.1:55245/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 855873 T2561 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 855876 T2561 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 855886 T2561 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 855901 T2561 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 855907 T2561 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 855918 T2561 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 855919 T2561 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 855932 T2561 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 855933 T2561 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 855941 T2561 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 855942 T2561 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 855950 T2561 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 855951 T2561 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 855958 T2561 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 855959 T2561 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 855967 T2561 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 855968 T2561 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 855976 T2561 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 855977 T2561 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 855984 T2561 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 855984 T2561 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 855992 T2561 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 855993 T2561 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 856002 T2561 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 856004 T2561 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 856011 T2561 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 856011 T2561 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 856382 T2561 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 856391 T2561 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:55248
[junit4] 2> 856392 T2561 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 856392 T2561 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 856392 T2561 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391848850861
[junit4] 2> 856393 T2561 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391848850861/'
[junit4] 2> 856422 T2561 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391848850861/solr.xml
[junit4] 2> 856522 T2561 oasc.CoreContainer.<init> New CoreContainer 2128875831
[junit4] 2> 856523 T2561 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391848850861/]
[junit4] 2> 856524 T2561 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 856525 T2561 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 856525 T2561 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 856525 T2561 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 856526 T2561 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 856526 T2561 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 856526 T2561 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 856526 T2561 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 856527 T2561 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 856537 T2561 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 856538 T2561 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 856538 T2561 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 856539 T2561 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55245/solr
[junit4] 2> 856539 T2561 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 856541 T2561 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 856556 T2581 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2f2672f6 name:ZooKeeperConnection Watcher:127.0.0.1:55245 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 856558 T2561 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 856564 T2561 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 856568 T2583 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@740695b7 name:ZooKeeperConnection Watcher:127.0.0.1:55245/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 856568 T2561 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 856572 T2561 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 856582 T2561 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 856591 T2561 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 856595 T2561 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55248_oca
[junit4] 2> 856597 T2561 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55248_oca
[junit4] 2> 856606 T2561 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 856611 T2561 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 856623 T2561 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:55248_oca
[junit4] 2> 856624 T2561 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 856631 T2561 oasc.Overseer.start Overseer (id=91216206272266243-127.0.0.1:55248_oca-n_0000000000) starting
[junit4] 2> 856643 T2561 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 856659 T2585 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 856660 T2561 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 856662 T2585 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
[junit4] 2> 856668 T2561 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 856674 T2561 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 856684 T2584 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 856689 T2586 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 856690 T2586 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 856692 T2583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 856693 T2586 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 856696 T2584 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 856698 T2584 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:55248/oca",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:55248_oca",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 856698 T2584 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 856699 T2584 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 856707 T2583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 856709 T2583 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 857694 T2586 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 857695 T2586 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391848850861/collection1
[junit4] 2> 857695 T2586 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 857700 T2586 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 857700 T2586 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 857707 T2586 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 857707 T2586 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391848850861/collection1/'
[junit4] 2> 857709 T2586 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391848850861/collection1/lib/classes/' to classloader
[junit4] 2> 857710 T2586 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391848850861/collection1/lib/README' to classloader
[junit4] 2> 857805 T2586 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 857886 T2586 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 857889 T2586 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 857910 T2586 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 858572 T2586 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 858575 T2586 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 858577 T2586 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 858583 T2586 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 858644 T2586 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 858644 T2586 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391848850861/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391848850574/control/data/
[junit4] 2> 858644 T2586 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@144ccd40
[junit4] 2> 858646 T2586 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391848850574/control/data
[junit4] 2> 858646 T2586 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391848850574/control/data/index/
[junit4] 2> 858647 T2586 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391848850574/control/data/index' doesn't exist. Creating new index...
[junit4] 2> 858648 T2586 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391848850574/control/data/index
[junit4] 2> 858649 T2586 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=36, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 858653 T2586 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391848850574/control/data/index,segFN=segments_1,generation=1}
[junit4] 2> 858653 T2586 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 858657 T2586 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 858658 T2586 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 858659 T2586 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 858659 T2586 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 858659 T2586 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 858659 T2586 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 858660 T2586 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 858661 T2586 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 858661 T2586 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 858662 T2586 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 858662 T2586 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 858663 T2586 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 858663 T2586 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 858663 T2586 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 858664 T2586 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 858664 T2586 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 858665 T2586 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 858689 T2586 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 858693 T2586 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 858693 T2586 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 858694 T2586 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=21, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.23970968841785797]
[junit4] 2> 858695 T2586 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391848850574/control/data/index,segFN=segments_1,generation=1}
[junit4] 2> 858696 T2586 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 858696 T2586 oass.SolrIndexSearcher.<init> Opening Searcher@3e47c5f2[collection1] main
[junit4] 2> 858702 T2587 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3e47c5f2[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 858703 T2586 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 858705 T2561 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 858705 T2590 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:55248/oca collection:control_collection shard:shard1
[junit4] 2> 858705 T2561 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 858708 T2561 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 858709 T2590 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 858712 T2592 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@65cae64d name:ZooKeeperConnection Watcher:127.0.0.1:55245/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 858712 T2561 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 858715 T2561 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 858723 T2561 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 858728 T2590 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 858734 T2583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 858736 T2590 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 858736 T2590 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C2880 name=collection1 org.apache.solr.core.SolrCore@417d2667 url=http://127.0.0.1:55248/oca/collection1 node=127.0.0.1:55248_oca C2880_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:55248/oca, core=collection1, node_name=127.0.0.1:55248_oca}
[junit4] 2> 858736 T2590 C2880 P55248 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:55248/oca/collection1/
[junit4] 2> 858736 T2590 C2880 P55248 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 858736 T2590 C2880 P55248 oasc.SyncStrategy.syncToMe http://127.0.0.1:55248/oca/collection1/ has no replicas
[junit4] 2> 858737 T2590 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:55248/oca/collection1/ shard1
[junit4] 2> 858737 T2590 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 858742 T2584 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 858758 T2583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 858761 T2583 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 858762 T2592 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 858778 T2584 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 858792 T2583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 858898 T2583 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 858901 T2592 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 858924 T2590 oasc.ZkController.register We are http://127.0.0.1:55248/oca/collection1/ and leader is http://127.0.0.1:55248/oca/collection1/
[junit4] 2> 858924 T2590 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:55248/oca
[junit4] 2> 858924 T2590 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 858925 T2590 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 858925 T2590 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 858927 T2583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 858927 T2583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 858927 T2583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 858931 T2590 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 858934 T2584 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 858935 T2584 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:55248/oca",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:55248_oca",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 858942 T2583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 859048 T2592 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 859050 T2583 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 859073 T2561 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 859075 T2561 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 859079 T2561 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:55252
[junit4] 2> 859080 T2561 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 859080 T2561 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 859080 T2561 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391848853562
[junit4] 2> 859081 T2561 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391848853562/'
[junit4] 2> 859114 T2561 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391848853562/solr.xml
[junit4] 2> 859224 T2561 oasc.CoreContainer.<init> New CoreContainer 303682915
[junit4] 2> 859225 T2561 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391848853562/]
[junit4] 2> 859226 T2561 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 859226 T2561 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 859227 T2561 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 859227 T2561 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 859227 T2561 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 859227 T2561 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 859228 T2561 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 859228 T2561 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 859228 T2561 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 859239 T2561 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 859239 T2561 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 859240 T2561 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 859241 T2561 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55245/solr
[junit4] 2> 859241 T2561 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 859243 T2561 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 859247 T2603 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5e085fdd name:ZooKeeperConnection Watcher:127.0.0.1:55245 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 859248 T2561 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 859253 T2561 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 859256 T2605 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2271f0de name:ZooKeeperConnection Watcher:127.0.0.1:55245/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 859257 T2561 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 859268 T2561 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 860281 T2561 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55252_oca
[junit4] 2> 860284 T2561 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55252_oca
[junit4] 2> 860294 T2583 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 860295 T2592 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 860295 T2605 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 860314 T2606 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 860314 T2606 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 860317 T2606 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 860317 T2583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 860318 T2583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 860318 T2583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 860322 T2584 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 860324 T2584 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:55252/oca",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:55252_oca",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 860324 T2584 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3]
[junit4] 2> 860325 T2584 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 860333 T2583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 860440 T2605 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 860441 T2583 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 860441 T2592 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 861318 T2606 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 861319 T2606 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391848853562/collection1
[junit4] 2> 861319 T2606 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 861321 T2606 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 861321 T2606 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 861324 T2606 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 861325 T2606 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391848853562/collection1/'
[junit4] 2> 861326 T2606 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391848853562/collection1/lib/classes/' to classloader
[junit4] 2> 861326 T2606 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391848853562/collection1/lib/README' to classloader
[junit4] 2> 861399 T2606 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 861480 T2606 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 861484 T2606 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 861504 T2606 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 862156 T2606 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 862159 T2606 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 862160 T2606 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 862168 T2606 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 862240 T2606 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 862241 T2606 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391848853562/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391848850574/jetty1/
[junit4] 2> 862241 T2606 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@144ccd40
[junit4] 2> 862243 T2606 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391848850574/jetty1
[junit4] 2> 862243 T2606 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391848850574/jetty1/index/
[junit4] 2> 862244 T2606 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391848850574/jetty1/index' doesn't exist. Creating new index...
[junit4] 2> 862246 T2606 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391848850574/jetty1/index
[junit4] 2> 862246 T2606 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=36, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 862250 T2606 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391848850574/jetty1/index,segFN=segments_1,generation=1}
[junit4] 2> 862250 T2606 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 862267 T2606 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 862268 T2606 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 862268 T2606 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 862268 T2606 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 862268 T2606 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 862269 T2606 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 862269 T2606 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 862270 T2606 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 862270 T2606 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 862270 T2606 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 862271 T2606 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 862271 T2606 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 862271 T2606 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 862272 T2606 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 862273 T2606 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 862273 T2606 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 862274 T2606 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 862289 T2606 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 862294 T2606 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 862294 T2606 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 862295 T2606 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=21, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.23970968841785797]
[junit4] 2> 862297 T2606 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391848850574/jetty1/index,segFN=segments_1,generation=1}
[junit4] 2> 862297 T2606 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 862297 T2606 oass.SolrIndexSearcher.<init> Opening Searcher@25c5d000[collection1] main
[junit4] 2> 862302 T2607 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@25c5d000[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 862306 T2606 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 862307 T2561 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 862308 T2561 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 862308 T2610 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:55252/oca collection:collection1 shard:shard1
[junit4] 2> 862311 T2610 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 862327 T2610 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 862336 T2583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 862336 T2583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 862336 T2583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 862339 T2610 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 862339 T2610 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C2881 name=collection1 org.apache.solr.core.SolrCore@7a2c5239 url=http://127.0.0.1:55252/oca/collection1 node=127.0.0.1:55252_oca C2881_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:55252/oca, core=collection1, node_name=127.0.0.1:55252_oca}
[junit4] 2> 862340 T2610 C2881 P55252 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:55252/oca/collection1/
[junit4] 2> 862340 T2610 C2881 P55252 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 862340 T2610 C2881 P55252 oasc.SyncStrategy.syncToMe http://127.0.0.1:55252/oca/collection1/ has no replicas
[junit4] 2> 862341 T2610 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:55252/oca/collection1/ shard1
[junit4] 2> 862341 T2610 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 862350 T2584 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 862360 T2583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 862365 T2583 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 862366 T2592 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 862369 T2605 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 862380 T2584 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 862389 T2583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 862494 T2592 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 862495 T2605 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 862496 T2583 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 862524 T2610 oasc.ZkController.register We are http://127.0.0.1:55252/oca/collection1/ and leader is http://127.0.0.1:55252/oca/collection1/
[junit4] 2> 862524 T2610 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:55252/oca
[junit4] 2> 862524 T2610 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 862524 T2610 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 862525 T2610 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 862527 T2583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 862527 T2583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 862528 T2583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 862531 T2584 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 862532 T2584 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:55252/oca",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:55252_oca",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 862533 T2610 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 862539 T2583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 862645 T2605 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 862646 T2592 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 862646 T2583 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 862657 T2561 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 862658 T2561 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 862662 T2561 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:55255
[junit4] 2> 862664 T2561 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 862664 T2561 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 862664 T2561 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391848857147
[junit4] 2> 862665 T2561 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391848857147/'
[junit4] 2> 862707 T2561 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391848857147/solr.xml
[junit4] 2> 862802 T2561 oasc.CoreContainer.<init> New CoreContainer 1620279884
[junit4] 2> 862802 T2561 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391848857147/]
[junit4] 2> 862804 T2561 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 862804 T2561 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 862804 T2561 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 862805 T2561 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 862805 T2561 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 862805 T2561 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 862805 T2561 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 862806 T2561 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 862806 T2561 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 862816 T2561 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 862817 T2561 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 862818 T2561 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 862818 T2561 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55245/solr
[junit4] 2> 862818 T2561 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 862820 T2561 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 862823 T2621 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@744f7d1c name:ZooKeeperConnection Watcher:127.0.0.1:55245 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 862825 T2561 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 862830 T2561 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 862833 T2623 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@15c443d name:ZooKeeperConnection Watcher:127.0.0.1:55245/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 862834 T2561 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 862846 T2561 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 863856 T2561 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55255_oca
[junit4] 2> 863859 T2561 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55255_oca
[junit4] 2> 863870 T2592 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 863871 T2605 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 863870 T2583 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 863871 T2623 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 863892 T2624 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 863893 T2624 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 863896 T2624 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 863896 T2583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 863897 T2583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 863897 T2583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 863902 T2584 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 863904 T2584 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:55255/oca",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:55255_oca",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 863904 T2584 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 863904 T2584 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 863913 T2583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 864020 T2592 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 864020 T2623 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 864021 T2583 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 864021 T2605 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 864898 T2624 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 864898 T2624 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391848857147/collection1
[junit4] 2> 864899 T2624 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 864900 T2624 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 864901 T2624 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 864905 T2624 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 864905 T2624 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391848857147/collection1/'
[junit4] 2> 864907 T2624 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391848857147/collection1/lib/classes/' to classloader
[junit4] 2> 864907 T2624 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391848857147/collection1/lib/README' to classloader
[junit4] 2> 864998 T2624 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 865128 T2624 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 865132 T2624 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 865148 T2624 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 866101 T2624 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 866105 T2624 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 866107 T2624 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 866116 T2624 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 866204 T2624 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 866206 T2624 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391848857147/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391848850574/jetty2/
[junit4] 2> 866206 T2624 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@144ccd40
[junit4] 2> 866207 T2624 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391848850574/jetty2
[junit4] 2> 866208 T2624 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391848850574/jetty2/index/
[junit4] 2> 866209 T2624 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391848850574/jetty2/index' doesn't exist. Creating new index...
[junit4] 2> 866210 T2624 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391848850574/jetty2/index
[junit4] 2> 866211 T2624 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=36, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 866214 T2624 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391848850574/jetty2/index,segFN=segments_1,generation=1}
[junit4] 2> 866215 T2624 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 866221 T2624 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 866222 T2624 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 866222 T2624 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 866223 T2624 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 866223 T2624 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 866223 T2624 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 866224 T2624 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 866225 T2624 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 866225 T2624 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 866226 T2624 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 866227 T2624 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 866227 T2624 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 866228 T2624 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 866229 T2624 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 866230 T2624 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 866231 T2624 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 866232 T2624 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 866247 T2624 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 866254 T2624 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 866254 T2624 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 866255 T2624 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=21, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.23970968841785797]
[junit4] 2> 866258 T2624 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391848850574/jetty2/index,segFN=segments_1,generation=1}
[junit4] 2> 866258 T2624 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 866258 T2624 oass.SolrIndexSearcher.<init> Opening Searcher@27b8b189[collection1] main
[junit4] 2> 866266 T2625 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@27b8b189[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 866270 T2624 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 866272 T2561 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 866272 T2561 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 866272 T2628 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:55255/oca collection:collection1 shard:shard2
[junit4] 2> 866276 T2628 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 866319 T2628 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 866328 T2583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 866329 T2583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 866330 T2583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 866331 T2628 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 866331 T2628 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C2882 name=collection1 org.apache.solr.core.SolrCore@1e273c1c url=http://127.0.0.1:55255/oca/collection1 node=127.0.0.1:55255_oca C2882_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:55255/oca, core=collection1, node_name=127.0.0.1:55255_oca}
[junit4] 2> 866331 T2628 C2882 P55255 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:55255/oca/collection1/
[junit4] 2> 866332 T2628 C2882 P55255 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 866332 T2628 C2882 P55255 oasc.SyncStrategy.syncToMe http://127.0.0.1:55255/oca/collection1/ has no replicas
[junit4] 2> 866332 T2628 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:55255/oca/collection1/ shard2
[junit4] 2> 866333 T2628 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 866335 T2584 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 866346 T2583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 866349 T2592 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 866350 T2623 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 866350 T2583 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 866350 T2605 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 866368 T2583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 866375 T2584 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 866384 T2583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 866490 T2623 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 866490 T2583 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 866491 T2605 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 866491 T2592 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 866527 T2628 oasc.ZkController.register We are http://127.0.0.1:55255/oca/collection1/ and leader is http://127.0.0.1:55255/oca/collection1/
[junit4] 2> 866527 T2628 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:55255/oca
[junit4] 2> 866527 T2628 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 866528 T2628 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 866528 T2628 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 866531 T2583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 866531 T2583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 866532 T2583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 866533 T2628 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 866536 T2584 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 866538 T2584 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:55255/oca",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:55255_oca",
[junit4] 2> "shard":"shard2",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":"core_node2"}
[junit4] 2> 866544 T2583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 866651 T2592 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 866651 T2583 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 866651 T2605 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 866651 T2623 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 866692 T2561 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 866693 T2561 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 866699 T2561 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:55258
[junit4] 2> 866699 T2561 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 866700 T2561 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 866700 T2561 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1391848861112
[junit4] 2> 866701 T2561 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1391848861112/'
[junit4] 2> 866734 T2561 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1391848861112/solr.xml
[junit4] 2> 866836 T2561 oasc.CoreContainer.<init> New CoreContainer 1393180877
[junit4] 2> 866836 T2561 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1391848861112/]
[junit4] 2> 866838 T2561 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 866838 T2561 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 866839 T2561 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 866839 T2561 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 866839 T2561 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 866839 T2561 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 866840 T2561 oashc.HttpShardHandlerFactory.
[...truncated too long message...]
tty4
[junit4] 2> 1695335 T4608 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 1695335 T4608 oasc.SolrException.log ERROR There was a problem trying to register as the leader:org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1041)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:206)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:203)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:203)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:414)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:383)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:370)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:112)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:273)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:164)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:108)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 1695336 T4608 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard2/election/91216239869034508-core_node4-n_0000000001
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:174)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:171)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:171)
[junit4] 2> at org.apache.solr.cloud.ElectionContext.cancelElection(ElectionContext.java:67)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:293)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:164)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:108)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 1695336 T4608 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 1695336 T4608 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:254)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:254)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> NOTE: test params are: codec=Lucene45, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=de_AT, timezone=Pacific/Apia
[junit4] 2> NOTE: Mac OS X 10.8.5 x86_64/Oracle Corporation 1.7.0_51 (64-bit)/cpus=2,threads=1,free=368737544,total=519438336
[junit4] 2> NOTE: All tests run in this JVM: [TestSystemIdResolver, TestJmxMonitoredMap, ShowFileRequestHandlerTest, TestNRTOpen, TestDefaultSimilarityFactory, XmlUpdateRequestHandlerTest, TestWriterPerf, TestHashPartitioner, TestSuggestSpellingConverter, TestComponentsName, TestCharFilters, CurrencyFieldOpenExchangeTest, SolrCmdDistributorTest, FunctionTest, TestCodecSupport, TestQueryTypes, BadComponentTest, OverseerRolesTest, LoggingHandlerTest, TestSweetSpotSimilarityFactory, ZkCLITest, TestWordDelimiterFilterFactory, TestIBSimilarityFactory, TestCollationField, HardAutoCommitTest, SuggestComponentTest, TestReload, HdfsUnloadDistributedZkTest, TestSerializedLuceneMatchVersion, DirectSolrSpellCheckerTest, OverseerCollectionProcessorTest, DeleteShardTest, SolrCoreCheckLockOnStartupTest, AddBlockUpdateTest, TestQueryUtils, DateFieldTest, TestSolrXmlPersistence, TestDocSet, TestCopyFieldCollectionResource, SuggesterWFSTTest, URLClassifyProcessorTest, MoreLikeThisHandlerTest, ClusterStateUpdateTest, ChangedSchemaMergeTest, TestSort, TestSurroundQueryParser, CopyFieldTest, TestDistribDocBasedVersion, TestDFRSimilarityFactory, AutoCommitTest, TestJmxIntegration, DocumentBuilderTest, TestRangeQuery, RecoveryZkTest, TestCoreDiscovery, TestShardHandlerFactory, TestRandomFaceting, TestModifyConfFiles, FieldAnalysisRequestHandlerTest, TestCSVResponseWriter, SortByFunctionTest, TestRemoteStreaming, TestUniqueKeyFieldResource, TestBinaryField, MultiTermTest, DistributedSuggestComponentTest, XsltUpdateRequestHandlerTest, TestAnalyzeInfixSuggestions, TestAddFieldRealTimeGet, TestPartialUpdateDeduplication, TestCustomSort, LeaderElectionIntegrationTest, CoreContainerCoreInitFailuresTest, ChaosMonkeyNothingIsSafeTest, SOLR749Test, TestLFUCache, TestMergePolicyConfig, PolyFieldTest, TestDistributedSearch, RegexBoostProcessorTest, SimplePostToolTest, TestStressVersions, SuggesterFSTTest, BlockDirectoryTest, TestFieldResource, TestRecoveryHdfs, OutputWriterTest, MBeansHandlerTest, WordBreakSolrSpellCheckerTest, PingRequestHandlerTest, TestSolrIndexConfig, ChaosMonkeySafeLeaderTest, FastVectorHighlighterTest, TestTrie, ExpressionTest, TestSolrXml, TestQuerySenderNoQuery, TestSolrXMLSerializer, DateMathParserTest, TestInfoStreamLogging, AnalysisErrorHandlingTest, SpatialFilterTest, BasicZkTest, CursorPagingTest, TimeZoneUtilsTest, SolrIndexConfigTest, TestFastWriter, OverseerTest, TestBinaryResponseWriter, TestFieldTypeCollectionResource, DebugComponentTest, PreAnalyzedFieldTest, TestStandardQParsers, RAMDirectoryFactoryTest, SchemaVersionSpecificBehaviorTest, SpellCheckComponentTest, SolrIndexSplitterTest, TestDefaultSearchFieldResource, ShardRoutingCustomTest, QueryParsingTest, FileBasedSpellCheckerTest, AssignTest, TestSimpleQParserPlugin, HighlighterConfigTest, AbstractAnalyticsStatsTest, ResourceLoaderTest, UnloadDistributedZkTest, ShardRoutingTest, SolrCoreTest, QueryEqualityTest, FullSolrCloudDistribCmdsTest, TestDocBasedVersionConstraints, ShardSplitTest]
[junit4] Completed in 327.75s, 1 test, 1 error <<< FAILURES!
[...truncated 723 lines...]
BUILD FAILED
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:453: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:433: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:39: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/extra-targets.xml:37: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build.xml:189: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/common-build.xml:491: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:1268: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:901: There were test failures: 368 suites, 1595 tests, 2 errors, 40 ignored (6 assumptions)
Total time: 94 minutes 13 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.7.0) - Build # 1312
- Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-MacOSX/1312/
Java: 64bit/jdk1.7.0 -XX:-UseCompressedOops -XX:+UseParallelGC
1 tests failed.
FAILED: org.apache.solr.TestDistributedSearch.testDistribSearch
Error Message:
Expected the partialResults header to be null
Stack Trace:
java.lang.AssertionError: Expected the partialResults header to be null
at __randomizedtesting.SeedInfo.seed([B24F1E52FD92E561:33A9904A8ACD855D]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNull(Assert.java:551)
at org.apache.solr.TestDistributedSearch.validateControlData(TestDistributedSearch.java:525)
at org.apache.solr.TestDistributedSearch.queryPartialResults(TestDistributedSearch.java:445)
at org.apache.solr.TestDistributedSearch.doTest(TestDistributedSearch.java:379)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:873)
at sun.reflect.GeneratedMethodAccessor67.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:744)
Build Log:
[...truncated 10305 lines...]
[junit4] Suite: org.apache.solr.TestDistributedSearch
[junit4] 2> 2245397 T8003 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /x_asc/s
[junit4] 2> 2245403 T8003 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> 2245406 T8003 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2245412 T8003 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:51628
[junit4] 2> 2245412 T8003 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 2245413 T8003 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2245413 T8003 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr
[junit4] 2> 2245414 T8003 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/'
[junit4] 2> 2245462 T8003 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/solr.xml
[junit4] 2> 2245557 T8003 oasc.CoreContainer.<init> New CoreContainer 1651546640
[junit4] 2> 2245558 T8003 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/]
[junit4] 2> 2245560 T8003 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 2245561 T8003 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 2245561 T8003 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 2245562 T8003 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 2245562 T8003 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 2245562 T8003 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 2245562 T8003 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 2245562 T8003 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 2245563 T8003 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 2245573 T8003 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2245574 T8003 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2245574 T8003 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 2245581 T8013 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1
[junit4] 2> 2245582 T8013 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/'
[junit4] 2> 2245583 T8013 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/lib/classes/' to classloader
[junit4] 2> 2245583 T8013 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/lib/README' to classloader
[junit4] 2> 2245705 T8013 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 2245839 T8013 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2245840 T8013 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 2245857 T8013 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 2246664 T8013 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 2246672 T8013 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2246677 T8013 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2246687 T8013 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2246694 T8013 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2246701 T8013 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2246702 T8013 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2246702 T8013 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2246703 T8013 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2246703 T8013 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2246704 T8013 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2246704 T8013 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 2246705 T8013 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/, dataDir=./org.apache.solr.TestDistributedSearch-1391951517841/control/data/
[junit4] 2> 2246705 T8013 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@357c4ab7
[junit4] 2> 2246706 T8013 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.TestDistributedSearch-1391951517841/control/data
[junit4] 2> 2246706 T8013 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.TestDistributedSearch-1391951517841/control/data/index/
[junit4] 2> 2246707 T8013 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.TestDistributedSearch-1391951517841/control/data/index' doesn't exist. Creating new index...
[junit4] 2> 2246708 T8013 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.TestDistributedSearch-1391951517841/control/data/index
[junit4] 2> 2246708 T8013 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=48, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.2775643639325711]
[junit4] 2> 2246709 T8013 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@6c083daf lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@26281145)),segFN=segments_1,generation=1}
[junit4] 2> 2246710 T8013 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2246711 T8013 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4] 2> 2246715 T8013 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 2246716 T8013 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2246716 T8013 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe-allfields"
[junit4] 2> 2246717 T8013 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4] 2> 2246717 T8013 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 2246718 T8013 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2246718 T8013 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "uniq-fields"
[junit4] 2> 2246718 T8013 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4] 2> 2246719 T8013 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 2246720 T8013 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2246720 T8013 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2246720 T8013 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 2246721 T8013 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 2246722 T8013 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 2246722 T8013 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 2246723 T8013 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 2246724 T8013 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4] 2> 2246725 T8013 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4] 2> 2246725 T8013 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 2246726 T8013 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 2246727 T8013 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 2246727 T8013 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4] 2> 2246728 T8013 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4] 2> 2246728 T8013 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4] 2> 2246729 T8013 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 2246730 T8013 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 2246730 T8013 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 2246731 T8013 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 2246732 T8013 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 2246733 T8013 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 2246733 T8013 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 2246734 T8013 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 2246735 T8013 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 2246735 T8013 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4] 2> 2246736 T8013 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4] 2> 2246753 T8013 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2246756 T8013 oasc.SolrCore.initDeprecatedSupport WARN solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4] 2> 2246763 T8013 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 2246764 T8013 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 2246764 T8013 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=23, maxMergeAtOnceExplicit=21, maxMergedSegmentMB=83.0517578125, floorSegmentMB=0.4189453125, forceMergeDeletesPctAllowed=28.774481710451948, segmentsPerTier=40.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 2246765 T8013 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@6c083daf lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@26281145)),segFN=segments_1,generation=1}
[junit4] 2> 2246766 T8013 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2246766 T8013 oass.SolrIndexSearcher.<init> Opening Searcher@2f60e8b5[collection1] main
[junit4] 2> 2246767 T8013 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4] 2> 2246777 T8013 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4] 2> 2246858 T8014 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2f60e8b5[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 2246866 T8013 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 2246873 T8003 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 2246874 T8003 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 2246877 T8003 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2246885 T8003 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:51629
[junit4] 2> 2246886 T8003 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 2246887 T8003 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2246888 T8003 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr
[junit4] 2> 2246889 T8003 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/'
[junit4] 2> 2246941 T8003 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/solr.xml
[junit4] 2> 2247067 T8003 oasc.CoreContainer.<init> New CoreContainer 157787719
[junit4] 2> 2247068 T8003 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/]
[junit4] 2> 2247070 T8003 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 2247070 T8003 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 2247070 T8003 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 2247071 T8003 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 2247071 T8003 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 2247071 T8003 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 2247072 T8003 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 2247072 T8003 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 2247072 T8003 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 2247084 T8003 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2247085 T8003 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2247085 T8003 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 2247096 T8025 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1
[junit4] 2> 2247096 T8025 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/'
[junit4] 2> 2247098 T8025 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/lib/classes/' to classloader
[junit4] 2> 2247098 T8025 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/lib/README' to classloader
[junit4] 2> 2247211 T8025 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 2247282 T8025 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2247283 T8025 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 2247292 T8025 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 2248080 T8025 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 2248089 T8025 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2248094 T8025 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2248105 T8025 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2248113 T8025 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2248117 T8025 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2248118 T8025 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2248118 T8025 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2248118 T8025 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2248119 T8025 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2248120 T8025 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2248120 T8025 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 2248120 T8025 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/, dataDir=./org.apache.solr.TestDistributedSearch-1391951517841/shard0/data/
[junit4] 2> 2248121 T8025 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@357c4ab7
[junit4] 2> 2248122 T8025 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.TestDistributedSearch-1391951517841/shard0/data
[junit4] 2> 2248122 T8025 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.TestDistributedSearch-1391951517841/shard0/data/index/
[junit4] 2> 2248122 T8025 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.TestDistributedSearch-1391951517841/shard0/data/index' doesn't exist. Creating new index...
[junit4] 2> 2248123 T8025 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.TestDistributedSearch-1391951517841/shard0/data/index
[junit4] 2> 2248124 T8025 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=48, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.2775643639325711]
[junit4] 2> 2248125 T8025 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@2cf9de4a lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4a091569)),segFN=segments_1,generation=1}
[junit4] 2> 2248125 T8025 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2248126 T8025 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4] 2> 2248132 T8025 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 2248133 T8025 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2248133 T8025 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe-allfields"
[junit4] 2> 2248133 T8025 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4] 2> 2248134 T8025 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 2248134 T8025 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2248134 T8025 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "uniq-fields"
[junit4] 2> 2248134 T8025 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4] 2> 2248135 T8025 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 2248135 T8025 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2248136 T8025 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2248136 T8025 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 2248136 T8025 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 2248137 T8025 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 2248137 T8025 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 2248138 T8025 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 2248139 T8025 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4] 2> 2248139 T8025 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4] 2> 2248140 T8025 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 2248140 T8025 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 2248141 T8025 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 2248141 T8025 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4] 2> 2248142 T8025 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4] 2> 2248142 T8025 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4] 2> 2248142 T8025 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 2248143 T8025 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 2248144 T8025 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 2248145 T8025 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 2248145 T8025 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 2248146 T8025 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 2248146 T8025 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 2248148 T8025 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 2248149 T8025 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 2248150 T8025 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4] 2> 2248151 T8025 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4] 2> 2248165 T8025 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2248167 T8025 oasc.SolrCore.initDeprecatedSupport WARN solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4] 2> 2248174 T8025 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 2248175 T8025 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 2248176 T8025 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=23, maxMergeAtOnceExplicit=21, maxMergedSegmentMB=83.0517578125, floorSegmentMB=0.4189453125, forceMergeDeletesPctAllowed=28.774481710451948, segmentsPerTier=40.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 2248177 T8025 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@2cf9de4a lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4a091569)),segFN=segments_1,generation=1}
[junit4] 2> 2248177 T8025 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2248178 T8025 oass.SolrIndexSearcher.<init> Opening Searcher@2fe4163c[collection1] main
[junit4] 2> 2248178 T8025 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4] 2> 2248187 T8025 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4] 2> 2248255 T8026 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2fe4163c[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 2248267 T8025 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 2248269 T8003 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 2248270 T8003 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> ASYNC NEW_CORE C2151 name=collection1 org.apache.solr.core.SolrCore@652b7a4
[junit4] 2> 2248579 T8008 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1459566958099824640)} 0 2
[junit4] 2> ASYNC NEW_CORE C2152 name=collection1 org.apache.solr.core.SolrCore@3da74f91
[junit4] 2> 2248587 T8018 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1459566958108213248)} 0 2
[junit4] 2> 2248595 T8009 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[1 (1459566958115553280)]} 0 3
[junit4] 2> 2248601 T8019 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[1 (1459566958122893312)]} 0 2
[junit4] 2> 2248609 T8010 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[2 (1459566958130233344)]} 0 3
[junit4] 2> 2248616 T8020 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[2 (1459566958138621952)]} 0 2
[junit4] 2> 2248623 T8011 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[3 (1459566958145961984)]} 0 2
[junit4] 2> 2248630 T8021 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[3 (1459566958153302016)]} 0 2
[junit4] 2> 2248636 T8007 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[4 (1459566958159593472)]} 0 2
[junit4] 2> 2248646 T8022 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[4 (1459566958171127808)]} 0 1
[junit4] 2> 2248655 T8008 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[5 (1459566958178467840)]} 0 3
[junit4] 2> 2248667 T8023 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[5 (1459566958192099328)]} 0 2
[junit4] 2> 2248672 T8009 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[6 (1459566958198390784)]} 0 1
[junit4] 2> 2248680 T8018 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[6 (1459566958204682240)]} 0 3
[junit4] 2> 2248686 T8010 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[7 (1459566958212022272)]} 0 2
[junit4] 2> 2248692 T8019 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[7 (1459566958218313728)]} 0 2
[junit4] 2> 2248698 T8011 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[8 (1459566958225653760)]} 0 0
[junit4] 2> 2248705 T8020 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[8 (1459566958232993792)]} 0 1
[junit4] 2> 2248712 T8012 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[9 (1459566958239285248)]} 0 2
[junit4] 2> 2248717 T8021 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[9 (1459566958245576704)]} 0 1
[junit4] 2> 2248721 T8007 C2151 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 2248730 T8007 C2151 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4] 2> commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@6c083daf lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@26281145)),segFN=segments_1,generation=1}
[junit4] 2> commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@6c083daf lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@26281145)),segFN=segments_2,generation=2}
[junit4] 2> 2248733 T8007 C2151 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4] 2> 2248736 T8007 C2151 oass.SolrIndexSearcher.<init> Opening Searcher@443cb716[collection1] main
[junit4] 2> 2248737 T8007 C2151 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4] 2> 2248739 T8014 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@443cb716[collection1] main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):c9)}
[junit4] 2> 2248740 T8007 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={commit=true&wt=javabin&version=2&waitSearcher=true&softCommit=false} {commit=} 0 19
[junit4] 2> 2248744 T8022 C2152 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 2248752 T8022 C2152 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4] 2> commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@2cf9de4a lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4a091569)),segFN=segments_1,generation=1}
[junit4] 2> commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@2cf9de4a lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4a091569)),segFN=segments_2,generation=2}
[junit4] 2> 2248753 T8022 C2152 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4] 2> 2248755 T8022 C2152 oass.SolrIndexSearcher.<init> Opening Searcher@4dd98442[collection1] main
[junit4] 2> 2248756 T8022 C2152 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4] 2> 2248758 T8026 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4dd98442[collection1] main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):c9)}
[junit4] 2> 2248759 T8022 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={commit=true&wt=javabin&version=2&waitSearcher=true&softCommit=false} {commit=} 0 15
[junit4] 2> 2248766 T8008 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[10 (1459566958294859776)]} 0 3
[junit4] 2> 2248772 T8023 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[10 (1459566958301151232)]} 0 3
[junit4] 2> 2248777 T8009 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[11 (1459566958308491264)]} 0 1
[junit4] 2> 2248784 T8018 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[11 (1459566958314782720)]} 0 2
[junit4] 2> 2248788 T8010 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[12 (1459566958321074176)]} 0 1
[junit4] 2> 2248792 T8019 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[12 (1459566958324219904)]} 0 1
[junit4] 2> 2248802 T8011 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[13 (1459566958333657088)]} 0 2
[junit4] 2> 2248809 T8020 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[13 (1459566958340997120)]} 0 3
[junit4] 2> 2248814 T8012 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[1001 (1459566958346240000)]} 0 2
[junit4] 2> 2248819 T8021 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[1001 (1459566958351482880)]} 0 2
[junit4] 2> 2248825 T8007 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[14 (1459566958358822912)]} 0 1
[junit4] 2> 2248830 T8022 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[14 (1459566958364065792)]} 0 1
[junit4] 2> 2248835 T8008 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[15 (1459566958369308672)]} 0 1
[junit4] 2> 2248840 T8023 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[15 (1459566958373502976)]} 0 2
[junit4] 2> 2248845 T8009 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[16 (1459566958379794432)]} 0 2
[junit4] 2> 2248849 T8018 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[16 (1459566958383988736)]} 0 1
[junit4] 2> 2248856 T8010 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[17 (1459566958389231616)]} 0 3
[junit4] 2> 2248862 T8019 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[17 (1459566958396571648)]} 0 3
[junit4] 2> 2248871 T8011 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[100 (1459566958407057408)]} 0 1
[junit4] 2> 2248876 T8020 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[100 (1459566958412300288)]} 0 1
[junit4] 2> 2248883 T8012 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[101 (1459566958419640320)]} 0 1
[junit4] 2> 2248887 T8021 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[101 (1459566958423834624)]} 0 1
[junit4] 2> 2248893 T8007 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[102 (1459566958430126080)]} 0 1
[junit4] 2> 2248900 T8022 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[102 (1459566958437466112)]} 0 1
[junit4] 2> 2248906 T8008 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[103 (1459566958443757568)]} 0 1
[junit4] 2> 2248912 T8023 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[103 (1459566958449000448)]} 0 2
[junit4] 2> 2248917 T8009 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[104 (1459566958455291904)]} 0 1
[junit4] 2> 2248923 T8019 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[104 (1459566958461583360)]} 0 1
[junit4] 2> 2248928 T8010 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[105 (1459566958466826240)]} 0 1
[junit4] 2> 2248933 T8020 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[105 (1459566958472069120)]} 0 1
[junit4] 2> 2248942 T8011 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[106 (1459566958480457728)]} 0 2
[junit4] 2> 2248949 T8021 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[106 (1459566958488846336)]} 0 1
[junit4] 2> 2248955 T8012 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[107 (1459566958495137792)]} 0 1
[junit4] 2> 2248961 T8022 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[107 (1459566958501429248)]} 0 2
[junit4] 2> 2248969 T8007 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[108 (1459566958509817856)]} 0 1
[junit4] 2> 2248974 T8018 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[108 (1459566958515060736)]} 0 1
[junit4] 2> 2248980 T8008 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[109 (1459566958520303616)]} 0 2
[junit4] 2> 2248988 T8023 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[109 (1459566958528692224)]} 0 2
[junit4] 2> 2248992 T8009 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[110 (1459566958533935104)]} 0 1
[junit4] 2> 2249001 T8019 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[110 (1459566958543372288)]} 0 1
[junit4] 2> 2249006 T8010 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[111 (1459566958548615168)]} 0 1
[junit4] 2> 2249016 T8020 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[111 (1459566958559100928)]} 0 1
[junit4] 2> 2249022 T8011 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[112 (1459566958565392384)]} 0 1
[junit4] 2> 2249027 T8021 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[112 (1459566958570635264)]} 0 1
[junit4] 2> 2249032 T8012 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[113 (1459566958575878144)]} 0 1
[junit4] 2> 2249041 T8022 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[113 (1459566958584266752)]} 0 2
[junit4] 2> 2249046 T8008 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[114 (1459566958590558208)]} 0 1
[junit4] 2> 2249053 T8018 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[114 (1459566958597898240)]} 0 1
[junit4] 2> 2249058 T8009 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[115 (1459566958603141120)]} 0 1
[junit4] 2> 2249064 T8023 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[115 (1459566958608384000)]} 0 2
[junit4] 2> 2249069 T8010 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[116 (1459566958614675456)]} 0 1
[junit4] 2> 2249074 T8019 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[116 (1459566958619918336)]} 0 2
[junit4] 2> 2249079 T8011 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[117 (1459566958625161216)]} 0 2
[junit4] 2> 2249084 T8020 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[117 (1459566958630404096)]} 0 2
[junit4] 2> 2249090 T8007 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[118 (1459566958636695552)]} 0 1
[junit4] 2> 2249098 T8021 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[118 (1459566958644035584)]} 0 2
[junit4] 2> 2249104 T8012 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[119 (1459566958651375616)]} 0 2
[junit4] 2> 2249109 T8022 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[119 (1459566958655569920)]} 0 2
[junit4] 2> 2249115 T8008 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[120 (1459566958661861376)]} 0 2
[junit4] 2> 2249130 T8018 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[120 (1459566958678638592)]} 0 2
[junit4] 2> 2249136 T8009 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[121 (1459566958684930048)]} 0 1
[junit4] 2> 2249142 T8023 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[121 (1459566958690172928)]} 0 2
[junit4] 2> 2249148 T8010 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[122 (1459566958697512960)]} 0 1
[junit4] 2> 2249153 T8019 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[122 (1459566958702755840)]} 0 1
[junit4] 2> 2249159 T8011 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[123 (1459566958709047296)]} 0 2
[junit4] 2> 2249166 T8020 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[123 (1459566958715338752)]} 0 2
[junit4] 2> 2249171 T8007 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[124 (1459566958721630208)]} 0 1
[junit4] 2> 2249176 T8021 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[124 (1459566958726873088)]} 0 1
[junit4] 2> 2249181 T8012 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[125 (1459566958732115968)]} 0 2
[junit4] 2> 2249186 T8022 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[125 (1459566958737358848)]} 0 1
[junit4] 2> 2249190 T8008 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[126 (1459566958742601728)]} 0 1
[junit4] 2> 2249198 T8018 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[126 (1459566958748893184)]} 0 2
[junit4] 2> 2249203 T8009 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[127 (1459566958756233216)]} 0 0
[junit4] 2> 2249214 T8023 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[127 (1459566958766718976)]} 0 1
[junit4] 2> 2249229 T8010 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[128 (1459566958782447616)]} 0 2
[junit4] 2> 2249235 T8019 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[128 (1459566958788739072)]} 0 1
[junit4] 2> 2249245 T8011 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[129 (1459566958800273408)]} 0 0
[junit4] 2> 2249252 T8020 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[129 (1459566958805516288)]} 0 2
[junit4] 2> 2249258 T8007 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[130 (1459566958811807744)]} 0 2
[junit4] 2> 2249263 T8021 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[130 (1459566958818099200)]} 0 1
[junit4] 2> 2249269 T8012 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[131 (1459566958823342080)]} 0 2
[junit4] 2> 2249275 T8022 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[131 (1459566958829633536)]} 0 2
[junit4] 2> 2249280 T8008 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[132 (1459566958835924992)]} 0 1
[junit4] 2> 2249285 T8018 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[132 (1459566958841167872)]} 0 1
[junit4] 2> 2249291 T8009 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[133 (1459566958846410752)]} 0 2
[junit4] 2> 2249296 T8023 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[133 (1459566958852702208)]} 0 1
[junit4] 2> 2249302 T8010 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[134 (1459566958857945088)]} 0 2
[junit4] 2> 2249306 T8019 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[134 (1459566958864236544)]} 0 0
[junit4] 2> 2249316 T8011 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[135 (1459566958872625152)]} 0 2
[junit4] 2> 2249324 T8020 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[135 (1459566958882062336)]} 0 1
[junit4] 2> 2249330 T8007 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[136 (1459566958888353792)]} 0 1
[junit4] 2> 2249336 T8022 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[136 (1459566958893596672)]} 0 2
[junit4] 2> 2249341 T8012 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[137 (1459566958899888128)]} 0 1
[junit4] 2> 2249346 T8018 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[137 (1459566958905131008)]} 0 1
[junit4] 2> 2249352 T8008 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[138 (1459566958911422464)]} 0 1
[junit4] 2> 2249357 T8023 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[138 (1459566958916665344)]} 0 1
[junit4] 2> 2249363 T8009 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[139 (1459566958922956800)]} 0 2
[junit4] 2> 2249368 T8019 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[139 (1459566958928199680)]} 0 1
[junit4] 2> 2249374 T8010 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[140 (1459566958934491136)]} 0 1
[junit4] 2> 2249379 T8021 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[140 (1459566958939734016)]} 0 1
[junit4] 2> 2249384 T8011 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[141 (1459566958944976896)]} 0 1
[junit4] 2> 2249390 T8020 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[141 (1459566958951268352)]} 0 1
[junit4] 2> 2249395 T8007 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[142 (1459566958956511232)]} 0 1
[junit4] 2> 2249399 T8022 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[142 (1459566958960705536)]} 0 1
[junit4] 2> 2249405 T8012 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[143 (1459566958966996992)]} 0 1
[junit4] 2> 2249410 T8018 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[143 (1459566958972239872)]} 0 1
[junit4] 2> 2249415 T8008 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[144 (1459566958978531328)]} 0 1
[junit4] 2> 2249420 T8023 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[144 (1459566958982725632)]} 0 1
[junit4] 2> 2249425 T8009 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[145 (1459566958987968512)]} 0 1
[junit4] 2> 2249430 T8019 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[145 (1459566958993211392)]} 0 1
[junit4] 2> 2249434 T8010 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[146 (1459566958997405696)]} 0 1
[junit4] 2> 2249438 T8021 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[146 (1459566959002648576)]} 0 1
[junit4] 2> 2249442 T8007 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[147 (1459566959006842880)]} 0 0
[junit4] 2> 2249451 T8020 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[147 (1459566959015231488)]} 0 1
[junit4] 2> 2249460 T8012 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[148 (1459566959024668672)]} 0 1
[junit4] 2> 2249465 T8022 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[148 (1459566959029911552)]} 0 1
[junit4] 2> 2249469 T8008 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[149 (1459566959035154432)]} 0 0
[junit4] 2> 2249475 T8018 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={wt=javabin&version=2} {add=[149 (1459566959041445888)]} 0 0
[junit4] 2> 2249479 T8009 C2151 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 2249495 T8009 C2151 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4] 2> commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@6c083daf lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@26281145)),segFN=segments_2,generation=2}
[junit4] 2> commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@6c083daf lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@26281145)),segFN=segments_3,generation=3}
[junit4] 2> 2249497 T8009 C2151 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4] 2> 2249500 T8009 C2151 oass.SolrIndexSearcher.<init> Opening Searcher@4b4b0c3f[collection1] main
[junit4] 2> 2249501 T8009 C2151 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4] 2> 2249505 T8014 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4b4b0c3f[collection1] main{StandardDirectoryReader(segments_3:5:nrt _0(5.0):c9 _1(5.0):c59)}
[junit4] 2> 2249506 T8009 C2151 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={commit=true&wt=javabin&version=2&waitSearcher=true&softCommit=false} {commit=} 0 27
[junit4] 2> 2249509 T8023 C2152 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 2249525 T8023 C2152 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4] 2> commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@2cf9de4a lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4a091569)),segFN=segments_2,generation=2}
[junit4] 2> commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@2cf9de4a lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4a091569)),segFN=segments_3,generation=3}
[junit4] 2> 2249526 T8023 C2152 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4] 2> 2249530 T8023 C2152 oass.SolrIndexSearcher.<init> Opening Searcher@d9c91a2[collection1] main
[junit4] 2> 2249531 T8023 C2152 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4] 2> 2249533 T8026 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@d9c91a2[collection1] main{StandardDirectoryReader(segments_3:5:nrt _0(5.0):c9 _1(5.0):c59)}
[junit4] 2> 2249533 T8023 C2152 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_asc/s path=/update params={commit=true&wt=javabin&version=2&waitSearcher=true&softCommit=false} {commit=} 0 24
[junit4] 2> 2249539 T8011 C2151 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&version=2&q=*:*&distrib=false&sort=n_ti1+desc} hits=68 status=0 QTime=2
[junit4] 2> 2249557 T8021 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={fsv=true&wt=javabin&isShard=true&shard.url=[ff01::213]:33332/x_asc/s|127.0.0.1:51629/x_asc/s|[ff01::083]:33332/x_asc/s|[ff01::114]:33332/x_asc/s&version=2&q=*:*&distrib=false&rows=10&sort=n_ti1+desc&NOW=1391951521982&fl=id&start=0} hits=68 status=0 QTime=1
[junit4] 2> 2249564 T8020 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&isShard=true&shard.url=[ff01::213]:33332/x_asc/s|127.0.0.1:51629/x_asc/s|[ff01::083]:33332/x_asc/s|[ff01::114]:33332/x_asc/s&ids=142,10,1001,123,14,4,119,12,122,144&version=2&q=*:*&distrib=false&NOW=1391951521982} status=0 QTime=1
[junit4] 2> 2249568 T8019 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&version=2&shards=[ff01::213]:33332/x_asc/s|127.0.0.1:51629/x_asc/s|[ff01::083]:33332/x_asc/s|[ff01::114]:33332/x_asc/s&q=*:*&sort=n_ti1+desc} hits=68 status=0 QTime=24
[junit4] 2> 2249575 T8010 C2151 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&version=2&q=*:*&distrib=false&sort=n_ti1+asc} hits=68 status=0 QTime=1
[junit4] 2> 2249588 T8018 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={fsv=true&wt=javabin&isShard=true&shard.url=[ff01::114]:33332/x_asc/s|[ff01::083]:33332/x_asc/s|127.0.0.1:51629/x_asc/s&version=2&q=*:*&distrib=false&rows=10&sort=n_ti1+asc&NOW=1391951522020&fl=id&start=0} hits=68 status=0 QTime=1
[junit4] 2> 2249593 T8023 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&isShard=true&shard.url=[ff01::114]:33332/x_asc/s|[ff01::083]:33332/x_asc/s|127.0.0.1:51629/x_asc/s&ids=141,16,117,107,8,111,146,112,149,104&version=2&q=*:*&distrib=false&NOW=1391951522020} status=0 QTime=0
[junit4] 2> 2249602 T8022 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&version=2&shards=[ff01::114]:33332/x_asc/s|[ff01::083]:33332/x_asc/s|127.0.0.1:51629/x_asc/s&q=*:*&sort=n_ti1+asc} hits=68 status=0 QTime=20
[junit4] 2> 2249610 T8007 C2151 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&version=2&q=*:*&distrib=false&sort=n_f1+desc} hits=68 status=0 QTime=1
[junit4] 2> 2249625 T8020 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={fsv=true&wt=javabin&isShard=true&shard.url=127.0.0.1:51629/x_asc/s&version=2&q=*:*&distrib=false&rows=10&sort=n_f1+desc&NOW=1391951522054&fl=id&start=0} hits=68 status=0 QTime=1
[junit4] 2> 2249632 T8019 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&isShard=true&shard.url=127.0.0.1:51629/x_asc/s&ids=1001,123,1,130,146,12,143,11,145,106&version=2&q=*:*&distrib=false&NOW=1391951522054} status=0 QTime=1
[junit4] 2> 2249635 T8021 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&version=2&shards=127.0.0.1:51629/x_asc/s&q=*:*&sort=n_f1+desc} hits=68 status=0 QTime=19
[junit4] 2> 2249639 T8012 C2151 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&version=2&q=*:*&distrib=false&sort=n_f1+asc} hits=68 status=0 QTime=0
[junit4] 2> 2249656 T8023 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={fsv=true&wt=javabin&isShard=true&shard.url=[ff01::083]:33332/x_asc/s|[ff01::213]:33332/x_asc/s|127.0.0.1:51629/x_asc/s&version=2&q=*:*&distrib=false&rows=10&sort=n_f1+asc&NOW=1391951522087&fl=id&start=0} hits=68 status=0 QTime=0
[junit4] 2> 2249662 T8022 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&isShard=true&shard.url=[ff01::083]:33332/x_asc/s|[ff01::213]:33332/x_asc/s|127.0.0.1:51629/x_asc/s&ids=16,115,138,8,121,131,125,124,6,126&version=2&q=*:*&distrib=false&NOW=1391951522087} status=0 QTime=0
[junit4] 2> 2249671 T8018 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&version=2&shards=[ff01::083]:33332/x_asc/s|[ff01::213]:33332/x_asc/s|127.0.0.1:51629/x_asc/s&q=*:*&sort=n_f1+asc} hits=68 status=0 QTime=22
[junit4] 2> 2249676 T8008 C2151 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&version=2&q=*:*&distrib=false&sort=n_tf1+desc} hits=68 status=0 QTime=1
[junit4] 2> 2249685 T8019 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={fsv=true&wt=javabin&isShard=true&shard.url=127.0.0.1:51629/x_asc/s|[ff01::083]:33332/x_asc/s|[ff01::114]:33332/x_asc/s|[ff01::213]:33332/x_asc/s&version=2&q=*:*&distrib=false&rows=10&sort=n_tf1+desc&NOW=1391951522118&fl=id&start=0} hits=68 status=0 QTime=1
[junit4] 2> 2249692 T8021 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&isShard=true&shard.url=127.0.0.1:51629/x_asc/s|[ff01::083]:33332/x_asc/s|[ff01::114]:33332/x_asc/s|[ff01::213]:33332/x_asc/s&ids=10,128,103,1,117,8,12,122,147,149&version=2&q=*:*&distrib=false&NOW=1391951522118} status=0 QTime=1
[junit4] 2> 2249696 T8020 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&version=2&shards=127.0.0.1:51629/x_asc/s|[ff01::083]:33332/x_asc/s|[ff01::114]:33332/x_asc/s|[ff01::213]:33332/x_asc/s&q=*:*&sort=n_tf1+desc} hits=68 status=0 QTime=16
[junit4] 2> 2249701 T8009 C2151 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&version=2&q=*:*&distrib=false&sort=n_tf1+asc} hits=68 status=0 QTime=1
[junit4] 2> 2249714 T8022 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={fsv=true&wt=javabin&isShard=true&shard.url=127.0.0.1:51629/x_asc/s|[ff01::114]:33332/x_asc/s|[ff01::213]:33332/x_asc/s&version=2&q=*:*&distrib=false&rows=10&sort=n_tf1+asc&NOW=1391951522146&fl=id&start=0} hits=68 status=0 QTime=0
[junit4] 2> 2249721 T8018 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&isShard=true&shard.url=127.0.0.1:51629/x_asc/s|[ff01::114]:33332/x_asc/s|[ff01::213]:33332/x_asc/s&ids=17,115,118,121,108,131,104,101,120,133&version=2&q=*:*&distrib=false&NOW=1391951522146} status=0 QTime=1
[junit4] 2> 2249724 T8023 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&version=2&shards=127.0.0.1:51629/x_asc/s|[ff01::114]:33332/x_asc/s|[ff01::213]:33332/x_asc/s&q=*:*&sort=n_tf1+asc} hits=68 status=0 QTime=16
[junit4] 2> 2249734 T8011 C2151 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&version=2&q=*:*&distrib=false&sort=n_d1+desc} hits=68 status=0 QTime=1
[junit4] 2> 2249753 T8020 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={fsv=true&wt=javabin&isShard=true&shard.url=127.0.0.1:51629/x_asc/s&version=2&q=*:*&distrib=false&rows=10&sort=n_d1+desc&NOW=1391951522177&fl=id&start=0} hits=68 status=0 QTime=1
[junit4] 2> 2249759 T8022 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&isShard=true&shard.url=127.0.0.1:51629/x_asc/s&ids=116,114,130,8,134,131,147,149,126,136&version=2&q=*:*&distrib=false&NOW=1391951522177} status=0 QTime=1
[junit4] 2> 2249761 T8021 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&version=2&shards=127.0.0.1:51629/x_asc/s&q=*:*&sort=n_d1+desc} hits=68 status=0 QTime=22
[junit4] 2> 2249765 T8010 C2151 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&version=2&q=*:*&distrib=false&sort=n_d1+asc} hits=68 status=0 QTime=0
[junit4] 2> 2249773 T8023 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={fsv=true&wt=javabin&isShard=true&shard.url=[ff01::083]:33332/x_asc/s|[ff01::114]:33332/x_asc/s|127.0.0.1:51629/x_asc/s&version=2&q=*:*&distrib=false&rows=10&sort=n_d1+asc&NOW=1391951522208&fl=id&start=0} hits=68 status=0 QTime=0
[junit4] 2> 2249784 T8019 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&isShard=true&shard.url=[ff01::083]:33332/x_asc/s|[ff01::114]:33332/x_asc/s|127.0.0.1:51629/x_asc/s&ids=128,118,123,137,139,146,3,9,6,7&version=2&q=*:*&distrib=false&NOW=1391951522208} status=0 QTime=1
[junit4] 2> 2249786 T8018 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&version=2&shards=[ff01::083]:33332/x_asc/s|[ff01::114]:33332/x_asc/s|127.0.0.1:51629/x_asc/s&q=*:*&sort=n_d1+asc} hits=68 status=0 QTime=16
[junit4] 2> 2249796 T8007 C2151 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&version=2&q=*:*&distrib=false&sort=n_td1+desc} hits=68 status=0 QTime=1
[junit4] 2> 2249810 T8022 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={fsv=true&wt=javabin&isShard=true&shard.url=[ff01::083]:33332/x_asc/s|[ff01::213]:33332/x_asc/s|[ff01::114]:33332/x_asc/s|127.0.0.1:51629/x_asc/s&version=2&q=*:*&distrib=false&rows=10&sort=n_td1+desc&NOW=1391951522242&fl=id&start=0} hits=68 status=0 QTime=1
[junit4] 2> 2249821 T8021 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&isShard=true&shard.url=[ff01::083]:33332/x_asc/s|[ff01::213]:33332/x_asc/s|[ff01::114]:33332/x_asc/s|127.0.0.1:51629/x_asc/s&ids=140,109,17,107,138,15,146,145,6,133&version=2&q=*:*&distrib=false&NOW=1391951522242} status=0 QTime=1
[junit4] 2> 2249823 T8020 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&version=2&shards=[ff01::083]:33332/x_asc/s|[ff01::213]:33332/x_asc/s|[ff01::114]:33332/x_asc/s|127.0.0.1:51629/x_asc/s&q=*:*&sort=n_td1+desc} hits=68 status=0 QTime=19
[junit4] 2> 2249828 T8012 C2151 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&version=2&q=*:*&distrib=false&sort=n_td1+asc} hits=68 status=0 QTime=0
[junit4] 2> 2249840 T8019 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={fsv=true&wt=javabin&isShard=true&shard.url=[ff01::213]:33332/x_asc/s|127.0.0.1:51629/x_asc/s|[ff01::083]:33332/x_asc/s&version=2&q=*:*&distrib=false&rows=10&sort=n_td1+asc&NOW=1391951522273&fl=id&start=0} hits=68 status=0 QTime=1
[junit4] 2> 2249846 T8018 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&isShard=true&shard.url=[ff01::213]:33332/x_asc/s|127.0.0.1:51629/x_asc/s|[ff01::083]:33332/x_asc/s&ids=16,100,4,131,148,112,143,101,106,120&version=2&q=*:*&distrib=false&NOW=1391951522273} status=0 QTime=0
[junit4] 2> 2249849 T8023 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&version=2&shards=[ff01::213]:33332/x_asc/s|127.0.0.1:51629/x_asc/s|[ff01::083]:33332/x_asc/s&q=*:*&sort=n_td1+asc} hits=68 status=0 QTime=14
[junit4] 2> 2249855 T8008 C2151 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&version=2&q=*:*&distrib=false&sort=n_l1+desc} hits=68 status=0 QTime=1
[junit4] 2> 2249863 T8021 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={fsv=true&wt=javabin&isShard=true&shard.url=[ff01::114]:33332/x_asc/s|[ff01::213]:33332/x_asc/s|[ff01::083]:33332/x_asc/s|127.0.0.1:51629/x_asc/s&version=2&q=*:*&distrib=false&rows=10&sort=n_l1+desc&NOW=1391951522297&fl=id&start=0} hits=68 status=0 QTime=1
[junit4] 2> 2249872 T8020 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&isShard=true&shard.url=[ff01::114]:33332/x_asc/s|[ff01::213]:33332/x_asc/s|[ff01::083]:33332/x_asc/s|127.0.0.1:51629/x_asc/s&ids=135,110,100,123,138,8,121,134,146,106&version=2&q=*:*&distrib=false&NOW=1391951522297} status=0 QTime=1
[junit4] 2> 2249874 T8022 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&version=2&shards=[ff01::114]:33332/x_asc/s|[ff01::213]:33332/x_asc/s|[ff01::083]:33332/x_asc/s|127.0.0.1:51629/x_asc/s&q=*:*&sort=n_l1+desc} hits=68 status=0 QTime=15
[junit4] 2> 2249878 T8011 C2151 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&version=2&q=*:*&distrib=false&sort=n_l1+asc} hits=68 status=0 QTime=0
[junit4] 2> 2249886 T8018 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={fsv=true&wt=javabin&isShard=true&shard.url=[ff01::213]:33332/x_asc/s|127.0.0.1:51629/x_asc/s&version=2&q=*:*&distrib=false&rows=10&sort=n_l1+asc&NOW=1391951522321&fl=id&start=0} hits=68 status=0 QTime=0
[junit4] 2> 2249892 T8023 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&isShard=true&shard.url=[ff01::213]:33332/x_asc/s|127.0.0.1:51629/x_asc/s&ids=109,1,102,130,127,5,147,145,149,136&version=2&q=*:*&distrib=false&NOW=1391951522321} status=0 QTime=2
[junit4] 2> 2249894 T8019 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&version=2&shards=[ff01::213]:33332/x_asc/s|127.0.0.1:51629/x_asc/s&q=*:*&sort=n_l1+asc} hits=68 status=0 QTime=11
[junit4] 2> 2249900 T8010 C2151 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&version=2&q=*:*&distrib=false&sort=n_tl1+desc} hits=68 status=0 QTime=1
[junit4] 2> 2249908 T8020 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={fsv=true&wt=javabin&isShard=true&shard.url=[ff01::083]:33332/x_asc/s|127.0.0.1:51629/x_asc/s|[ff01::213]:33332/x_asc/s|[ff01::114]:33332/x_asc/s&version=2&q=*:*&distrib=false&rows=10&sort=n_tl1+desc&NOW=1391951522342&fl=id&start=0} hits=68 status=0 QTime=1
[junit4] 2> 2249913 T8022 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&isShard=true&shard.url=[ff01::083]:33332/x_asc/s|127.0.0.1:51629/x_asc/s|[ff01::213]:33332/x_asc/s|[ff01::114]:33332/x_asc/s&ids=10,109,127,130,107,12,148,13,136,7&version=2&q=*:*&distrib=false&NOW=1391951522342} status=0 QTime=1
[junit4] 2> 2249916 T8021 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&version=2&shards=[ff01::083]:33332/x_asc/s|127.0.0.1:51629/x_asc/s|[ff01::213]:33332/x_asc/s|[ff01::114]:33332/x_asc/s&q=*:*&sort=n_tl1+desc} hits=68 status=0 QTime=12
[junit4] 2> 2249922 T8007 C2151 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&version=2&q=*:*&distrib=false&sort=n_tl1+asc} hits=68 status=0 QTime=0
[junit4] 2> 2249932 T8023 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={fsv=true&wt=javabin&isShard=true&shard.url=127.0.0.1:51629/x_asc/s&version=2&q=*:*&distrib=false&rows=10&sort=n_tl1+asc&NOW=1391951522367&fl=id&start=0} hits=68 status=0 QTime=0
[junit4] 2> 2249937 T8019 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&isShard=true&shard.url=127.0.0.1:51629/x_asc/s&ids=139,137,119,122,143,149,106,120,126,144&version=2&q=*:*&distrib=false&NOW=1391951522367} status=0 QTime=1
[junit4] 2> 2249940 T8018 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&version=2&shards=127.0.0.1:51629/x_asc/s&q=*:*&sort=n_tl1+asc} hits=68 status=0 QTime=11
[junit4] 2> 2249946 T8012 C2151 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&version=2&q=*:*&distrib=false&sort=n_dt1+desc} hits=68 status=0 QTime=2
[junit4] 2> 2249954 T8022 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={fsv=true&wt=javabin&isShard=true&shard.url=[ff01::114]:33332/x_asc/s|127.0.0.1:51629/x_asc/s|[ff01::083]:33332/x_asc/s|[ff01::213]:33332/x_asc/s&version=2&q=*:*&distrib=false&rows=10&sort=n_dt1+desc&NOW=1391951522388&fl=id&start=0} hits=68 status=0 QTime=1
[junit4] 2> 2249960 T8021 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&isShard=true&shard.url=[ff01::114]:33332/x_asc/s|127.0.0.1:51629/x_asc/s|[ff01::083]:33332/x_asc/s|[ff01::213]:33332/x_asc/s&ids=109,113,103,100,102,105,146,134,15,120&version=2&q=*:*&distrib=false&NOW=1391951522388} status=0 QTime=1
[junit4] 2> 2249962 T8020 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&version=2&shards=[ff01::114]:33332/x_asc/s|127.0.0.1:51629/x_asc/s|[ff01::083]:33332/x_asc/s|[ff01::213]:33332/x_asc/s&q=*:*&sort=n_dt1+desc} hits=68 status=0 QTime=12
[junit4] 2> 2249966 T8009 C2151 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&version=2&q=*:*&distrib=false&sort=n_dt1+asc} hits=68 status=0 QTime=1
[junit4] 2> 2249973 T8019 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={fsv=true&wt=javabin&isShard=true&shard.url=127.0.0.1:51629/x_asc/s|[ff01::083]:33332/x_asc/s|[ff01::213]:33332/x_asc/s&version=2&q=*:*&distrib=false&rows=10&sort=n_dt1+asc&NOW=1391951522408&fl=id&start=0} hits=68 status=0 QTime=0
[junit4] 2> 2249978 T8018 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&isShard=true&shard.url=127.0.0.1:51629/x_asc/s|[ff01::083]:33332/x_asc/s|[ff01::213]:33332/x_asc/s&ids=10,128,17,139,127,108,143,132,145,133&version=2&q=*:*&distrib=false&NOW=1391951522408} status=0 QTime=1
[junit4] 2> 2249981 T8023 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&version=2&shards=127.0.0.1:51629/x_asc/s|[ff01::083]:33332/x_asc/s|[ff01::213]:33332/x_asc/s&q=*:*&sort=n_dt1+asc} hits=68 status=0 QTime=11
[junit4] 2> 2249986 T8008 C2151 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&version=2&q=*:*&distrib=false&sort=n_tdt1+desc} hits=68 status=0 QTime=1
[junit4] 2> 2249993 T8021 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={fsv=true&wt=javabin&isShard=true&shard.url=127.0.0.1:51629/x_asc/s|[ff01::083]:33332/x_asc/s|[ff01::114]:33332/x_asc/s&version=2&q=*:*&distrib=false&rows=10&sort=n_tdt1+desc&NOW=1391951522427&fl=id&start=0} hits=68 status=0 QTime=1
[junit4] 2> 2249999 T8020 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&isShard=true&shard.url=127.0.0.1:51629/x_asc/s|[ff01::083]:33332/x_asc/s|[ff01::114]:33332/x_asc/s&ids=141,111,119,12,122,148,13,104,6,9&version=2&q=*:*&distrib=false&NOW=1391951522427} status=0 QTime=1
[junit4] 2> 2250001 T8022 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&version=2&shards=127.0.0.1:51629/x_asc/s|[ff01::083]:33332/x_asc/s|[ff01::114]:33332/x_asc/s&q=*:*&sort=n_tdt1+desc} hits=68 status=0 QTime=12
[junit4] 2> 2250010 T8011 C2151 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&version=2&q=*:*&distrib=false&sort=n_tdt1+asc} hits=68 status=0 QTime=0
[junit4] 2> 2250023 T8018 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={fsv=true&wt=javabin&isShard=true&shard.url=127.0.0.1:51629/x_asc/s&version=2&q=*:*&distrib=false&rows=10&sort=n_tdt1+asc&NOW=1391951522453&fl=id&start=0} hits=68 status=0 QTime=0
[junit4] 2> 2250030 T8023 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&isShard=true&shard.url=127.0.0.1:51629/x_asc/s&ids=128,103,114,100,1,117,134,112,129,143&version=2&q=*:*&distrib=false&NOW=1391951522453} status=0 QTime=0
[junit4] 2> 2250033 T8019 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&version=2&shards=127.0.0.1:51629/x_asc/s&q=*:*&sort=n_tdt1+asc} hits=68 status=0 QTime=18
[junit4] 2> 2250038 T8010 C2151 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&version=2&q=*:*&distrib=false&sort=a_si+desc} hits=68 status=0 QTime=1
[junit4] 2> 2250046 T8020 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={fsv=true&wt=javabin&isShard=true&shard.url=[ff01::083]:33332/x_asc/s|127.0.0.1:51629/x_asc/s|[ff01::114]:33332/x_asc/s&version=2&q=*:*&distrib=false&rows=10&sort=a_si+desc&NOW=1391951522480&fl=id&start=0} hits=68 status=0 QTime=0
[junit4] 2> 2250051 T8022 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&isShard=true&shard.url=[ff01::083]:33332/x_asc/s|127.0.0.1:51629/x_asc/s|[ff01::114]:33332/x_asc/s&ids=10,1,8,5,12,13,2,9,3,7&version=2&q=*:*&distrib=false&NOW=1391951522480} status=0 QTime=0
[junit4] 2> 2250054 T8021 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&version=2&shards=[ff01::083]:33332/x_asc/s|127.0.0.1:51629/x_asc/s|[ff01::114]:33332/x_asc/s&q=*:*&sort=a_si+desc} hits=68 status=0 QTime=12
[junit4] 2> 2250058 T8007 C2151 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&version=2&q=*:*&distrib=false&sort={!func}testfunc(add(a_si,5))+desc} hits=68 status=0 QTime=1
[junit4] 2> 2250066 T8023 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={fsv=true&wt=javabin&isShard=true&shard.url=[ff01::213]:33332/x_asc/s|[ff01::083]:33332/x_asc/s|[ff01::114]:33332/x_asc/s|127.0.0.1:51629/x_asc/s&version=2&q=*:*&distrib=false&rows=10&sort={!func}testfunc(add(a_si,5))+desc&NOW=1391951522500&fl=id&start=0} hits=68 status=0 QTime=1
[junit4] 2> 2250071 T8019 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&isShard=true&shard.url=[ff01::213]:33332/x_asc/s|[ff01::083]:33332/x_asc/s|[ff01::114]:33332/x_asc/s|127.0.0.1:51629/x_asc/s&ids=10,1,8,5,12,13,2,9,3,7&version=2&q=*:*&distrib=false&NOW=1391951522500} status=0 QTime=1
[junit4] 2> 2250073 T8018 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&version=2&shards=[ff01::213]:33332/x_asc/s|[ff01::083]:33332/x_asc/s|[ff01::114]:33332/x_asc/s|127.0.0.1:51629/x_asc/s&q=*:*&sort={!func}testfunc(add(a_si,5))+desc} hits=68 status=0 QTime=11
[junit4] 2> 2250078 T8012 C2151 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&version=2&q=*:*&distrib=false&sort=a_si+asc} hits=68 status=0 QTime=0
[junit4] 2> 2250086 T8022 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={fsv=true&wt=javabin&isShard=true&shard.url=127.0.0.1:51629/x_asc/s|[ff01::083]:33332/x_asc/s&version=2&q=*:*&distrib=false&rows=10&sort=a_si+asc&NOW=1391951522520&fl=id&start=0} hits=68 status=0 QTime=1
[junit4] 2> 2250093 T8021 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&isShard=true&shard.url=127.0.0.1:51629/x_asc/s|[ff01::083]:33332/x_asc/s&ids=1,4,12,11,13,2,6,3,9,7&version=2&q=*:*&distrib=false&NOW=1391951522520} status=0 QTime=0
[junit4] 2> 2250096 T8020 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&version=2&shards=127.0.0.1:51629/x_asc/s|[ff01::083]:33332/x_asc/s&q=*:*&sort=a_si+asc} hits=68 status=0 QTime=14
[junit4] 2> 2250100 T8009 C2151 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&version=2&q=*:*&distrib=false&sort=a_si+desc&fl=*,score} hits=68 status=0 QTime=0
[junit4] 2> 2250109 T8019 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={fsv=true&wt=javabin&isShard=true&shard.url=[ff01::083]:33332/x_asc/s|[ff01::213]:33332/x_asc/s|127.0.0.1:51629/x_asc/s|[ff01::114]:33332/x_asc/s&version=2&q=*:*&distrib=false&rows=10&sort=a_si+desc&NOW=1391951522543&start=0&fl=id,score} hits=68 status=0 QTime=1
[junit4] 2> 2250115 T8018 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&isShard=true&shard.url=[ff01::083]:33332/x_asc/s|[ff01::213]:33332/x_asc/s|127.0.0.1:51629/x_asc/s|[ff01::114]:33332/x_asc/s&ids=10,1,8,5,12,13,2,9,3,7&version=2&q=*:*&distrib=false&NOW=1391951522543&fl=*,score} status=0 QTime=1
[junit4] 2> 2250120 T8023 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&version=2&shards=[ff01::083]:33332/x_asc/s|[ff01::213]:33332/x_asc/s|127.0.0.1:51629/x_asc/s|[ff01::114]:33332/x_asc/s&q=*:*&sort=a_si+desc&fl=*,score} hits=68 status=0 QTime=15
[junit4] 2> 2250124 T8008 C2151 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&version=2&q=*:*&distrib=false&sort=n_tl1+asc&fl=*,score} hits=68 status=0 QTime=1
[junit4] 2> 2250133 T8020 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={fsv=true&wt=javabin&isShard=true&shard.url=[ff01::213]:33332/x_asc/s|[ff01::114]:33332/x_asc/s|127.0.0.1:51629/x_asc/s&version=2&q=*:*&distrib=false&rows=10&sort=n_tl1+asc&NOW=1391951522568&start=0&fl=id,score} hits=68 status=0 QTime=0
[junit4] 2> 2250138 T8019 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&isShard=true&shard.url=[ff01::213]:33332/x_asc/s|[ff01::114]:33332/x_asc/s|127.0.0.1:51629/x_asc/s&ids=139,137,119,122,143,149,106,120,126,144&version=2&q=*:*&distrib=false&NOW=1391951522568&fl=*,score} status=0 QTime=1
[junit4] 2> 2250140 T8022 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&version=2&shards=[ff01::213]:33332/x_asc/s|[ff01::114]:33332/x_asc/s|127.0.0.1:51629/x_asc/s&q=*:*&sort=n_tl1+asc&fl=*,score} hits=68 status=0 QTime=10
[junit4] 2> 2250144 T8011 C2151 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={wt=javabin&version=2&q=*:*&distrib=false&sort=n_tl1+desc} hits=68 status=0 QTime=0
[junit4] 2> 2250154 T8023 C2152 oasc.SolrCore.execute [collection1] webapp=/x_asc/s path=/select params={fsv=true&wt=javabin&isShard=true&shar
[...truncated too long message...]
y.close Closing directory: ./org.apache.solr.TestDistributedSearch-1391951517841/shard0/data/index
[junit4] 2> 2261756 T8003 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.TestDistributedSearch-1391951517841/shard0/data [CachedDir<<refCount=0;path=./org.apache.solr.TestDistributedSearch-1391951517841/shard0/data;done=false>>]
[junit4] 2> 2261757 T8003 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.TestDistributedSearch-1391951517841/shard0/data
[junit4] 2> 2261758 T8003 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/x_asc/s,null}
[junit4] 2> 2261826 T8003 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=586255370
[junit4] 2> 2261832 T8003 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@6f6a62d0
[junit4] 2> 2261857 T8003 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=3,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=36,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0,transaction_logs_total_size=8888,transaction_logs_total_number=3}
[junit4] 2> 2261858 T8003 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 2261858 T8003 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 2261859 T8003 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 2261862 T8003 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 2261863 T8003 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 2261863 T8003 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.TestDistributedSearch-1391951517841/shard1/data/index [CachedDir<<refCount=0;path=./org.apache.solr.TestDistributedSearch-1391951517841/shard1/data/index;done=false>>]
[junit4] 2> 2261864 T8003 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.TestDistributedSearch-1391951517841/shard1/data/index
[junit4] 2> 2261865 T8003 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.TestDistributedSearch-1391951517841/shard1/data [CachedDir<<refCount=0;path=./org.apache.solr.TestDistributedSearch-1391951517841/shard1/data;done=false>>]
[junit4] 2> 2261865 T8003 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.TestDistributedSearch-1391951517841/shard1/data
[junit4] 2> 2261872 T8003 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/x_asc/s,null}
[junit4] 2> 2261977 T8003 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestDistributedSearch -Dtests.method=testDistribSearch -Dtests.seed=B24F1E52FD92E561 -Dtests.slow=true -Dtests.locale=th_TH -Dtests.timezone=America/Argentina/Buenos_Aires -Dtests.file.encoding=UTF-8
[junit4] FAILURE 16.6s | TestDistributedSearch.testDistribSearch <<<
[junit4] > Throwable #1: java.lang.AssertionError: Expected the partialResults header to be null
[junit4] > at __randomizedtesting.SeedInfo.seed([B24F1E52FD92E561:33A9904A8ACD855D]:0)
[junit4] > at org.apache.solr.TestDistributedSearch.validateControlData(TestDistributedSearch.java:525)
[junit4] > at org.apache.solr.TestDistributedSearch.queryPartialResults(TestDistributedSearch.java:445)
[junit4] > at org.apache.solr.TestDistributedSearch.doTest(TestDistributedSearch.java:379)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:873)
[junit4] > at java.lang.Thread.run(Thread.java:744)
[junit4] 2> 2261993 T8003 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> NOTE: test params are: codec=Lucene40, sim=DefaultSimilarity, locale=th_TH, timezone=America/Argentina/Buenos_Aires
[junit4] 2> NOTE: Mac OS X 10.8.5 x86_64/Oracle Corporation 1.7.0_51 (64-bit)/cpus=2,threads=1,free=176981448,total=492306432
[junit4] 2> NOTE: All tests run in this JVM: [TestModifyConfFiles, CursorMarkTest, TestQueryUtils, OverseerTest, TermsComponentTest, OpenCloseCoreStressTest, MoreLikeThisHandlerTest, SearchHandlerTest, TestRangeQuery, ClusterStateUpdateTest, DocValuesTest, CollectionsAPIDistributedZkTest, DocValuesMissingTest, TestSolrQueryParser, BadCopyFieldTest, DirectSolrConnectionTest, HardAutoCommitTest, RegexBoostProcessorTest, TestPartialUpdateDeduplication, TestRandomDVFaceting, TestInfoStreamLogging, TestCSVResponseWriter, TestCopyFieldCollectionResource, MigrateRouteKeyTest, TestIndexingPerformance, TestSchemaResource, InfoHandlerTest, TestDefaultSimilarityFactory, SimplePostToolTest, CachingDirectoryFactoryTest, TestAddFieldRealTimeGet, TestCursorMarkWithoutUniqueKey, TestFieldResource, TestAtomicUpdateErrorCases, CoreAdminCreateDiscoverTest, TestLMJelinekMercerSimilarityFactory, TestJmxMonitoredMap, DateMathParserTest, SpellCheckCollatorTest, CoreAdminHandlerTest, TestExtendedDismaxParser, PreAnalyzedFieldTest, PreAnalyzedUpdateProcessorTest, HdfsBasicDistributedZk2Test, TestRTGBase, BasicDistributedZk2Test, DistribCursorPagingTest, TriLevelCompositeIdRoutingTest, MBeansHandlerTest, TestUpdate, SliceStateTest, TestCoreContainer, PolyFieldTest, AnalysisErrorHandlingTest, LukeRequestHandlerTest, TestSchemaVersionResource, NoCacheHeaderTest, LeaderElectionTest, TestCodecSupport, TestMergePolicyConfig, TestCoreDiscovery, TestAnalyzedSuggestions, RangeFacetTest, RequestHandlersTest, SolrXmlInZkTest, CurrencyFieldXmlFileTest, CSVRequestHandlerTest, TestQuerySenderNoQuery, PluginInfoTest, TestDocBasedVersionConstraints, TestSerializedLuceneMatchVersion, SuggesterTest, UpdateRequestProcessorFactoryTest, SimpleFacetsTest, TestSolrXMLSerializer, TestOmitPositions, TestSweetSpotSimilarityFactory, IndexSchemaRuntimeFieldTest, TestSolrDeletionPolicy1, CursorPagingTest, HdfsChaosMonkeySafeLeaderTest, XsltUpdateRequestHandlerTest, CurrencyFieldOpenExchangeTest, TestUtils, ConvertedLegacyTest, TestJmxIntegration, ShardRoutingCustomTest, TestStressUserVersions, TestLazyCores, FileUtilsTest, CacheHeaderTest, TestFastOutputStream, TestDFRSimilarityFactory, TestFastWriter, TestCollationField, BlockCacheTest, DisMaxRequestHandlerTest, TestCSVLoader, TermVectorComponentTest, TestSolrJ, TestHashPartitioner, TestSolrXmlPersistence, SystemInfoHandlerTest, TestIndexSearcher, UniqFieldsUpdateProcessorFactoryTest, TestQueryTypes, TestSurroundQueryParser, TestFunctionQuery, TestJoin, TestLuceneMatchVersion, TestPhraseSuggestions, SolrCoreTest, TestReload, EchoParamsTest, DistributedSuggestComponentTest, TestSolrDeletionPolicy2, TestAnalyzeInfixSuggestions, URLClassifyProcessorTest, DocValuesMultiTest, AddSchemaFieldsUpdateProcessorFactoryTest, UnloadDistributedZkTest, CopyFieldTest, ZkCLITest, TestBinaryResponseWriter, TestFoldingMultitermQuery, UUIDFieldTest, TestReplicationHandler, TestSearchPerf, ZkNodePropsTest, AnalysisAfterCoreReloadTest, PathHierarchyTokenizerFactoryTest, ShowFileRequestHandlerTest, TestValueSourceCache, DistributedTermsComponentTest, NotRequiredUniqueKeyTest, TestFaceting, TestCollationFieldDocValues, TestBM25SimilarityFactory, TestShardHandlerFactory, DocumentAnalysisRequestHandlerTest, SOLR749Test, StatelessScriptUpdateProcessorFactoryTest, TestUniqueKeyFieldResource, TestSolrXmlPersistor, TestStressRecovery, TestRemoteStreaming, DistributedSpellCheckComponentTest, TestNRTOpen, OverseerCollectionProcessorTest, FullSolrCloudDistribCmdsTest, FileBasedSpellCheckerTest, TestIBSimilarityFactory, WordBreakSolrSpellCheckerTest, TestStressLucene, BasicZkTest, BadComponentTest, TestPseudoReturnFields, OpenExchangeRatesOrgProviderTest, ScriptEngineTest, NoFacetTest, TestDistributedGrouping, DistanceFunctionTest, AddBlockUpdateTest, TestReversedWildcardFilterFactory, QueryResultKeyTest, HighlighterTest, TestRecovery, DocumentBuilderTest, TestArbitraryIndexDir, MultiTermTest, FieldFacetExtrasTest, FieldAnalysisRequestHandlerTest, TestStressReorder, TestWordDelimiterFilterFactory, HdfsSyncSliceTest, DateFieldTest, BasicDistributedZkTest, ChaosMonkeySafeLeaderTest, SyncSliceTest, LeaderElectionIntegrationTest, ShardRoutingTest, RecoveryZkTest, TestRandomFaceting, ZkSolrClientTest, TestZkChroot, SliceStateUpdateTest, TestDistributedSearch]
[junit4] Completed in 16.68s, 1 test, 1 failure <<< FAILURES!
[...truncated 540 lines...]
BUILD FAILED
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:453: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:433: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:39: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/extra-targets.xml:37: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build.xml:189: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/common-build.xml:491: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:1268: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:901: There were test failures: 370 suites, 1599 tests, 1 failure, 40 ignored (6 assumptions)
Total time: 86 minutes 34 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0 -XX:-UseCompressedOops -XX:+UseParallelGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.7.0) - Build # 1311
- Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-MacOSX/1311/
Java: 64bit/jdk1.7.0 -XX:-UseCompressedOops -XX:+UseSerialGC
1 tests failed.
REGRESSION: org.apache.lucene.store.TestRateLimiter.testPause
Error Message:
we should sleep less than 2 seconds but did: 2625 millis
Stack Trace:
java.lang.AssertionError: we should sleep less than 2 seconds but did: 2625 millis
at __randomizedtesting.SeedInfo.seed([C9CC1B5633AFC362:AF6C5F68B8829A64]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.lucene.store.TestRateLimiter.testPause(TestRateLimiter.java:37)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:744)
Build Log:
[...truncated 584 lines...]
[junit4] Suite: org.apache.lucene.store.TestRateLimiter
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestRateLimiter -Dtests.method=testPause -Dtests.seed=C9CC1B5633AFC362 -Dtests.slow=true -Dtests.locale=mk -Dtests.timezone=America/Costa_Rica -Dtests.file.encoding=US-ASCII
[junit4] FAILURE 2.64s | TestRateLimiter.testPause <<<
[junit4] > Throwable #1: java.lang.AssertionError: we should sleep less than 2 seconds but did: 2625 millis
[junit4] > at __randomizedtesting.SeedInfo.seed([C9CC1B5633AFC362:AF6C5F68B8829A64]:0)
[junit4] > at org.apache.lucene.store.TestRateLimiter.testPause(TestRateLimiter.java:37)
[junit4] > at java.lang.Thread.run(Thread.java:744)
[junit4] 2> NOTE: test params are: codec=CheapBastard, sim=DefaultSimilarity, locale=mk, timezone=America/Costa_Rica
[junit4] 2> NOTE: Mac OS X 10.8.5 x86_64/Oracle Corporation 1.7.0_51 (64-bit)/cpus=2,threads=1,free=236738992,total=324739072
[junit4] 2> NOTE: All tests run in this JVM: [TestNorms, TestDirectoryReader, TestDocCount, TestExternalCodecs, TestOpenBitSet, TestPrefixInBooleanQuery, TestDateFilter, TestCharTermAttributeImpl, TestIndexFileDeleter, TestDocumentsWriterDeleteQueue, TestSloppyMath, TestReuseDocsEnum, TestPositiveScoresOnlyCollector, TestFieldsReader, TestByteSlices, TestLucene42DocValuesFormat, TestSegmentTermEnum, TestNoMergePolicy, TestRegexpQuery, TestTermdocPerf, TestCodecHoldsOpenFiles, TestMultiMMap, TestCrashCausesCorruptIndex, TestDocBoost, TestPrefixCodedTerms, TestSnapshotDeletionPolicy, TestBytesRef, TestElevationComparator, TestExplanations, TestIndexWriterOnDiskFull, TestSumDocFreq, TestDeterminizeLexicon, TestTermsEnum2, TestScorerPerf, TestDocValuesWithThreads, TestBroadWord, TestDateTools, TestIndexWriter, TestCustomNorms, TestRegexpRandom2, TestMixedCodecs, TestCachingTokenFilter, TestBooleanMinShouldMatch, TestCloseableThreadLocal, TestCharFilter, Nested, TestNumericTokenStream, TestDocValuesFormat, TestCheckIndex, TestSpanExplanations, TestBlockPostingsFormat, TestTermsEnum, TestFieldMaskingSpanQuery, TestDocsAndPositions, TestBooleanScorer, TestDocValuesScoring, Nested, Nested, Nested, Nested, Nested, Nested, Nested, Nested, Nested, Nested, Nested, Nested, Nested, Nested, Nested, Nested, Nested, Nested, Nested, Nested, Nested, TestConcurrentMergeScheduler, TestTermVectorsWriter, TestSpans, TestSentinelIntSet, TestLiveFieldValues, TestIndexWriterMergePolicy, TestIndexWriterLockRelease, TestWildcardRandom, TestNearSpansOrdered, TestWeakIdentityMap, TestTerm, TestTopDocsMerge, TestTryDelete, TestDocTermOrdsRangeFilter, TestRecyclingIntBlockAllocator, TestBasicOperations, TestSearchForDuplicates, TestFieldCacheRewriteMethod, TestByteBlockPool, TestCopyBytes, TestConstantScoreQuery, TestSimilarityProvider, TestFieldCache, TestMultiDocValues, TestTermRangeFilter, TestShardSearching, TestNoMergeScheduler, TestLock, TestRateLimiter]
[junit4] Completed in 2.67s, 1 test, 1 failure <<< FAILURES!
[...truncated 960 lines...]
BUILD FAILED
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:453: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:433: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:39: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/extra-targets.xml:37: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/build.xml:49: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:1268: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:901: There were test failures: 373 suites, 2718 tests, 1 failure, 85 ignored (72 assumptions)
Total time: 11 minutes 18 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0 -XX:-UseCompressedOops -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.7.0) - Build # 1310
- Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-MacOSX/1310/
Java: 64bit/jdk1.7.0 -XX:+UseCompressedOops -XX:+UseSerialGC
3 tests failed.
REGRESSION: org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest.testDistribSearch
Error Message:
Test abandoned because suite timeout was reached.
Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
at __randomizedtesting.SeedInfo.seed([4376D003CA975703]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest
Error Message:
Suite timeout exceeded (>= 7200000 msec).
Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
at __randomizedtesting.SeedInfo.seed([4376D003CA975703]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest
Error Message:
Captured an uncaught exception in thread: Thread[id=10133, name=RecoveryThread, state=RUNNABLE, group=TGRP-ChaosMonkeyNothingIsSafeTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=10133, name=RecoveryThread, state=RUNNABLE, group=TGRP-ChaosMonkeyNothingIsSafeTest]
Caused by: java.lang.AssertionError: liveDocs.count()=267 info.docCount=482 info.getDelCount()=224
at __randomizedtesting.SeedInfo.seed([4376D003CA975703]:0)
at org.apache.lucene.codecs.lucene40.Lucene40LiveDocsFormat.readLiveDocs(Lucene40LiveDocsFormat.java:92)
at org.apache.lucene.index.SegmentReader.<init>(SegmentReader.java:103)
at org.apache.lucene.index.ReadersAndUpdates.getReader(ReadersAndUpdates.java:131)
at org.apache.lucene.index.ReadersAndUpdates.getReadOnlyClone(ReadersAndUpdates.java:183)
at org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:97)
at org.apache.lucene.index.IndexWriter.getReader(IndexWriter.java:380)
at org.apache.lucene.index.StandardDirectoryReader.doOpenIfChanged(StandardDirectoryReader.java:271)
at org.apache.lucene.index.DirectoryReader.openIfChanged(DirectoryReader.java:204)
at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:1445)
at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1633)
at org.apache.solr.handler.SnapPuller.openNewSearcherAndUpdateCommitPoint(SnapPuller.java:670)
at org.apache.solr.handler.SnapPuller.fetchLatestIndex(SnapPuller.java:490)
at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:322)
at org.apache.solr.cloud.RecoveryStrategy.replicate(RecoveryStrategy.java:155)
at org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:437)
at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:247)
Build Log:
[...truncated 10822 lines...]
[junit4] Suite: org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest
[junit4] 2> 2441821 T9326 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4] 2> 2441827 T9326 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ChaosMonkeyNothingIsSafeTest-1391904457717
[junit4] 2> 2441828 T9326 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 2441829 T9327 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 2441930 T9326 oasc.ZkTestServer.run start zk server on port:51987
[junit4] 2> 2441931 T9326 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2441938 T9333 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@38d61370 name:ZooKeeperConnection Watcher:127.0.0.1:51987 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2441939 T9326 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2441939 T9326 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 2441948 T9326 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2441951 T9335 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@73684062 name:ZooKeeperConnection Watcher:127.0.0.1:51987/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2441952 T9326 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2441952 T9326 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 2441960 T9326 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 2441966 T9326 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 2441972 T9326 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 2441978 T9326 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 2441979 T9326 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 2441989 T9326 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 2441989 T9326 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 2441995 T9326 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 2441996 T9326 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 2442002 T9326 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 2442003 T9326 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 2442011 T9326 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 2442011 T9326 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 2442017 T9326 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 2442018 T9326 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 2442024 T9326 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 2442024 T9326 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 2442031 T9326 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 2442032 T9326 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 2442038 T9326 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 2442038 T9326 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 2442044 T9326 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 2442044 T9326 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 2442051 T9326 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 2442052 T9326 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 2442365 T9326 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2442381 T9326 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:51990
[junit4] 2> 2442382 T9326 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 2442383 T9326 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2442383 T9326 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1391904457949
[junit4] 2> 2442383 T9326 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1391904457949/'
[junit4] 2> 2442410 T9326 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1391904457949/solr.xml
[junit4] 2> 2442483 T9326 oasc.CoreContainer.<init> New CoreContainer 1476120097
[junit4] 2> 2442483 T9326 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1391904457949/]
[junit4] 2> 2442485 T9326 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 2442486 T9326 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 2442486 T9326 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 2442486 T9326 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 2442487 T9326 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 2442487 T9326 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 2442487 T9326 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 2442487 T9326 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 2442488 T9326 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 2442498 T9326 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2442498 T9326 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2442498 T9326 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 2442499 T9326 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:51987/solr
[junit4] 2> 2442499 T9326 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 2442500 T9326 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2442505 T9346 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@549a05a7 name:ZooKeeperConnection Watcher:127.0.0.1:51987 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2442506 T9326 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2442511 T9326 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2442514 T9348 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3cd658a7 name:ZooKeeperConnection Watcher:127.0.0.1:51987/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2442515 T9326 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2442519 T9326 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 2442528 T9326 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 2442535 T9326 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 2442539 T9326 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51990_
[junit4] 2> 2442541 T9326 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51990_
[junit4] 2> 2442547 T9326 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 2442553 T9326 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 2442562 T9326 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:51990_
[junit4] 2> 2442563 T9326 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 2442568 T9326 oasc.Overseer.start Overseer (id=91219850541334531-127.0.0.1:51990_-n_0000000000) starting
[junit4] 2> 2442575 T9326 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 2442584 T9350 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 2442585 T9326 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 2442585 T9350 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
[junit4] 2> 2442590 T9326 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 2442594 T9326 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2442601 T9349 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 2442608 T9351 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 2442608 T9351 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 2442610 T9348 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2442610 T9351 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2442615 T9349 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2442616 T9349 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:51990",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:51990_",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 2442616 T9349 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 2442617 T9349 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 2442623 T9348 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2442624 T9348 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2443613 T9351 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 2443614 T9351 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1391904457949/collection1
[junit4] 2> 2443614 T9351 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 2443615 T9351 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 2443615 T9351 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 2443618 T9351 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2443618 T9351 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1391904457949/collection1/'
[junit4] 2> 2443619 T9351 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1391904457949/collection1/lib/classes/' to classloader
[junit4] 2> 2443620 T9351 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1391904457949/collection1/lib/README' to classloader
[junit4] 2> 2443678 T9351 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 2443733 T9351 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2443737 T9351 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 2443791 T9351 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 2444423 T9351 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2444425 T9351 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2444427 T9351 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2444434 T9351 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2444489 T9351 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 2444490 T9351 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1391904457949/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1391904457716/control/data/
[junit4] 2> 2444490 T9351 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2030fe04
[junit4] 2> 2444491 T9351 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1391904457716/control/data
[junit4] 2> 2444492 T9351 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1391904457716/control/data/index/
[junit4] 2> 2444492 T9351 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1391904457716/control/data/index' doesn't exist. Creating new index...
[junit4] 2> 2444493 T9351 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1391904457716/control/data/index
[junit4] 2> 2444493 T9351 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=42, maxMergeAtOnceExplicit=27, maxMergedSegmentMB=68.5322265625, floorSegmentMB=1.779296875, forceMergeDeletesPctAllowed=8.388387003414447, segmentsPerTier=43.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 2444497 T9351 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1391904457716/control/data/index,segFN=segments_1,generation=1}
[junit4] 2> 2444497 T9351 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2444501 T9351 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 2444501 T9351 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 2444502 T9351 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2444502 T9351 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 2444502 T9351 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2444503 T9351 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 2444503 T9351 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2444504 T9351 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2444504 T9351 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 2444504 T9351 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 2444505 T9351 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 2444505 T9351 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 2444506 T9351 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 2444506 T9351 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 2444506 T9351 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 2444507 T9351 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 2444507 T9351 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 2444517 T9351 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2444521 T9351 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 2444521 T9351 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 2444522 T9351 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=11, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.2915574979051945]
[junit4] 2> 2444523 T9351 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1391904457716/control/data/index,segFN=segments_1,generation=1}
[junit4] 2> 2444524 T9351 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2444524 T9351 oass.SolrIndexSearcher.<init> Opening Searcher@caa9d50[collection1] main
[junit4] 2> 2444527 T9352 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@caa9d50[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 2444528 T9351 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 2444529 T9326 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 2444530 T9326 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 2444530 T9355 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:51990 collection:control_collection shard:shard1
[junit4] 2> 2444532 T9326 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2444532 T9355 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 2444536 T9357 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ad93fee name:ZooKeeperConnection Watcher:127.0.0.1:51987/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2444536 T9326 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2444538 T9326 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2444544 T9326 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 2444546 T9355 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 2444550 T9348 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2444551 T9355 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 2444551 T9355 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C4648 name=collection1 org.apache.solr.core.SolrCore@6a0c4c12 url=http://127.0.0.1:51990/collection1 node=127.0.0.1:51990_ C4648_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:51990, core=collection1, node_name=127.0.0.1:51990_}
[junit4] 2> 2444551 T9355 C4648 P51990 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:51990/collection1/
[junit4] 2> 2444552 T9355 C4648 P51990 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 2444552 T9355 C4648 P51990 oasc.SyncStrategy.syncToMe http://127.0.0.1:51990/collection1/ has no replicas
[junit4] 2> 2444552 T9355 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:51990/collection1/ shard1
[junit4] 2> 2444552 T9355 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 2444560 T9349 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2444566 T9348 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2444571 T9348 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2444575 T9357 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2444580 T9349 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2444586 T9348 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2444690 T9348 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2444693 T9357 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2444721 T9355 oasc.ZkController.register We are http://127.0.0.1:51990/collection1/ and leader is http://127.0.0.1:51990/collection1/
[junit4] 2> 2444722 T9355 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:51990
[junit4] 2> 2444722 T9355 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 2444722 T9355 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 2444722 T9355 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 2444724 T9348 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2444725 T9348 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2444725 T9348 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2444726 T9355 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2444728 T9349 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2444729 T9349 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:51990",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:51990_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 2444734 T9348 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2444839 T9348 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2444839 T9357 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2444855 T9326 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 2444855 T9326 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2444860 T9326 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:51994
[junit4] 2> 2444862 T9326 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 2444862 T9326 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2444862 T9326 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1391904460433
[junit4] 2> 2444863 T9326 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1391904460433/'
[junit4] 2> 2444889 T9326 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1391904460433/solr.xml
[junit4] 2> 2444977 T9326 oasc.CoreContainer.<init> New CoreContainer 1231486264
[junit4] 2> 2444978 T9326 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1391904460433/]
[junit4] 2> 2444979 T9326 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 2444979 T9326 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 2444980 T9326 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 2444980 T9326 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 2444980 T9326 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 2444980 T9326 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 2444981 T9326 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 2444981 T9326 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 2444981 T9326 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 2444991 T9326 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2444991 T9326 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2444991 T9326 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 2444992 T9326 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:51987/solr
[junit4] 2> 2444992 T9326 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 2444993 T9326 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2444997 T9368 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@87a8d2e name:ZooKeeperConnection Watcher:127.0.0.1:51987 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2444998 T9326 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2445002 T9326 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2445006 T9370 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7c763468 name:ZooKeeperConnection Watcher:127.0.0.1:51987/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2445007 T9326 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2445017 T9326 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2446026 T9326 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51994_
[junit4] 2> 2446028 T9326 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51994_
[junit4] 2> 2446035 T9370 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 2446035 T9348 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 2446035 T9357 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 2446049 T9371 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 2446049 T9371 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 2446052 T9348 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2446052 T9348 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2446052 T9348 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2446052 T9371 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2446056 T9349 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2446058 T9349 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:51994",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:51994_",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 2446058 T9349 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
[junit4] 2> 2446058 T9349 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 2446064 T9348 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2446172 T9370 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2446172 T9357 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2446172 T9348 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2447057 T9371 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 2447057 T9371 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1391904460433/collection1
[junit4] 2> 2447057 T9371 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 2447059 T9371 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 2447059 T9371 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 2447062 T9371 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2447063 T9371 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1391904460433/collection1/'
[junit4] 2> 2447064 T9371 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1391904460433/collection1/lib/classes/' to classloader
[junit4] 2> 2447064 T9371 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1391904460433/collection1/lib/README' to classloader
[junit4] 2> 2447120 T9371 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 2447177 T9371 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2447179 T9371 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 2447201 T9371 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 2447791 T9371 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2447794 T9371 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2447795 T9371 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2447801 T9371 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2447855 T9371 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 2447855 T9371 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1391904460433/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1391904457716/jetty1/
[junit4] 2> 2447856 T9371 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2030fe04
[junit4] 2> 2447856 T9371 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1391904457716/jetty1
[junit4] 2> 2447857 T9371 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1391904457716/jetty1/index/
[junit4] 2> 2447858 T9371 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1391904457716/jetty1/index' doesn't exist. Creating new index...
[junit4] 2> 2447858 T9371 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1391904457716/jetty1/index
[junit4] 2> 2447859 T9371 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=42, maxMergeAtOnceExplicit=27, maxMergedSegmentMB=68.5322265625, floorSegmentMB=1.779296875, forceMergeDeletesPctAllowed=8.388387003414447, segmentsPerTier=43.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 2447862 T9371 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1391904457716/jetty1/index,segFN=segments_1,generation=1}
[junit4] 2> 2447862 T9371 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2447867 T9371 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 2447867 T9371 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 2447867 T9371 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2447868 T9371 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 2447868 T9371 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2447868 T9371 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 2447869 T9371 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2447869 T9371 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2447869 T9371 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 2447870 T9371 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 2447870 T9371 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 2447871 T9371 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 2447871 T9371 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 2447872 T9371 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 2447872 T9371 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 2447873 T9371 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 2447873 T9371 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 2447883 T9371 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2447886 T9371 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 2447886 T9371 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 2447888 T9371 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=11, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.2915574979051945]
[junit4] 2> 2447889 T9371 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1391904457716/jetty1/index,segFN=segments_1,generation=1}
[junit4] 2> 2447890 T9371 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2447890 T9371 oass.SolrIndexSearcher.<init> Opening Searcher@7932507[collection1] main
[junit4] 2> 2447896 T9372 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7932507[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 2447898 T9371 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 2447900 T9326 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 2447900 T9375 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:51994 collection:collection1 shard:shard1
[junit4] 2> 2447900 T9326 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 2447902 T9375 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 2447913 T9375 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 2447917 T9348 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2447917 T9348 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2447917 T9348 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2447919 T9375 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 2447919 T9375 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C4649 name=collection1 org.apache.solr.core.SolrCore@1371d21f url=http://127.0.0.1:51994/collection1 node=127.0.0.1:51994_ C4649_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:51994, core=collection1, node_name=127.0.0.1:51994_}
[junit4] 2> 2447919 T9375 C4649 P51994 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:51994/collection1/
[junit4] 2> 2447920 T9375 C4649 P51994 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 2447920 T9375 C4649 P51994 oasc.SyncStrategy.syncToMe http://127.0.0.1:51994/collection1/ has no replicas
[junit4] 2> 2447920 T9375 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:51994/collection1/ shard1
[junit4] 2> 2447920 T9375 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 2447928 T9349 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2447934 T9348 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2447936 T9370 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2447937 T9348 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2447937 T9357 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2447947 T9349 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2447954 T9348 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2448057 T9370 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2448058 T9357 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2448058 T9348 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2448092 T9375 oasc.ZkController.register We are http://127.0.0.1:51994/collection1/ and leader is http://127.0.0.1:51994/collection1/
[junit4] 2> 2448092 T9375 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:51994
[junit4] 2> 2448093 T9375 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 2448093 T9375 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 2448093 T9375 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 2448095 T9348 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2448095 T9348 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2448096 T9348 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2448096 T9375 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2448099 T9349 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2448100 T9349 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:51994",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:51994_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 2448105 T9348 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2448210 T9370 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2448211 T9348 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2448211 T9357 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2448233 T9326 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 2448233 T9326 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2448237 T9326 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:51997
[junit4] 2> 2448239 T9326 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 2448239 T9326 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2448239 T9326 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1391904463790
[junit4] 2> 2448240 T9326 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1391904463790/'
[junit4] 2> 2448267 T9326 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1391904463790/solr.xml
[junit4] 2> 2448380 T9326 oasc.CoreContainer.<init> New CoreContainer 1987579162
[junit4] 2> 2448381 T9326 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1391904463790/]
[junit4] 2> 2448382 T9326 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 2448383 T9326 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 2448383 T9326 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 2448383 T9326 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 2448383 T9326 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 2448384 T9326 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 2448384 T9326 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 2448384 T9326 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 2448384 T9326 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 2448395 T9326 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2448395 T9326 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2448395 T9326 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 2448397 T9326 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:51987/solr
[junit4] 2> 2448397 T9326 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 2448398 T9326 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2448402 T9386 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@43a462b9 name:ZooKeeperConnection Watcher:127.0.0.1:51987 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2448403 T9326 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2448407 T9326 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2448411 T9388 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7faf043 name:ZooKeeperConnection Watcher:127.0.0.1:51987/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2448411 T9326 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2448420 T9326 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2449426 T9326 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51997_
[junit4] 2> 2449429 T9326 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51997_
[junit4] 2> 2449435 T9370 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 2449436 T9357 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 2449436 T9388 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 2449436 T9348 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 2449451 T9389 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 2449451 T9389 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 2449453 T9389 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2449453 T9348 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2449454 T9348 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2449454 T9348 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2449457 T9349 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2449459 T9349 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:51997",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:51997_",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 2449459 T9349 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 2449459 T9349 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 2449466 T9348 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2449572 T9370 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2449572 T9357 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2449573 T9348 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2449573 T9388 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2450455 T9389 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 2450455 T9389 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1391904463790/collection1
[junit4] 2> 2450455 T9389 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 2450457 T9389 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 2450457 T9389 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 2450460 T9389 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2450460 T9389 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1391904463790/collection1/'
[junit4] 2> 2450461 T9389 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1391904463790/collection1/lib/classes/' to classloader
[junit4] 2> 2450462 T9389 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1391904463790/collection1/lib/README' to classloader
[junit4] 2> 2450542 T9389 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 2450646 T9389 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2450649 T9389 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 2450683 T9389 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 2451213 T9389 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2451217 T9389 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2451219 T9389 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2451225 T9389 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2451280 T9389 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 2451281 T9389 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1391904463790/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1391904457716/jetty2/
[junit4] 2> 2451281 T9389 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2030fe04
[junit4] 2> 2451282 T9389 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1391904457716/jetty2
[junit4] 2> 2451282 T9389 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1391904457716/jetty2/index/
[junit4] 2> 2451283 T9389 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1391904457716/jetty2/index' doesn't exist. Creating new index...
[junit4] 2> 2451284 T9389 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1391904457716/jetty2/index
[junit4] 2> 2451284 T9389 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=42, maxMergeAtOnceExplicit=27, maxMergedSegmentMB=68.5322265625, floorSegmentMB=1.779296875, forceMergeDeletesPctAllowed=8.388387003414447, segmentsPerTier=43.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 2451288 T9389 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1391904457716/jetty2/index,segFN=segments_1,generation=1}
[junit4] 2> 2451288 T9389 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2451293 T9389 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 2451293 T9389 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 2451294 T9389 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2451294 T9389 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 2451294 T9389 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2451295 T9389 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 2451295 T9389 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2451295 T9389 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2451295 T9389 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 2451296 T9389 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 2451297 T9389 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 2451297 T9389 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 2451297 T9389 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 2451298 T9389 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 2451298 T9389 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 2451299 T9389 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 2451299 T9389 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 2451308 T9389 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2451313 T9389 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 2451313 T9389 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 2451314 T9389 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=11, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.2915574979051945]
[junit4] 2> 2451315 T9389 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1391904457716/jetty2/index,segFN=segments_1,generation=1}
[junit4] 2> 2451316 T9389 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2451316 T9389 oass.SolrIndexSearcher.<init> Opening Searcher@47256e2b[collection1] main
[junit4] 2> 2451320 T9390 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@47256e2b[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 2451321 T9389 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 2451323 T9326 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 2451323 T9326 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 2451323 T9393 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:51997 collection:collection1 shard:shard2
[junit4] 2> 2451326 T9393 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 2451336 T9393 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 2451339 T9348 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2451339 T9348 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2451340 T9348 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2451341 T9393 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 2451341 T9393 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C4650 name=collection1 org.apache.solr.core.SolrCore@6f33df35 url=http://127.0.0.1:51997/collection1 node=127.0.0.1:51997_ C4650_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:51997, core=collection1, node_name=127.0.0.1:51997_}
[junit4] 2> 2451341 T9393 C4650 P51997 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:51997/collection1/
[junit4] 2> 2451341 T9393 C4650 P51997 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 2451342 T9393 C4650 P51997 oasc.SyncStrategy.syncToMe http://127.0.0.1:51997/collection1/ has no replicas
[junit4] 2> 2451342 T9393 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:51997/collection1/ shard2
[junit4] 2> 2451342 T9393 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 2451353 T9349 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2451356 T9348 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2451362 T9348 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2451364 T9388 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2451364 T9357 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2451372 T9349 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2451373 T9370 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2451378 T9348 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2451483 T9370 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2451484 T9357 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2451484 T9348 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2451486 T9388 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2451511 T9393 oasc.ZkController.register We are http://127.0.0.1:51997/collection1/ and leader is http://127.0.0.1:51997/collection1/
[junit4] 2> 2451512 T9393 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:51997
[junit4] 2> 2451512 T9393 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 2451512 T9393 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 2451513 T9393 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 2451517 T9348 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2451517 T9348 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2451518 T9348 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2451521 T9393 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2451522 T9349 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2451524 T9349 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:51997",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:51997_",
[junit4] 2> "shard":"shard2",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node2"}
[junit4] 2> 2451530 T9348 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2451635 T9357 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2451635 T9388 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2451635 T9370 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2451635 T9348 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 2451641 T9326 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 2451642 T9326 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2451646 T9326 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52000
[junit4] 2> 2451648 T9326 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 2451649 T9326 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2451649 T9326 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1391904467213
[junit4] 2> 2451650 T9326 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1391904467213/'
[junit4] 2> 2451682 T9326 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1391904467213/solr.xml
[junit4] 2> 2451752 T9326 oasc.CoreContainer.<init> New CoreContainer 2023156489
[junit4] 2> 2451753 T9326 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1391904467213/]
[junit4] 2> 2451754 T9326 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 2451754 T9326 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 2451755 T9326 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 2451755 T9326 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 2451756 T9326 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 2451756 T9326 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 2451756 T9326 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 2451756 T9326 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 2451757 T9326 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 2451766 T9326 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2451766 T9326 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2451767 T9326 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 2451768 T9326 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:51987/solr
[junit4] 2> 2451768 T9326 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 2451769 T9326 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2451773 T9404 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7c20d9b8 name:ZooKeeperConnection Watcher:127.0.0.1:51987 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2451774 T9326 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2451779 T9326 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2451783 T9406 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@361bab4e name:ZooKeeperConnection Watcher:127.0.0.1:51987/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2451783 T9326 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2451793 T9326 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2452805 T9326 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52000_
[junit4] 2> 2452807 T9326 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52000_
[junit4] 2> 2452815 T9406 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 2452815 T9357 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 2452816 T9370 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 2452816 T9388 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 2452816 T9348 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 2452830 T9407 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 2452831 T9407 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 2452833 T9348 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2452833 T9348 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2452833 T9348 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2452833 T9407 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2452837 T9349 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2452839 T9349 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:52000",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:52000_",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 2452839 T9349 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 2452839 T9349 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 2452846 T9348 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2452952 T9370 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 2452952 T9388 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 2452953 T9406 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 2452953 T9348 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 2452953 T9357 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 2453835 T9407 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 2453836 T9407 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1391904467213/collection1
[junit4] 2> 2453836 T9407 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 2453838 T9407 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 2453839 T9407 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 2453842 T9407 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2453842 T9407 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1391904467213/collection1/'
[junit4] 2> 2453843 T9407 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1391904467213/collection1/lib/classes/' to classloader
[junit4] 2> 2453844 T9407 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1391904467213/collection1/lib/README' to classloader
[junit4] 2> 2453903 T9407 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 2453977 T9407 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2453981 T9407 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 2453996 T9407 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 2454494 T9407 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2454497 T9407 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2454499 T9407 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2454505 T9407 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2454557 T9407 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 2454558 T9407 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1391904467213/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1391904457716/jetty3/
[junit4] 2> 2454558 T9407 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2030fe04
[junit4] 2> 2454559 T9407 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1391904457716/jetty3
[junit4] 2> 2454560 T9407 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1391904457716/jetty3/index/
[junit4] 2> 2454560 T9407 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1391904457716/jetty3/index' doesn't exist. Creating new index...
[junit4] 2> 2
[...truncated too long message...]
ieldResource, TestIBSimilarityFactory, BadCopyFieldTest, TestClassNameShortening, TestRecovery, TestShardHandlerFactory, QueryParsingTest, TestTrie, AssignTest, SearchHandlerTest, HdfsChaosMonkeySafeLeaderTest, RangeFacetTest, URLClassifyProcessorTest, TestJmxMonitoredMap, ScriptEngineTest, FullSolrCloudDistribCmdsTest, RAMDirectoryFactoryTest, TestReversedWildcardFilterFactory, DocValuesTest, SolrTestCaseJ4Test, TestSolrXmlPersistence, DocValuesMissingTest, HighlighterConfigTest, MoreLikeThisHandlerTest, StressHdfsTest, DirectSolrConnectionTest, TestSchemaNameResource, ShardRoutingCustomTest, TestFunctionQuery, DateMathParserTest, TestDefaultSearchFieldResource, TestCloudManagedSchema, TestStressLucene, LeaderElectionTest, HighlighterTest, ModifyConfFileTest, BJQParserTest, TestFastWriter, ResourceLoaderTest, ZkNodePropsTest, ChangedSchemaMergeTest, DOMUtilTest, TestStressReorder, TestSystemIdResolver, UpdateRequestProcessorFactoryTest, PluginInfoTest, HdfsRecoveryZkTest, TestFoldingMultitermQuery, ZkControllerTest, TestIndexSearcher, PingRequestHandlerTest, CacheHeaderTest, TestConfig, TestQueryUtils, DistributedSpellCheckComponentTest, TestCursorMarkWithoutUniqueKey, TestFaceting, TestSolrQueryParserDefaultOperatorResource, TestImplicitCoreProperties, OpenCloseCoreStressTest, BasicFunctionalityTest, TestStressVersions, TestSerializedLuceneMatchVersion, UUIDFieldTest, ShowFileRequestHandlerTest, TestNumberUtils, SchemaVersionSpecificBehaviorTest, DateFieldTest, TestHashPartitioner, TestReload, TestCollapseQParserPlugin, TestSolrXmlPersistor, TestArbitraryIndexDir, TestCollationFieldDocValues, TestSearchPerf, TestSort, QueryFacetTest, TestMultiCoreConfBootstrap, SimpleFacetsTest, PreAnalyzedUpdateProcessorTest, XsltUpdateRequestHandlerTest, SoftAutoCommitTest, TestZkChroot, TestExtendedDismaxParser, TestAnalyzeInfixSuggestions, TestPostingsSolrHighlighter, UnloadDistributedZkTest, SystemInfoHandlerTest, HdfsCollectionsAPIDistributedZkTest, TestRTGBase, TestCopyFieldCollectionResource, TestLRUCache, CollectionsAPIDistributedZkTest, AutoCommitTest, TestDocumentBuilder, DirectSolrSpellCheckerTest, TestUpdate, StatelessScriptUpdateProcessorFactoryTest, TestFiltering, TestUtils, QueryResultKeyTest, TestNonNRTOpen, EchoParamsTest, TestQueryTypes, TestOverriddenPrefixQueryForCustomFieldType, TermVectorComponentTest, TestDynamicFieldResource, OverseerTest, TriLevelCompositeIdRoutingTest, CursorMarkTest, CursorPagingTest, SolrIndexSplitterTest, BinaryUpdateRequestHandlerTest, TestFieldTypeResource, DistributedTermsComponentTest, TestPartialUpdateDeduplication, UpdateParamsTest, CoreMergeIndexesAdminHandlerTest, SimplePostToolTest, TestDocBasedVersionConstraints, ClusterStateTest, TestFastLRUCache, TestCustomSort, RequestHandlersTest, RegexBoostProcessorTest, IndexBasedSpellCheckerTest, DisMaxRequestHandlerTest, TestNoOpRegenerator, BadIndexSchemaTest, SolrIndexConfigTest, TestManagedSchemaFieldResource, TestModifyConfFiles, NoCacheHeaderTest, FieldFacetExtrasTest, TestPerFieldSimilarity, MigrateRouteKeyTest, CustomCollectionTest, FastVectorHighlighterTest, SuggesterTest, AddSchemaFieldsUpdateProcessorFactoryTest, BasicDistributedZk2Test, TestReplicationHandler, TestOmitPositions, ResponseLogComponentTest, TestDistributedGrouping, HdfsBasicDistributedZkTest, BasicDistributedZkTest, ChaosMonkeySafeLeaderTest, SyncSliceTest, LeaderElectionIntegrationTest, ShardRoutingTest, RecoveryZkTest, ClusterStateUpdateTest, TestRandomFaceting, ZkSolrClientTest, TestRandomDVFaceting, ZkCLITest, SliceStateUpdateTest, TestDistributedSearch, TermVectorComponentDistributedTest, TestRealTimeGet, TestJoin, HardAutoCommitTest, TestRangeQuery, TestSolr4Spatial, SolrCoreTest, SpellCheckComponentTest, TestGroupingSearch, QueryElevationComponentTest, PeerSyncTest, ConvertedLegacyTest, TestLazyCores, DirectUpdateHandlerTest, TestBadConfig, OverseerCollectionProcessorTest, DistributedQueryElevationComponentTest, CurrencyFieldXmlFileTest, TestCoreDiscovery, AnalysisAfterCoreReloadTest, SignatureUpdateProcessorFactoryTest, SpellCheckCollatorTest, SuggesterFSTTest, CoreAdminHandlerTest, SolrRequestParserTest, SuggesterTSTTest, TestCSVLoader, PolyFieldTest, WordBreakSolrSpellCheckerTest, SolrCoreCheckLockOnStartupTest, TestPseudoReturnFields, FieldMutatingUpdateProcessorTest, TestAtomicUpdateErrorCases, TestWordDelimiterFilterFactory, QueryEqualityTest, DirectUpdateHandlerOptimizeTest, DefaultValueUpdateProcessorTest, SortByFunctionTest, DocValuesMultiTest, DistanceFunctionTest, DebugComponentTest, TestSurroundQueryParser, LukeRequestHandlerTest, StandardRequestHandlerTest, TestWriterPerf, PrimitiveFieldTypeTest, FileBasedSpellCheckerTest, TermsComponentTest, XmlUpdateRequestHandlerTest, DocumentBuilderTest, TestValueSourceCache, PathHierarchyTokenizerFactoryTest, TestIndexingPerformance, RequiredFieldsTest, FieldAnalysisRequestHandlerTest, TestSolrQueryParser, IndexSchemaRuntimeFieldTest, LoggingHandlerTest, SolrPluginUtilsTest, IndexSchemaTest, TestJmxIntegration, ReturnFieldsTest, JSONWriterTest, MBeansHandlerTest, TestAnalyzedSuggestions, UniqFieldsUpdateProcessorFactoryTest, JsonLoaderTest, TestPHPSerializedResponseWriter, TestComponentsName, CoreContainerCoreInitFailuresTest, TestBinaryResponseWriter, TestLFUCache, SOLR749Test, TestQuerySenderListener, AlternateDirectoryTest, TestSolrIndexConfig, TestQuerySenderNoQuery, CopyFieldTest, BadComponentTest, TestMergePolicyConfig, TestSolrDeletionPolicy2, MultiTermTest, SampleTest, TestDocSet, NumericFieldsTest, TestElisionMultitermQuery, OutputWriterTest, TestFuzzyAnalyzedSuggestions, ExternalFileFieldSortTest, TestSolrCoreProperties, NotRequiredUniqueKeyTest, TestLuceneMatchVersion, TestPhraseSuggestions, SpellPossibilityIteratorTest, TestCharFilters, TestCodecSupport, SynonymTokenizerTest, TestXIncludeConfig, TestSweetSpotSimilarityFactory, TestDFRSimilarityFactory, TestLMDirichletSimilarityFactory, TestLMJelinekMercerSimilarityFactory, LegacyHTMLStripCharFilterTest, TestFastOutputStream, OpenExchangeRatesOrgProviderTest, ChaosMonkeyNothingIsSafeTest]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ChaosMonkeyNothingIsSafeTest -Dtests.seed=4376D003CA975703 -Dtests.slow=true -Dtests.locale=en_CA -Dtests.timezone=Africa/Harare -Dtests.file.encoding=ISO-8859-1
[junit4] ERROR 0.00s | ChaosMonkeyNothingIsSafeTest (suite) <<<
[junit4] > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
[junit4] > at __randomizedtesting.SeedInfo.seed([4376D003CA975703]:0)Throwable #2: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=10133, name=RecoveryThread, state=RUNNABLE, group=TGRP-ChaosMonkeyNothingIsSafeTest]
[junit4] > Caused by: java.lang.AssertionError: liveDocs.count()=267 info.docCount=482 info.getDelCount()=224
[junit4] > at __randomizedtesting.SeedInfo.seed([4376D003CA975703]:0)
[junit4] > at org.apache.lucene.codecs.lucene40.Lucene40LiveDocsFormat.readLiveDocs(Lucene40LiveDocsFormat.java:92)
[junit4] > at org.apache.lucene.index.SegmentReader.<init>(SegmentReader.java:103)
[junit4] > at org.apache.lucene.index.ReadersAndUpdates.getReader(ReadersAndUpdates.java:131)
[junit4] > at org.apache.lucene.index.ReadersAndUpdates.getReadOnlyClone(ReadersAndUpdates.java:183)
[junit4] > at org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:97)
[junit4] > at org.apache.lucene.index.IndexWriter.getReader(IndexWriter.java:380)
[junit4] > at org.apache.lucene.index.StandardDirectoryReader.doOpenIfChanged(StandardDirectoryReader.java:271)
[junit4] > at org.apache.lucene.index.DirectoryReader.openIfChanged(DirectoryReader.java:204)
[junit4] > at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:1445)
[junit4] > at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1633)
[junit4] > at org.apache.solr.handler.SnapPuller.openNewSearcherAndUpdateCommitPoint(SnapPuller.java:670)
[junit4] > at org.apache.solr.handler.SnapPuller.fetchLatestIndex(SnapPuller.java:490)
[junit4] > at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:322)
[junit4] > at org.apache.solr.cloud.RecoveryStrategy.replicate(RecoveryStrategy.java:155)
[junit4] > at org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:437)
[junit4] > at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:247)
[junit4] Completed in 7264.58s, 1 test, 3 errors <<< FAILURES!
[...truncated 202 lines...]
BUILD FAILED
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:453: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:433: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:39: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/extra-targets.xml:37: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build.xml:189: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/common-build.xml:491: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:1268: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:901: There were test failures: 368 suites, 1595 tests, 2 suite-level errors, 1 error, 215 ignored (6 assumptions)
Total time: 195 minutes 26 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0 -XX:+UseCompressedOops -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.7.0) - Build # 1309
- Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-MacOSX/1309/
Java: 64bit/jdk1.7.0 -XX:-UseCompressedOops -XX:+UseSerialGC
1 tests failed.
REGRESSION: org.apache.solr.cloud.OverseerRolesTest.testDistribSearch
Error Message:
Captured an uncaught exception in thread: Thread[id=10589, name=Overseer-91217910817161232-127.0.0.1:52455_-n_0000000013, state=RUNNABLE, group=Overseer collection creation process.]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=10589, name=Overseer-91217910817161232-127.0.0.1:52455_-n_0000000013, state=RUNNABLE, group=Overseer collection creation process.]
Caused by: org.apache.solr.common.cloud.ZooKeeperException:
at __randomizedtesting.SeedInfo.seed([32495660FCAD7BA8]:0)
at org.apache.solr.cloud.OverseerCollectionProcessor.run(OverseerCollectionProcessor.java:209)
at java.lang.Thread.run(Thread.java:744)
Caused by: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /overseer/collection-queue-work/qn-0000000004
at org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:174)
at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:171)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:171)
at org.apache.solr.cloud.DistributedQueue.remove(DistributedQueue.java:193)
at org.apache.solr.cloud.OverseerCollectionProcessor.run(OverseerCollectionProcessor.java:200)
... 1 more
Build Log:
[...truncated 10780 lines...]
[junit4] Suite: org.apache.solr.cloud.OverseerRolesTest
[junit4] 2> 2930985 T10420 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4] 2> 2930990 T10420 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-OverseerRolesTest-1391874859876
[junit4] 2> 2930991 T10420 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 2930992 T10421 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 2931096 T10420 oasc.ZkTestServer.run start zk server on port:52433
[junit4] 2> 2931097 T10420 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2931106 T10427 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@596c6fe6 name:ZooKeeperConnection Watcher:127.0.0.1:52433 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2931108 T10420 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2931108 T10420 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 2931119 T10420 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2931124 T10429 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4915c443 name:ZooKeeperConnection Watcher:127.0.0.1:52433/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2931125 T10420 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2931125 T10420 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 2931132 T10420 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 2931138 T10420 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 2931143 T10420 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 2931150 T10420 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 2931151 T10420 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 2931159 T10420 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 2931160 T10420 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 2931167 T10420 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 2931167 T10420 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 2931174 T10420 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 2931174 T10420 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 2931180 T10420 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 2931181 T10420 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 2931189 T10420 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 2931190 T10420 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 2931198 T10420 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 2931199 T10420 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 2931206 T10420 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 2931206 T10420 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 2931214 T10420 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 2931215 T10420 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 2931224 T10420 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 2931224 T10420 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 2931233 T10420 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 2931234 T10420 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 2931582 T10420 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2931591 T10420 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52436
[junit4] 2> 2931592 T10420 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 2931592 T10420 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2931593 T10420 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-controljetty-1391874860129
[junit4] 2> 2931593 T10420 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-controljetty-1391874860129/'
[junit4] 2> 2931621 T10420 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-controljetty-1391874860129/solr.xml
[junit4] 2> 2931721 T10420 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 2931722 T10420 oasc.CoreContainer.<init> New CoreContainer 1732088387
[junit4] 2> 2931722 T10420 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-controljetty-1391874860129/]
[junit4] 2> 2931723 T10420 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 2931724 T10420 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 2931724 T10420 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 2931724 T10420 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 2931725 T10420 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 2931725 T10420 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 2931725 T10420 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 2931726 T10420 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 2931726 T10420 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 2931737 T10420 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2931737 T10420 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2931737 T10420 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 2931738 T10420 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52433/solr
[junit4] 2> 2931738 T10420 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 2931740 T10420 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2931745 T10440 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7b4da1a8 name:ZooKeeperConnection Watcher:127.0.0.1:52433 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2931746 T10420 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2931751 T10420 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2931756 T10442 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@70b217d0 name:ZooKeeperConnection Watcher:127.0.0.1:52433/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2931757 T10420 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2931760 T10420 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 2931770 T10420 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 2931779 T10420 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 2931785 T10420 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52436_
[junit4] 2> 2931787 T10420 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52436_
[junit4] 2> 2931797 T10420 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 2931803 T10420 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 2931819 T10420 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:52436_
[junit4] 2> 2931820 T10420 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 2931827 T10420 oasc.Overseer.start Overseer (id=91217910817161219-127.0.0.1:52436_-n_0000000000) starting
[junit4] 2> 2931837 T10420 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 2931849 T10444 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 2931850 T10420 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 2931851 T10444 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
[junit4] 2> 2931857 T10420 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 2931865 T10420 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2931880 T10443 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 2931887 T10420 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-controljetty-1391874860129
[junit4] 2> 2932047 T10420 oasc.CorePropertiesLocator.discoverUnder Found core conf in /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-controljetty-1391874860129/conf/
[junit4] 2> 2932055 T10420 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 2932056 T10420 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 2932057 T10420 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 2932058 T10420 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2932063 T10447 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@41c4310c name:ZooKeeperConnection Watcher:127.0.0.1:52433/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2932064 T10420 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2932067 T10420 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2932073 T10420 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 2932394 T10420 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 2932394 T10420 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2932399 T10420 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52440
[junit4] 2> 2932400 T10420 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 2932400 T10420 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2932401 T10420 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.OverseerRolesTest-jetty1-1391874860958
[junit4] 2> 2932401 T10420 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.OverseerRolesTest-jetty1-1391874860958/'
[junit4] 2> 2932428 T10420 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty1-1391874860958/solr.xml
[junit4] 2> 2932499 T10420 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 2932500 T10420 oasc.CoreContainer.<init> New CoreContainer 1562049419
[junit4] 2> 2932500 T10420 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.OverseerRolesTest-jetty1-1391874860958/]
[junit4] 2> 2932502 T10420 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 2932502 T10420 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 2932502 T10420 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 2932503 T10420 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 2932503 T10420 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 2932503 T10420 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 2932503 T10420 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 2932504 T10420 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 2932504 T10420 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 2932513 T10420 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2932514 T10420 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2932515 T10420 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 2932515 T10420 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52433/solr
[junit4] 2> 2932516 T10420 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 2932517 T10420 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2932521 T10458 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1678926e name:ZooKeeperConnection Watcher:127.0.0.1:52433 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2932522 T10420 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2932528 T10420 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2932533 T10460 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@86e5efd name:ZooKeeperConnection Watcher:127.0.0.1:52433/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2932534 T10420 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2932544 T10420 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2933555 T10420 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52440_
[junit4] 2> 2933558 T10420 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52440_
[junit4] 2> 2933564 T10442 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 2933564 T10447 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 2933564 T10460 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 2933576 T10420 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty1-1391874860958
[junit4] 2> 2933680 T10420 oasc.CorePropertiesLocator.discoverUnder Found core conf in /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty1-1391874860958/conf/
[junit4] 2> 2933686 T10420 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 2933687 T10420 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 2933687 T10420 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 2934009 T10420 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 2934010 T10420 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2934014 T10420 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52443
[junit4] 2> 2934014 T10420 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 2934015 T10420 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2934015 T10420 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.OverseerRolesTest-jetty2-1391874862573
[junit4] 2> 2934015 T10420 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.OverseerRolesTest-jetty2-1391874862573/'
[junit4] 2> 2934043 T10420 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty2-1391874862573/solr.xml
[junit4] 2> 2934113 T10420 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 2934114 T10420 oasc.CoreContainer.<init> New CoreContainer 1435207985
[junit4] 2> 2934115 T10420 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.OverseerRolesTest-jetty2-1391874862573/]
[junit4] 2> 2934116 T10420 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 2934117 T10420 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 2934117 T10420 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 2934117 T10420 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 2934117 T10420 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 2934118 T10420 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 2934118 T10420 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 2934118 T10420 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 2934119 T10420 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 2934128 T10420 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2934128 T10420 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2934129 T10420 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 2934129 T10420 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52433/solr
[junit4] 2> 2934129 T10420 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 2934133 T10420 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2934137 T10472 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3bdc1bd7 name:ZooKeeperConnection Watcher:127.0.0.1:52433 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2934138 T10420 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2934143 T10420 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2934147 T10474 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6b542d7c name:ZooKeeperConnection Watcher:127.0.0.1:52433/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2934147 T10420 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2934157 T10420 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2935169 T10420 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52443_
[junit4] 2> 2935172 T10420 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52443_
[junit4] 2> 2935181 T10474 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 2935182 T10460 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 2935181 T10447 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 2935182 T10442 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 2935210 T10420 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty2-1391874862573
[junit4] 2> 2935309 T10420 oasc.CorePropertiesLocator.discoverUnder Found core conf in /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty2-1391874862573/conf/
[junit4] 2> 2935315 T10420 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 2935316 T10420 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 2935316 T10420 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 2935620 T10420 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 2935621 T10420 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2935624 T10420 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52446
[junit4] 2> 2935625 T10420 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 2935625 T10420 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2935626 T10420 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty3-1391874864202
[junit4] 2> 2935626 T10420 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty3-1391874864202/'
[junit4] 2> 2935661 T10420 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty3-1391874864202/solr.xml
[junit4] 2> 2935732 T10420 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 2935732 T10420 oasc.CoreContainer.<init> New CoreContainer 2019614236
[junit4] 2> 2935733 T10420 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty3-1391874864202/]
[junit4] 2> 2935734 T10420 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 2935734 T10420 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 2935734 T10420 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 2935734 T10420 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 2935735 T10420 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 2935735 T10420 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 2935735 T10420 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 2935735 T10420 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 2935736 T10420 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 2935748 T10420 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2935748 T10420 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2935749 T10420 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 2935750 T10420 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52433/solr
[junit4] 2> 2935750 T10420 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 2935752 T10420 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2935758 T10486 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f963e02 name:ZooKeeperConnection Watcher:127.0.0.1:52433 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2935759 T10420 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2935765 T10420 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2935769 T10488 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@587b0ee7 name:ZooKeeperConnection Watcher:127.0.0.1:52433/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2935770 T10420 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2935779 T10420 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2936791 T10420 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52446_
[junit4] 2> 2936793 T10420 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52446_
[junit4] 2> 2936800 T10474 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 2936800 T10460 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 2936800 T10488 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 2936800 T10442 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 2936800 T10447 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 2936813 T10420 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty3-1391874864202
[junit4] 2> 2936965 T10420 oasc.CorePropertiesLocator.discoverUnder Found core conf in /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty3-1391874864202/conf/
[junit4] 2> 2936973 T10420 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 2936974 T10420 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 2936974 T10420 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 2937284 T10420 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 4
[junit4] 2> 2937285 T10420 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2937289 T10420 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52449
[junit4] 2> 2937289 T10420 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 2937290 T10420 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2937291 T10420 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.OverseerRolesTest-jetty4-1391874865860
[junit4] 2> 2937291 T10420 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.OverseerRolesTest-jetty4-1391874865860/'
[junit4] 2> 2937318 T10420 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty4-1391874865860/solr.xml
[junit4] 2> 2937386 T10420 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 2937386 T10420 oasc.CoreContainer.<init> New CoreContainer 763673776
[junit4] 2> 2937387 T10420 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.OverseerRolesTest-jetty4-1391874865860/]
[junit4] 2> 2937389 T10420 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 2937389 T10420 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 2937389 T10420 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 2937390 T10420 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 2937390 T10420 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 2937390 T10420 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 2937391 T10420 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 2937391 T10420 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 2937391 T10420 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 2937400 T10420 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2937401 T10420 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2937401 T10420 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 2937401 T10420 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52433/solr
[junit4] 2> 2937402 T10420 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 2937404 T10420 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2937408 T10500 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@657fde28 name:ZooKeeperConnection Watcher:127.0.0.1:52433 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2937409 T10420 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2937414 T10420 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2937418 T10502 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@225d5ba3 name:ZooKeeperConnection Watcher:127.0.0.1:52433/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2937419 T10420 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2937429 T10420 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2938438 T10420 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52449_
[junit4] 2> 2938441 T10420 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52449_
[junit4] 2> 2938448 T10460 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 2938449 T10502 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 2938449 T10447 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 2938449 T10488 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 2938449 T10442 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 2938450 T10474 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 2938464 T10420 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty4-1391874865860
[junit4] 2> 2938564 T10420 oasc.CorePropertiesLocator.discoverUnder Found core conf in /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty4-1391874865860/conf/
[junit4] 2> 2938569 T10420 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 2938570 T10420 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 2938571 T10420 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 2938941 T10420 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 5
[junit4] 2> 2938942 T10420 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2938946 T10420 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52452
[junit4] 2> 2938946 T10420 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 2938946 T10420 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2938947 T10420 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.OverseerRolesTest-jetty5-1391874867456
[junit4] 2> 2938947 T10420 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.OverseerRolesTest-jetty5-1391874867456/'
[junit4] 2> 2938991 T10420 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty5-1391874867456/solr.xml
[junit4] 2> 2939075 T10420 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 2939076 T10420 oasc.CoreContainer.<init> New CoreContainer 2092912022
[junit4] 2> 2939076 T10420 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.OverseerRolesTest-jetty5-1391874867456/]
[junit4] 2> 2939078 T10420 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 2939078 T10420 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 2939078 T10420 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 2939079 T10420 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 2939079 T10420 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 2939079 T10420 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 2939080 T10420 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 2939080 T10420 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 2939080 T10420 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 2939089 T10420 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2939089 T10420 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2939090 T10420 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 2939090 T10420 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52433/solr
[junit4] 2> 2939090 T10420 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 2939092 T10420 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2939096 T10514 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@737ef2d5 name:ZooKeeperConnection Watcher:127.0.0.1:52433 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2939097 T10420 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2939101 T10420 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2939105 T10516 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@236f61a0 name:ZooKeeperConnection Watcher:127.0.0.1:52433/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2939106 T10420 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2939115 T10420 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2940124 T10420 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52452_
[junit4] 2> 2940131 T10420 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52452_
[junit4] 2> 2940142 T10447 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 2940142 T10442 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 2940142 T10488 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 2940142 T10474 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 2940144 T10460 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 2940142 T10502 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 2940145 T10516 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 2940160 T10420 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty5-1391874867456
[junit4] 2> 2940274 T10420 oasc.CorePropertiesLocator.discoverUnder Found core conf in /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty5-1391874867456/conf/
[junit4] 2> 2940279 T10420 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 2940280 T10420 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 2940280 T10420 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 2940596 T10420 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 6
[junit4] 2> 2940597 T10420 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2940600 T10420 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52455
[junit4] 2> 2940601 T10420 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 2940604 T10420 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2940604 T10420 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty6-1391874869166
[junit4] 2> 2940605 T10420 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty6-1391874869166/'
[junit4] 2> 2940635 T10420 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty6-1391874869166/solr.xml
[junit4] 2> 2940712 T10420 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 2940713 T10420 oasc.CoreContainer.<init> New CoreContainer 1071865893
[junit4] 2> 2940713 T10420 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty6-1391874869166/]
[junit4] 2> 2940715 T10420 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 2940715 T10420 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 2940715 T10420 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 2940716 T10420 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 2940716 T10420 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 2940716 T10420 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 2940716 T10420 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 2940717 T10420 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 2940717 T10420 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 2940727 T10420 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2940727 T10420 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2940728 T10420 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 2940728 T10420 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52433/solr
[junit4] 2> 2940729 T10420 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 2940730 T10420 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2940734 T10528 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@68bd3de7 name:ZooKeeperConnection Watcher:127.0.0.1:52433 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2940734 T10420 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2940740 T10420 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2940744 T10530 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@53ae1a87 name:ZooKeeperConnection Watcher:127.0.0.1:52433/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2940745 T10420 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2940755 T10420 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2941764 T10420 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52455_
[junit4] 2> 2941767 T10420 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52455_
[junit4] 2> 2941777 T10447 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 2941777 T10442 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 2941778 T10488 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 2941778 T10460 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 2941779 T10474 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 2941778 T10530 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 2941779 T10502 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 2941779 T10516 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 2941791 T10420 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty6-1391874869166
[junit4] 2> 2941942 T10420 oasc.CorePropertiesLocator.discoverUnder Found core conf in /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty6-1391874869166/conf/
[junit4] 2> 2941951 T10420 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 2941952 T10420 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 2941952 T10420 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 2941954 T10420 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2941958 T10533 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4fa8066b name:ZooKeeperConnection Watcher:127.0.0.1:52433/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2941959 T10420 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2941962 T10420 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2941971 T10420 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2941975 T10535 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3651b9d4 name:ZooKeeperConnection Watcher:127.0.0.1:52433/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2941976 T10420 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2941979 T10420 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2941990 T10498 oasha.CollectionsHandler.handleCreateAction Creating Collection : wt=javabin&action=CREATE&numShards=4&name=testOverseerCol&replicationFactor=2&version=2&maxShardsPerNode=2
[junit4] 2> 2941993 T10442 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2941996 T10444 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
[junit4] 2> "operation":"createcollection",
[junit4] 2> "fromApi":"true",
[junit4] 2> "name":"testOverseerCol",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "numShards":"4",
[junit4] 2> "maxShardsPerNode":"2"}
[junit4] 2> 2941996 T10444 oasc.OverseerCollectionProcessor.processMessage WARN OverseerCollectionProcessor.processMessage : createcollection , {
[junit4] 2> "operation":"createcollection",
[junit4] 2> "fromApi":"true",
[junit4] 2> "name":"testOverseerCol",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "numShards":"4",
[junit4] 2> "maxShardsPerNode":"2"}
[junit4] 2> 2941999 T10444 oasc.OverseerCollectionProcessor.createConfNode Only one config set found in zk - using it:conf1
[junit4] 2> 2941999 T10444 oasc.OverseerCollectionProcessor.createConfNode creating collections conf node /collections/testOverseerCol
[junit4] 2> 2941999 T10444 oascc.SolrZkClient.makePath makePath: /collections/testOverseerCol
[junit4] 2> 2942011 T10442 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2942015 T10443 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2942017 T10443 oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: testOverseerCol
[junit4] 2> 2942018 T10443 oasc.Overseer$ClusterStateUpdater.createCollection Create collection testOverseerCol with shards [shard1, shard2, shard3, shard4]
[junit4] 2> 2942024 T10442 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2942027 T10488 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 2942027 T10460 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 2942028 T10530 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 2942029 T10442 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 2942029 T10447 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 2942030 T10502 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 2942029 T10474 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 2942029 T10533 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 2942030 T10516 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 2942029 T10535 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 2942112 T10444 oasc.OverseerCollectionProcessor.createCollection going to create cores replicas shardNames [shard1, shard2, shard3, shard4] , repFactor : 2
[junit4] 2> 2942113 T10444 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard1_replica1 as part of slice shard1 of collection testOverseerCol on 127.0.0.1:52455_
[junit4] 2> 2942114 T10444 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard1_replica2 as part of slice shard1 of collection testOverseerCol on 127.0.0.1:52440_
[junit4] 2> 2942114 T10444 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard2_replica1 as part of slice shard2 of collection testOverseerCol on 127.0.0.1:52446_
[junit4] 2> 2942119 T10444 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard2_replica2 as part of slice shard2 of collection testOverseerCol on 127.0.0.1:52449_
[junit4] 2> 2942120 T10444 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard3_replica1 as part of slice shard3 of collection testOverseerCol on 127.0.0.1:52436_
[junit4] 2> 2942123 T10444 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard3_replica2 as part of slice shard3 of collection testOverseerCol on 127.0.0.1:52452_
[junit4] 2> 2942128 T10493 oasc.ZkController.publish publishing core=testOverseerCol_shard2_replica2 state=down
[junit4] 2> 2942130 T10434 oasc.ZkController.publish publishing core=testOverseerCol_shard3_replica1 state=down
[junit4] 2> 2942131 T10444 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard4_replica1 as part of slice shard4 of collection testOverseerCol on 127.0.0.1:52443_
[junit4] 2> 2942126 T10524 oasc.ZkController.publish publishing core=testOverseerCol_shard1_replica1 state=down
[junit4] 2> 2942125 T10451 oasc.ZkController.publish publishing core=testOverseerCol_shard1_replica2 state=down
[junit4] 2> 2942135 T10483 oasc.ZkController.publish publishing core=testOverseerCol_shard2_replica1 state=down
[junit4] 2> 2942136 T10508 oasc.ZkController.publish publishing core=testOverseerCol_shard3_replica2 state=down
[junit4] 2> 2942133 T10444 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard4_replica2 as part of slice shard4 of collection testOverseerCol on 127.0.0.1:52455_
[junit4] 2> 2942138 T10442 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2942138 T10465 oasc.ZkController.publish publishing core=testOverseerCol_shard4_replica1 state=down
[junit4] 2> 2942136 T10493 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2942142 T10434 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2942142 T10524 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2942144 T10508 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2942144 T10451 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2942144 T10483 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2942146 T10465 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2942146 T10525 oasc.ZkController.publish publishing core=testOverseerCol_shard4_replica2 state=down
[junit4] 2> 2942147 T10442 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2942149 T10443 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2942150 T10525 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2942151 T10443 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:52449",
[junit4] 2> "core":"testOverseerCol_shard2_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:52449_",
[junit4] 2> "shard":"shard2",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"testOverseerCol",
[junit4] 2> "numShards":"4",
[junit4] 2> "core_node_name":null}
[junit4] 2> 2942161 T10443 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:52455",
[junit4] 2> "core":"testOverseerCol_shard1_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:52455_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"testOverseerCol",
[junit4] 2> "numShards":"4",
[junit4] 2> "core_node_name":null}
[junit4] 2> 2942168 T10442 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2942170 T10443 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:52436",
[junit4] 2> "core":"testOverseerCol_shard3_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:52436_",
[junit4] 2> "shard":"shard3",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"testOverseerCol",
[junit4] 2> "numShards":"4",
[junit4] 2> "core_node_name":null}
[junit4] 2> 2942178 T10442 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2942181 T10443 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:52452",
[junit4] 2> "core":"testOverseerCol_shard3_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:52452_",
[junit4] 2> "shard":"shard3",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"testOverseerCol",
[junit4] 2> "numShards":"4",
[junit4] 2> "core_node_name":null}
[junit4] 2> 2942188 T10442 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2942191 T10443 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:52440",
[junit4] 2> "core":"testOverseerCol_shard1_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:52440_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"testOverseerCol",
[junit4] 2> "numShards":"4",
[junit4] 2> "core_node_name":null}
[junit4] 2> 2942198 T10442 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2942200 T10443 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:52446",
[junit4] 2> "core":"testOverseerCol_shard2_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:52446_",
[junit4] 2> "shard":"shard2",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"testOverseerCol",
[junit4] 2> "numShards":"4",
[junit4] 2> "core_node_name":null}
[junit4] 2> 2942208 T10442 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2942212 T10443 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:52443",
[junit4] 2> "core":"testOverseerCol_shard4_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:52443_",
[junit4] 2> "shard":"shard4",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"testOverseerCol",
[junit4] 2> "numShards":"4",
[junit4] 2> "core_node_name":null}
[junit4] 2> 2942220 T10442 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2942223 T10443 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:52455",
[junit4] 2> "core":"testOverseerCol_shard4_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:52455_",
[junit4] 2> "shard":"shard4",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"testOverseerCol",
[junit4] 2> "numShards":"4",
[junit4] 2> "core_node_name":null}
[junit4] 2> 2942231 T10442 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2942341 T10516 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 2942341 T10447 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 2942342 T10535 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 2942342 T10533 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 2942342 T10460 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 2942343 T10502 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 2942343 T10442 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 2942342 T10474 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 2942342 T10488 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 2942342 T10530 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 2943141 T10493 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard2_replica2
[junit4] 2> 2943142 T10493 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard2_replica2' using instanceDir: ./org.apache.solr.cloud.OverseerRolesTest-jetty4-1391874865860/testOverseerCol_shard2_replica2
[junit4] 2> 2943143 T10493 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
[junit4] 2> 2943143 T10434 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard3_replica1
[junit4] 2> 2943144 T10493 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 2943146 T10493 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
[junit4] 2> 2943146 T10434 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard3_replica1' using instanceDir: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-controljetty-1391874860129/testOverseerCol_shard3_replica1
[junit4] 2> 2943147 T10434 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
[junit4] 2> 2943147 T10524 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard1_replica1
[junit4] 2> 2943147 T10483 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard2_replica1
[junit4] 2> 2943149 T10524 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard1_replica1' using instanceDir: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty6-1391874869166/testOverseerCol_shard1_replica1
[junit4] 2> 2943150 T10524 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
[junit4] 2> 2943150 T10508 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard3_replica2
[junit4] 2> 2943151 T10483 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard2_replica1' using instanceDir: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty3-1391874864202/testOverseerCol_shard2_replica1
[junit4] 2> 2943152 T10483 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
[junit4] 2> 2943153 T10525 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard4_replica2
[junit4] 2> 2943154 T10493 oascc.ZkStateReader.readConfigName path=/collections/testOverseerCol configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2943155 T10493 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.OverseerRolesTest-jetty4-1391874865860/testOverseerCol_shard2_replica2/'
[junit4] 2> 2943155 T10434 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 2943156 T10434 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
[junit4] 2> 2943152 T10465 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard4_replica1
[junit4] 2> 2943158 T10465 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard4_replica1' using instanceDir: ./org.apache.solr.cloud.OverseerRolesTest-jetty2-1391874862573/testOverseerCol_shard4_replica1
[junit4] 2> 2943158 T10465 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
[junit4] 2> 2943159 T10524 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 2943159 T10524 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
[junit4] 2> 2943152 T10451 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard1_replica2
[junit4] 2> 2943161 T10451 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard1_replica2' using instanceDir: ./org.apache.solr.cloud.OverseerRolesTest-jetty1-1391874860958/testOverseerCol_shard1_replica2
[junit4] 2> 2943162 T10451 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
[junit4] 2> 2943152 T10508 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard3_replica2' using instanceDir: ./org.apache.solr.cloud.OverseerRolesTest-jetty5-1391874867456/testOverseerCol_shard3_replica2
[junit4] 2> 2943163 T10508 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
[junit4] 2> 2943161 T10483 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 2943164 T10483 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
[junit4] 2> 2943165 T10524 oascc.ZkStateReader.readConfigName path=/collections/testOverseerCol configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2943165 T10524 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty6-1391874869166/testOverseerCol_shard1_replica1/'
[junit4] 2> 2943166 T10465 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 2943166 T10465 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
[junit4] 2> 2943167 T10434 oascc.ZkStateReader.readConfigName path=/collections/testOverseerCol configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2943167 T10434 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-controljetty-1391874860129/testOverseerCol_shard3_replica1/'
[junit4] 2> 2943168 T10508 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 2943169 T10508 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
[junit4] 2> 2943155 T10525 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard4_replica2' using instanceDir: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty6-1391874869166/testOverseerCol_shard4_replica2
[junit4] 2> 2943169 T10525 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
[junit4] 2> 2943170 T10451 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 2943170 T10451 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
[junit4] 2> 2943173 T10483 oascc.ZkStateReader.readConfigName path=/collections/testOverseerCol configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2943174 T10483 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty3-1391874864202/testOverseerCol_shard2_replica1/'
[junit4] 2> 2943175 T10525 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 2943175 T10525 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
[junit4] 2> 2943175 T10465 oascc.ZkStateReader.readConfigName path=/collections/testOverseerCol configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2943176 T10465 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.OverseerRolesTest-jetty2-1391874862573/testOverseerCol_shard4_replica1/'
[junit4] 2> 2943177 T10508 oascc.ZkStateReader.readConfigName path=/collections/testOverseerCol configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2943177 T10508 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.OverseerRolesTest-jetty5-1391874867456/testOverseerCol_shard3_replica2/'
[junit4] 2> 2943182 T10525 oascc.ZkStateReader.readConfigName path=/collections/testOverseerCol configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2943182 T10525 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty6-1391874869166/testOverseerCol_shard4_replica2/'
[junit4] 2> 2943183 T10451 oascc.ZkStateReader.readConfigName path=/collections/testOverseerCol configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2943183 T10451 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.OverseerRolesTest-jetty1-1391874860958/testOverseerCol_shard1_replica2/'
[junit4] 2> 2943447 T10493 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 2943498 T10524 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 2943512 T10508 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 2943557 T10465 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 2943629 T10451 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 2943638 T10483 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 2943645 T10525 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 2943763 T10434 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 2943912 T10508 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2943920 T10508 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 2943922 T10524 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2943931 T10524 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 2943947 T10508 oass.IndexSchema.readSchema [testOverseerCol_shard3_replica2] Schema name=test
[junit4] 2> 2943958 T10493 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2943961 T10483 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2943971 T10451 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2943961 T10524 oass.IndexSchema.readSchema [testOverseerCol_shard1_replica1] Schema name=test
[junit4] 2> 2943975 T10465 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2943983 T10451 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 2943984 T10465 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 2943985 T10493 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 2943998 T10525 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2944006 T10493 oass.IndexSchema.readSchema [testOverseerCol_shard2_replica2] Schema name=test
[junit4] 2> 2944012 T10525 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 2943986 T10483 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 2944024 T10465 oass.IndexSchema.readSchema [testOverseerCol_shard4_replica1] Schema name=test
[junit4] 2> 2944030 T10525 oass.IndexSchema.readSchema [testOverseerCol_shard4_replica2] Schema name=test
[junit4] 2> 2944068 T10451 oass.IndexSchema.readSchema [testOverseerCol_shard1_replica2] Schema name=test
[junit4] 2> 2944073 T10483 oass.IndexSchema.readSchema [testOverseerCol_shard2_replica1] Schema name=test
[junit4] 2> 2944228 T10434 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2944243 T10434 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 2944329 T10434 oass.IndexSchema.readSchema [testOverseerCol_shard3_replica1] Schema name=test
[junit4] 2> 2947428 T10493 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 2947444 T10493 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2947511 T10493 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2947514 T10525 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 2947664 T10525 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2947697 T10525 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2947756 T10493 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2947778 T10493 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2947788 T10493 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2947809 T10493 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2947810 T10493 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2947811 T10493 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2947820 T10493 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2947821 T10493 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2947821 T10493 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 2947822 T10493 oasc.SolrCore.<init> [testOverseerCol_shard2_replica2] Opening new SolrCore at ./org.apache.solr.cloud.OverseerRolesTest-jetty4-1391874865860/testOverseerCol_shard2_replica2/, dataDir=./org.apache.solr.cloud.OverseerRolesTest-jetty4-1391874865860/testOverseerCol_shard2_replica2/data/
[junit4] 2> 2947823 T10493 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@482ab63d
[junit4] 2> 2947835 T10493 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.OverseerRolesTest-jetty4-1391874865860/testOverseerCol_shard2_replica2/data
[junit4] 2> 2947838 T10493 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.OverseerRolesTest-jetty4-1391874865860/testOverseerCol_shard2_replica2/data/index/
[junit4] 2> 2947838 T10493 oasc.SolrCore.initIndex WARN [testOverseerCol_shard2_replica2] Solr index directory './org.apache.solr.cloud.OverseerRolesTest-jetty4-1391874865860/testOverseerCol_shard2_replica2/data/index' doesn't exist. Creating new index...
[junit4] 2> 2947863 T10493 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.OverseerRolesTest-jetty4-1391874865860/testOverseerCol_shard2_replica2/data/index
[junit4] 2> 2947866 T10493 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=46, maxMergeAtOnceExplicit=30, maxMergedSegmentMB=56.3056640625, floorSegmentMB=0.7041015625, forceMergeDeletesPctAllowed=29.17983292266276, segmentsPerTier=43.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 2947872 T10493 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@5946e819 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5e5fd332),segFN=segments_1,generation=1}
[junit4] 2> 2947873 T10493 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2947888 T10493 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 2947890 T10493 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 2947891 T10493 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2947892 T10493 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 2947894 T10493 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2947895 T10493 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 2947896 T10493 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2947897 T10493 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2947897 T10493 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 2947899 T10493 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 2947940 T10493 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 2947941 T10493 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 2947942 T10493 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 2947943 T10493 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 2947959 T10493 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 2947960 T10493 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 2947961 T10493 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 2948049 T10525 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2948056 T10493 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2948110 T10525 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2948132 T10525 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2948151 T10525 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2948151 T10525 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2948152 T10525 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2948163 T10493 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 2948164 T10493 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 2948174 T10525 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2948176 T10525 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2948176 T10525 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 2948177 T10525 oasc.SolrCore.<init> [testOverseerCol_shard4_replica2] Opening new SolrCore at ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty6-1391874869166/testOverseerCol_shard4_replica2/, dataDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty6-1391874869166/testOverseerCol_shard4_replica2/data/
[junit4] 2> 2948177 T10525 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@482ab63d
[junit4] 2> 2948195 T10525 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty6-1391874869166/testOverseerCol_shard4_replica2/data
[junit4] 2> 2948200 T10525 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty6-1391874869166/testOverseerCol_shard4_replica2/data/index/
[junit4] 2> 2948205 T10525 oasc.SolrCore.initIndex WARN [testOverseerCol_shard4_replica2] Solr index directory '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apac
[...truncated too long message...]
ception.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:254)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:254)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 2956273 T10516 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 2956414 T10530 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> NOTE: test params are: codec=Lucene46: {}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=ar_SY, timezone=GMT
[junit4] 2> NOTE: Mac OS X 10.8.5 x86_64/Oracle Corporation 1.7.0_51 (64-bit)/cpus=2,threads=5,free=161765976,total=374693888
[junit4] 2> NOTE: All tests run in this JVM: [TestHashPartitioner, TestQuerySenderNoQuery, IndexSchemaTest, TestCloudManagedSchemaAddField, SliceStateTest, TestIndexSearcher, TestLFUCache, HdfsBasicDistributedZkTest, TestAtomicUpdateErrorCases, BasicDistributedZkTest, SystemInfoHandlerTest, TestValueSourceCache, FastVectorHighlighterTest, TestAddFieldRealTimeGet, FunctionTest, TestDocBasedVersionConstraints, TestBinaryField, DistribCursorPagingTest, TermsComponentTest, BasicZkTest, ZkCLITest, TestCollationFieldDocValues, TestJmxIntegration, TestRangeQuery, SolrIndexSplitterTest, SolrXmlInZkTest, TestWriterPerf, FileBasedSpellCheckerTest, TestSuggestSpellingConverter, SpellPossibilityIteratorTest, RequiredFieldsTest, SuggestComponentTest, DirectUpdateHandlerOptimizeTest, StandardRequestHandlerTest, CacheHeaderTest, ShardSplitTest, SuggesterWFSTTest, DistributedTermsComponentTest, CoreMergeIndexesAdminHandlerTest, TestCollapseQParserPlugin, ZkSolrClientTest, TestStressVersions, JSONWriterTest, TestFieldCollectionResource, SOLR749Test, TestLRUCache, ConvertedLegacyTest, TestDocumentBuilder, TestSurroundQueryParser, RequestHandlersTest, FieldAnalysisRequestHandlerTest, ScriptEngineTest, TestHighFrequencyDictionaryFactory, TestSort, TestFunctionQuery, LukeRequestHandlerTest, TestDistributedGrouping, QueryEqualityTest, LoggingHandlerTest, AssignTest, TestGroupingSearch, ConnectionManagerTest, ModifyConfFileTest, TestPhraseSuggestions, TestSchemaSimilarityResource, TestCursorMarkWithoutUniqueKey, TestNumberUtils, StatelessScriptUpdateProcessorFactoryTest, TestStandardQParsers, LeaderElectionIntegrationTest, HardAutoCommitTest, XsltUpdateRequestHandlerTest, TestSolrXml, TestReload, TestDynamicFieldCollectionResource, URLClassifyProcessorTest, HdfsCollectionsAPIDistributedZkTest, UnloadDistributedZkTest, MinimalSchemaTest, TestFieldTypeResource, ZkControllerTest, TestSchemaVersionResource, TestReversedWildcardFilterFactory, NumericFieldsTest, QueryFacetTest, SearchHandlerTest, TestSolrQueryParserDefaultOperatorResource, ResourceLoaderTest, DeleteShardTest, TestSchemaNameResource, TestUpdate, SolrCoreCheckLockOnStartupTest, SuggesterTSTTest, HdfsDirectoryTest, SuggesterFSTTest, ReturnFieldsTest, FileUtilsTest, TestQuerySenderListener, DirectSolrConnectionTest, OpenExchangeRatesOrgProviderTest, UniqFieldsUpdateProcessorFactoryTest, TestZkChroot, BadComponentTest, CustomCollectionTest, NoFacetTest, BJQParserTest, TestSolrQueryParser, SampleTest, SolrRequestParserTest, DateFieldTest, TestRecovery, TestLuceneMatchVersion, IndexBasedSpellCheckerTest, BasicFunctionalityTest, TestPseudoReturnFields, TermVectorComponentTest, SpellCheckComponentTest, TestCSVResponseWriter, ClusterStateUpdateTest, TestFieldTypeCollectionResource, TestFuzzyAnalyzedSuggestions, BlockCacheTest, CoreAdminCreateDiscoverTest, TestFoldingMultitermQuery, PreAnalyzedUpdateProcessorTest, TestDefaultSimilarityFactory, StressHdfsTest, EchoParamsTest, TestElisionMultitermQuery, StatsComponentTest, OverseerTest, TestCodecSupport, AutoCommitTest, BlockDirectoryTest, TestNonNRTOpen, DistributedSuggestComponentTest, TestDistribDocBasedVersion, HdfsUnloadDistributedZkTest, TestBM25SimilarityFactory, TestCoreContainer, RAMDirectoryFactoryTest, PrimUtilsTest, TestInitQParser, RangeFacetTest, TestPHPSerializedResponseWriter, TestMaxScoreQueryParser, FieldMutatingUpdateProcessorTest, TestRTGBase, TestModifyConfFiles, DebugComponentTest, TestRandomDVFaceting, TestTrie, TestFastLRUCache, UpdateRequestProcessorFactoryTest, TestStressRecovery, DistributedQueryElevationComponentTest, ShardRoutingTest, CachingDirectoryFactoryTest, TestQueryUtils, TestXIncludeConfig, DirectSolrSpellCheckerTest, SpellingQueryConverterTest, MultiTermTest, TestFreeTextSuggestions, TestCopyFieldCollectionResource, TestPostingsSolrHighlighter, TestFaceting, CoreAdminHandlerTest, TestSweetSpotSimilarityFactory, TestSolr4Spatial, DocValuesMissingTest, TestCloudManagedSchema, DefaultValueUpdateProcessorTest, DocValuesMultiTest, AliasIntegrationTest, TestNoOpRegenerator, ShowFileRequestHandlerTest, ChaosMonkeySafeLeaderTest, BasicDistributedZk2Test, CollectionsAPIDistributedZkTest, SyncSliceTest, OpenCloseCoreStressTest, RecoveryZkTest, FullSolrCloudDistribCmdsTest, TestReplicationHandler, TestRandomFaceting, LeaderElectionTest, ShardRoutingCustomTest, SliceStateUpdateTest, TestDistributedSearch, DistributedSpellCheckComponentTest, TermVectorComponentDistributedTest, TestRealTimeGet, TestStressReorder, TestJoin, TestMultiCoreConfBootstrap, SimpleFacetsTest, SolrCoreTest, SolrCmdDistributorTest, QueryElevationComponentTest, PeerSyncTest, BadIndexSchemaTest, TestFiltering, TestLazyCores, DirectUpdateHandlerTest, TestBadConfig, OverseerCollectionProcessorTest, HighlighterTest, SoftAutoCommitTest, CurrencyFieldOpenExchangeTest, CurrencyFieldXmlFileTest, SimplePostToolTest, TestCoreDiscovery, AnalysisAfterCoreReloadTest, SignatureUpdateProcessorFactoryTest, TestExtendedDismaxParser, SpellCheckCollatorTest, DocValuesTest, SuggesterTest, TestStressLucene, SpatialFilterTest, TestCSVLoader, PolyFieldTest, NoCacheHeaderTest, WordBreakSolrSpellCheckerTest, SchemaVersionSpecificBehaviorTest, TestWordDelimiterFilterFactory, SortByFunctionTest, TestRemoteStreaming, DistanceFunctionTest, TestSolrDeletionPolicy1, SolrInfoMBeanTest, DisMaxRequestHandlerTest, DocumentAnalysisRequestHandlerTest, TestQueryTypes, PrimitiveFieldTypeTest, TestOmitPositions, XmlUpdateRequestHandlerTest, DocumentBuilderTest, PathHierarchyTokenizerFactoryTest, TestIndexingPerformance, MoreLikeThisHandlerTest, TestArbitraryIndexDir, IndexSchemaRuntimeFieldTest, RegexBoostProcessorTest, SolrPluginUtilsTest, TestCollationField, MBeansHandlerTest, QueryParsingTest, TestAnalyzedSuggestions, JsonLoaderTest, BinaryUpdateRequestHandlerTest, TestPartialUpdateDeduplication, PingRequestHandlerTest, CSVRequestHandlerTest, TestComponentsName, CoreContainerCoreInitFailuresTest, TestBinaryResponseWriter, HighlighterConfigTest, UpdateParamsTest, AlternateDirectoryTest, TestSolrIndexConfig, CopyFieldTest, ResponseLogComponentTest, SolrIndexConfigTest, TestMergePolicyConfig, TestSolrDeletionPolicy2, TestDocSet, TestSearchPerf, TestConfig, OutputWriterTest, ExternalFileFieldSortTest, TestSolrCoreProperties, NotRequiredUniqueKeyTest, TestCharFilters, SynonymTokenizerTest, TestDFRSimilarityFactory, TestPerFieldSimilarity, TestLMDirichletSimilarityFactory, TestLMJelinekMercerSimilarityFactory, TestIBSimilarityFactory, TestFastWriter, LegacyHTMLStripCharFilterTest, TestJmxMonitoredMap, TimeZoneUtilsTest, TestFastOutputStream, PluginInfoTest, DateMathParserTest, ChaosMonkeyNothingIsSafeTest, TestSolrXMLSerializer, PreAnalyzedFieldTest, TestSystemIdResolver, DOMUtilTest, ClusterStateTest, TestSolrJ, TestUtils, ZkNodePropsTest, UUIDFieldTest, CircularListTest, CursorPagingTest, SolrTestCaseJ4Test, TestDistributedMissingSort, AbstractAnalyticsStatsTest, ExpressionTest, AbstractAnalyticsFacetTest, FieldFacetExtrasTest, DeleteReplicaTest, MigrateRouteKeyTest, OverseerRolesTest]
[junit4] Completed in 25.62s, 1 test, 1 error <<< FAILURES!
[...truncated 139 lines...]
BUILD FAILED
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:453: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:433: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:39: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/extra-targets.xml:37: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build.xml:189: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/common-build.xml:491: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:1268: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:901: There were test failures: 368 suites, 1595 tests, 1 error, 40 ignored (6 assumptions)
Total time: 86 minutes 11 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0 -XX:-UseCompressedOops -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure