You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/04/20 01:23:56 UTC
[JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.7.0_60-ea-b14) -
Build # 10117 - Still Failing!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/10117/
Java: 64bit/jdk1.7.0_60-ea-b14 -XX:+UseCompressedOops -XX:+UseSerialGC
1 tests failed.
REGRESSION: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testDistribSearch
Error Message:
createcollection the collection error [Watcher fired on path: null state: SyncConnected type None]
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: createcollection the collection error [Watcher fired on path: null state: SyncConnected type None]
at __randomizedtesting.SeedInfo.seed([6A915C65C2BEC277:EB77D27DB5E1A24B]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:554)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:210)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:206)
at org.apache.solr.client.solrj.request.CollectionAdminRequest.process(CollectionAdminRequest.java:300)
at org.apache.solr.client.solrj.request.CollectionAdminRequest.createCollection(CollectionAdminRequest.java:340)
at org.apache.solr.client.solrj.request.CollectionAdminRequest.createCollection(CollectionAdminRequest.java:318)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testSolrJAPICalls(CollectionsAPIDistributedZkTest.java:258)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:201)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:865)
at sun.reflect.GeneratedMethodAccessor47.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:793)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:453)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at java.lang.Thread.run(Thread.java:744)
Build Log:
[...truncated 10944 lines...]
[junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-6A915C65C2BEC277-001/init-core-data-001
[junit4] 2> 771147 T3281 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (true)
[junit4] 2> 771148 T3281 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4] 2> 771152 T3281 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> 771153 T3281 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 771154 T3282 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 771253 T3281 oasc.ZkTestServer.run start zk server on port:50836
[junit4] 2> 771255 T3281 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 780456 T3285 oazsp.FileTxnLog.commit WARN fsync-ing the write ahead log in SyncThread:0 took 9200ms which will adversely effect operation latency. See the ZooKeeper troubleshooting guide
[junit4] 2> 780459 T3288 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6afa4c3d name:ZooKeeperConnection Watcher:127.0.0.1:50836 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 780460 T3281 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 780460 T3281 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 780467 T3281 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 780469 T3290 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@319e4a31 name:ZooKeeperConnection Watcher:127.0.0.1:50836/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 780469 T3281 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 780470 T3281 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 780473 T3281 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 780474 T3281 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 780475 T3281 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 780477 T3281 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 780477 T3281 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 780480 T3281 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 780480 T3281 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 780483 T3281 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 780483 T3281 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 780486 T3281 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 780487 T3281 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 780490 T3281 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 780490 T3281 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 780493 T3281 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 780494 T3281 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 780498 T3281 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 780498 T3281 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 780502 T3281 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 780503 T3281 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 780505 T3281 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 780505 T3281 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 780507 T3281 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 780508 T3281 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 780509 T3281 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 780510 T3281 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 780513 T3283 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1457c42a7ed0001, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 780513 T3281 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 780516 T3292 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2ad02e6f name:ZooKeeperConnection Watcher:127.0.0.1:50836/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 780516 T3281 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> Using new style solr.xml
[junit4] 2> 780519 T3281 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 780522 T3294 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@340254a7 name:ZooKeeperConnection Watcher:127.0.0.1:50836 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 780522 T3281 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 780522 T3281 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 780525 T3281 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 780527 T3296 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@22003136 name:ZooKeeperConnection Watcher:127.0.0.1:50836/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 780528 T3281 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 780528 T3281 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf2/solrconfig.xml
[junit4] 2> 780529 T3281 oascc.SolrZkClient.makePath makePath: /configs/conf2/solrconfig.xml
[junit4] 2> 780533 T3281 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf2/schema.xml
[junit4] 2> 780533 T3281 oascc.SolrZkClient.makePath makePath: /configs/conf2/schema.xml
[junit4] 2> 780536 T3281 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf2/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 780536 T3281 oascc.SolrZkClient.makePath makePath: /configs/conf2/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 780538 T3281 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf2/stopwords.txt
[junit4] 2> 780538 T3281 oascc.SolrZkClient.makePath makePath: /configs/conf2/stopwords.txt
[junit4] 2> 780540 T3281 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf2/protwords.txt
[junit4] 2> 780540 T3281 oascc.SolrZkClient.makePath makePath: /configs/conf2/protwords.txt
[junit4] 2> 780542 T3281 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf2/currency.xml
[junit4] 2> 780542 T3281 oascc.SolrZkClient.makePath makePath: /configs/conf2/currency.xml
[junit4] 2> 780544 T3281 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf2/open-exchange-rates.json
[junit4] 2> 780544 T3281 oascc.SolrZkClient.makePath makePath: /configs/conf2/open-exchange-rates.json
[junit4] 2> 780546 T3281 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf2/mapping-ISOLatin1Accent.txt
[junit4] 2> 780546 T3281 oascc.SolrZkClient.makePath makePath: /configs/conf2/mapping-ISOLatin1Accent.txt
[junit4] 2> 780548 T3281 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf2/old_synonyms.txt
[junit4] 2> 780548 T3281 oascc.SolrZkClient.makePath makePath: /configs/conf2/old_synonyms.txt
[junit4] 2> 780549 T3281 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf2/synonyms.txt
[junit4] 2> 780550 T3281 oascc.SolrZkClient.makePath makePath: /configs/conf2/synonyms.txt
[junit4] 2> 780552 T3281 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/elevate.xml to /configs/conf2/elevate.xml
[junit4] 2> 780552 T3281 oascc.SolrZkClient.makePath makePath: /configs/conf2/elevate.xml
[junit4] 2> 780808 T3281 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 780812 T3281 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 780813 T3281 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:51106
[junit4] 2> 780815 T3281 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 780815 T3281 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 780815 T3281 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.CollectionsAPIDistributedZkTest-6A915C65C2BEC277-001/tempDir-002
[junit4] 2> 780816 T3281 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.CollectionsAPIDistributedZkTest-6A915C65C2BEC277-001/tempDir-002/'
[junit4] 2> 780826 T3281 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-6A915C65C2BEC277-001/tempDir-002/solr.xml
[junit4] 2> 780868 T3281 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-6A915C65C2BEC277-001/tempDir-002
[junit4] 2> 780868 T3281 oasc.CoreContainer.<init> New CoreContainer 754674954
[junit4] 2> 780868 T3281 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.CollectionsAPIDistributedZkTest-6A915C65C2BEC277-001/tempDir-002/]
[junit4] 2> 780869 T3281 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 780869 T3281 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 780870 T3281 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 780870 T3281 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 780870 T3281 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 780870 T3281 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 780871 T3281 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 780871 T3281 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 780871 T3281 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 780874 T3281 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 780874 T3281 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 780874 T3281 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 780874 T3281 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50836/solr
[junit4] 2> 780875 T3281 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 780875 T3281 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 780877 T3307 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@31808fbe name:ZooKeeperConnection Watcher:127.0.0.1:50836 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 780877 T3281 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 780879 T3281 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 780881 T3309 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4fe1cf3 name:ZooKeeperConnection Watcher:127.0.0.1:50836/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 780881 T3281 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 780883 T3281 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 780886 T3281 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 780889 T3281 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 780892 T3281 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 780894 T3281 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 780897 T3281 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 780898 T3281 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51106_
[junit4] 2> 780899 T3281 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51106_
[junit4] 2> 780902 T3281 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 780903 T3281 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 780905 T3281 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:51106_
[junit4] 2> 780906 T3281 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 780907 T3281 oasc.Overseer.start Overseer (id=91615993157976070-127.0.0.1:51106_-n_0000000000) starting
[junit4] 2> 780909 T3281 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 780916 T3311 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 780916 T3281 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 780916 T3311 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes at 127.0.0.1:51106_
[junit4] 2> 780917 T3281 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 780918 T3281 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 780921 T3310 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 780922 T3281 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-6A915C65C2BEC277-001/tempDir-002
[junit4] 2> 780930 T3281 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-6A915C65C2BEC277-001/tempDir-002/conf/
[junit4] 2> 781018 T3281 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 781019 T3281 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4] 2> 781019 T3281 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 781021 T3281 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 781023 T3314 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2b8b4013 name:ZooKeeperConnection Watcher:127.0.0.1:50836/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 781023 T3281 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 781025 T3281 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 781028 T3281 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 781262 T3281 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 781263 T3281 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 781266 T3281 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 781267 T3281 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:56172
[junit4] 2> 781269 T3281 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 781269 T3281 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 781269 T3281 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-6A915C65C2BEC277-001/tempDir-003
[junit4] 2> 781270 T3281 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-6A915C65C2BEC277-001/tempDir-003/'
[junit4] 2> 781280 T3281 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-6A915C65C2BEC277-001/tempDir-003/solr.xml
[junit4] 2> 781301 T3281 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-6A915C65C2BEC277-001/tempDir-003
[junit4] 2> 781302 T3281 oasc.CoreContainer.<init> New CoreContainer 1350652299
[junit4] 2> 781302 T3281 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-6A915C65C2BEC277-001/tempDir-003/]
[junit4] 2> 781302 T3281 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 781303 T3281 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 781303 T3281 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 781303 T3281 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 781303 T3281 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 781303 T3281 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 781304 T3281 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 781304 T3281 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 781304 T3281 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 781306 T3281 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 781306 T3281 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 781307 T3281 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 781307 T3281 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50836/solr
[junit4] 2> 781307 T3281 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 781308 T3281 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 781309 T3325 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@574bdd4 name:ZooKeeperConnection Watcher:127.0.0.1:50836 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 781309 T3281 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 781311 T3281 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 781312 T3327 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@74563d1c name:ZooKeeperConnection Watcher:127.0.0.1:50836/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 781312 T3281 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 781318 T3281 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 782321 T3281 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56172_
[junit4] 2> 782344 T3281 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56172_
[junit4] 2> 782350 T3281 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-6A915C65C2BEC277-001/tempDir-003
[junit4] 2> 782355 T3281 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-6A915C65C2BEC277-001/tempDir-003/conf/
[junit4] 2> 782463 T3281 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 782464 T3281 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4] 2> 782464 T3281 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 782687 T3281 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 782688 T3281 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 782691 T3281 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 782692 T3281 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:33513
[junit4] 2> 782694 T3281 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 782694 T3281 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 782694 T3281 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-6A915C65C2BEC277-001/tempDir-004
[junit4] 2> 782694 T3281 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-6A915C65C2BEC277-001/tempDir-004/'
[junit4] 2> 782705 T3281 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-6A915C65C2BEC277-001/tempDir-004/solr.xml
[junit4] 2> 782726 T3281 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-6A915C65C2BEC277-001/tempDir-004
[junit4] 2> 782726 T3281 oasc.CoreContainer.<init> New CoreContainer 1590363052
[junit4] 2> 782726 T3281 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-6A915C65C2BEC277-001/tempDir-004/]
[junit4] 2> 782727 T3281 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 782727 T3281 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 782727 T3281 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 782728 T3281 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 782728 T3281 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 782728 T3281 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 782728 T3281 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 782728 T3281 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 782729 T3281 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 782731 T3281 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 782731 T3281 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 782732 T3281 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 782732 T3281 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50836/solr
[junit4] 2> 782732 T3281 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 782733 T3281 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 782736 T3339 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@59247ce9 name:ZooKeeperConnection Watcher:127.0.0.1:50836 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 782736 T3281 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 782740 T3281 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 782741 T3341 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f0a36b4 name:ZooKeeperConnection Watcher:127.0.0.1:50836/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 782742 T3281 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 782752 T3281 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 783755 T3281 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33513_
[junit4] 2> 783756 T3281 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:33513_
[junit4] 2> 783761 T3281 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-6A915C65C2BEC277-001/tempDir-004
[junit4] 2> 783766 T3281 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-6A915C65C2BEC277-001/tempDir-004/conf/
[junit4] 2> 783871 T3281 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 783872 T3281 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4] 2> 783872 T3281 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 784076 T3281 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 784077 T3281 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 784080 T3281 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 784081 T3281 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:57819
[junit4] 2> 784082 T3281 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 784083 T3281 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 784083 T3281 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.CollectionsAPIDistributedZkTest-6A915C65C2BEC277-001/tempDir-005
[junit4] 2> 784083 T3281 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.CollectionsAPIDistributedZkTest-6A915C65C2BEC277-001/tempDir-005/'
[junit4] 2> 784094 T3281 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-6A915C65C2BEC277-001/tempDir-005/solr.xml
[junit4] 2> 784127 T3281 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-6A915C65C2BEC277-001/tempDir-005
[junit4] 2> 784127 T3281 oasc.CoreContainer.<init> New CoreContainer 322964638
[junit4] 2> 784128 T3281 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.CollectionsAPIDistributedZkTest-6A915C65C2BEC277-001/tempDir-005/]
[junit4] 2> 784128 T3281 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 784129 T3281 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 784129 T3281 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 784129 T3281 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 784129 T3281 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 784129 T3281 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 784130 T3281 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 784130 T3281 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 784130 T3281 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 784132 T3281 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 784132 T3281 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 784133 T3281 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 784133 T3281 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50836/solr
[junit4] 2> 784133 T3281 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 784134 T3281 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 784135 T3353 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7c0adb0d name:ZooKeeperConnection Watcher:127.0.0.1:50836 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 784135 T3281 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 784138 T3281 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 784139 T3355 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1831d551 name:ZooKeeperConnection Watcher:127.0.0.1:50836/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 784139 T3281 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 784147 T3281 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 785150 T3281 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:57819_
[junit4] 2> 785151 T3281 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:57819_
[junit4] 2> 785157 T3281 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-6A915C65C2BEC277-001/tempDir-005
[junit4] 2> 785161 T3281 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-6A915C65C2BEC277-001/tempDir-005/conf/
[junit4] 2> 785243 T3281 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 785244 T3281 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4] 2> 785244 T3281 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 785450 T3281 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 4
[junit4] 2> 785450 T3281 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 785454 T3281 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 785454 T3281 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:42831
[junit4] 2> 785456 T3281 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 785456 T3281 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 785457 T3281 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-6A915C65C2BEC277-001/tempDir-006
[junit4] 2> 785457 T3281 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-6A915C65C2BEC277-001/tempDir-006/'
[junit4] 2> 785467 T3281 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-6A915C65C2BEC277-001/tempDir-006/solr.xml
[junit4] 2> 785488 T3281 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-6A915C65C2BEC277-001/tempDir-006
[junit4] 2> 785488 T3281 oasc.CoreContainer.<init> New CoreContainer 39689984
[junit4] 2> 785489 T3281 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-6A915C65C2BEC277-001/tempDir-006/]
[junit4] 2> 785489 T3281 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 785489 T3281 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 785490 T3281 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 785490 T3281 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 785490 T3281 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 785490 T3281 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 785490 T3281 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 785491 T3281 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 785491 T3281 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 785493 T3281 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 785493 T3281 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 785493 T3281 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 785494 T3281 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50836/solr
[junit4] 2> 785494 T3281 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 785495 T3281 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 785496 T3367 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@107665b3 name:ZooKeeperConnection Watcher:127.0.0.1:50836 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 785497 T3281 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 785498 T3281 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 785499 T3369 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@38428da3 name:ZooKeeperConnection Watcher:127.0.0.1:50836/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 785500 T3281 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 785505 T3281 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 786508 T3281 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42831_
[junit4] 2> 786510 T3281 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:42831_
[junit4] 2> 786518 T3281 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-6A915C65C2BEC277-001/tempDir-006
[junit4] 2> 786529 T3281 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-6A915C65C2BEC277-001/tempDir-006/conf/
[junit4] 2> 786637 T3281 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 786638 T3281 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4] 2> 786638 T3281 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 786710 T3323 oasha.CollectionsHandler.handleCreateAction Creating Collection : router.field=myOwnField&name=solrj_collection&router.name=compositeId&collection.configName=conf1&numShards=2&version=2&replicationFactor=2&wt=javabin&action=CREATE
[junit4] 2> 786744 T3309 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4] 2> 786745 T3311 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
[junit4] 2> "operation":"createcollection",
[junit4] 2> "fromApi":"true",
[junit4] 2> "name":"solrj_collection",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "collection.configName":"conf1",
[junit4] 2> "numShards":"2",
[junit4] 2> "router.field":"myOwnField",
[junit4] 2> "router.name":"compositeId"}
[junit4] 2> 786746 T3311 oasc.OverseerCollectionProcessor.processMessage WARN OverseerCollectionProcessor.processMessage : createcollection , {
[junit4] 2> "operation":"createcollection",
[junit4] 2> "fromApi":"true",
[junit4] 2> "name":"solrj_collection",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "collection.configName":"conf1",
[junit4] 2> "numShards":"2",
[junit4] 2> "router.field":"myOwnField",
[junit4] 2> "router.name":"compositeId"}
[junit4] 2> 786747 T3311 oasc.OverseerCollectionProcessor.createConfNode creating collections conf node /collections/solrj_collection
[junit4] 2> 786747 T3311 oascc.SolrZkClient.makePath makePath: /collections/solrj_collection
[junit4] 2> 786793 T3309 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 786795 T3310 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 786797 T3310 oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: solrj_collection
[junit4] 2> 786797 T3310 oasc.Overseer$ClusterStateUpdater.createCollection Create collection solrj_collection with shards [shard1, shard2]
[junit4] 2> 786797 T3310 oasc.Overseer$ClusterStateUpdater.createCollection _extern solrj_collection false
[junit4] 2> 793182 T3283 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1457c42a7ed0007, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 793283 T3314 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2b8b4013 name:ZooKeeperConnection Watcher:127.0.0.1:50836/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4] 2> 793283 T3314 oascc.ConnectionManager.process zkClient has disconnected
[junit4] 2> 794548 T3314 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2b8b4013 name:ZooKeeperConnection Watcher:127.0.0.1:50836/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 799847 T3283 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1457c42a7ed000d, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 799853 T3283 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1457c42a7ed000b, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 799947 T3355 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1831d551 name:ZooKeeperConnection Watcher:127.0.0.1:50836/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4] 2> 799947 T3355 oascc.ConnectionManager.process zkClient has disconnected
[junit4] 2> 799953 T3341 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f0a36b4 name:ZooKeeperConnection Watcher:127.0.0.1:50836/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4] 2> 799954 T3341 oascc.ConnectionManager.process zkClient has disconnected
[junit4] 2> 799975 T3283 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1457c42a7ed000f, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 800075 T3369 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@38428da3 name:ZooKeeperConnection Watcher:127.0.0.1:50836/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4] 2> 800075 T3369 oascc.ConnectionManager.process zkClient has disconnected
[junit4] 2> 800085 T3283 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1457c42a7ed0009, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 800137 T3283 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1457c42a7ed0006, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 800185 T3327 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@74563d1c name:ZooKeeperConnection Watcher:127.0.0.1:50836/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4] 2> 800186 T3327 oascc.ConnectionManager.process zkClient has disconnected
[junit4] 2> 800186 T3327 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: null state: Disconnected type None
[junit4] 2> 800237 T3309 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4fe1cf3 name:ZooKeeperConnection Watcher:127.0.0.1:50836/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4] 2> 800238 T3309 oascc.ConnectionManager.process zkClient has disconnected
[junit4] 2> 800238 T3309 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: null state: Disconnected type None
[junit4] 2> 800238 T3309 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: null state: Disconnected type None
[junit4] 2> 801215 T3283 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1457c42a7ed0007, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 801315 T3314 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2b8b4013 name:ZooKeeperConnection Watcher:127.0.0.1:50836/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4] 2> 801315 T3314 oascc.ConnectionManager.process zkClient has disconnected
[junit4] 2> 801336 T3327 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@74563d1c name:ZooKeeperConnection Watcher:127.0.0.1:50836/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801336 T3327 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: null state: SyncConnected type None
[junit4] 2> 801391 T3355 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1831d551 name:ZooKeeperConnection Watcher:127.0.0.1:50836/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801417 T3341 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f0a36b4 name:ZooKeeperConnection Watcher:127.0.0.1:50836/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801552 T3369 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@38428da3 name:ZooKeeperConnection Watcher:127.0.0.1:50836/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801689 T3309 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4fe1cf3 name:ZooKeeperConnection Watcher:127.0.0.1:50836/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 801689 T3309 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: null state: SyncConnected type None
[junit4] 2> 801689 T3309 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: null state: SyncConnected type None
[junit4] 2> 803159 T3314 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2b8b4013 name:ZooKeeperConnection Watcher:127.0.0.1:50836/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 809829 T3283 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1457c42a7ed0007, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 809929 T3314 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2b8b4013 name:ZooKeeperConnection Watcher:127.0.0.1:50836/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4] 2> 809929 T3314 oascc.ConnectionManager.process zkClient has disconnected
[junit4] 2> 811053 T3314 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2b8b4013 name:ZooKeeperConnection Watcher:127.0.0.1:50836/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 814675 T3283 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1457c42a7ed0009, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 814731 T3283 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1457c42a7ed000d, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 814755 T3283 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1457c42a7ed000b, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 814776 T3327 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: null state: Disconnected type None
[junit4] 2> 814776 T3327 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@74563d1c name:ZooKeeperConnection Watcher:127.0.0.1:50836/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4] 2> 814776 T3327 oascc.ConnectionManager.process zkClient has disconnected
[junit4] 2> 814831 T3355 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1831d551 name:ZooKeeperConnection Watcher:127.0.0.1:50836/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4] 2> 814832 T3355 oascc.ConnectionManager.process zkClient has disconnected
[junit4] 2> 814855 T3341 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f0a36b4 name:ZooKeeperConnection Watcher:127.0.0.1:50836/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4] 2> 814855 T3341 oascc.ConnectionManager.process zkClient has disconnected
[junit4] 2> 814889 T3283 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1457c42a7ed000f, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 814986 T3285 oazsp.FileTxnLog.commit WARN fsync-ing the write ahead log in SyncThread:0 took 28188ms which will adversely effect operation latency. See the ZooKeeper troubleshooting guide
[junit4] 2> 814987 T3285 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:404)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:200)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:131)
[junit4] 2>
[junit4] 2> 814988 T3285 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:170)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)
[junit4] 2>
[junit4] 2> 814989 T3285 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:170)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)
[junit4] 2>
[junit4] 2> 814989 T3285 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:170)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)
[junit4] 2>
[junit4] 2> 814990 T3285 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:170)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)
[junit4] 2>
[junit4] 2> 814990 T3285 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:170)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)
[junit4] 2>
[junit4] 2> 814991 T3285 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:170)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)
[junit4] 2>
[junit4] 2> 814989 T3369 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@38428da3 name:ZooKeeperConnection Watcher:127.0.0.1:50836/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4] 2> 814991 T3369 oascc.ConnectionManager.process zkClient has disconnected
[junit4] 2> 814991 T3285 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:404)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)
[junit4] 2>
[junit4] 2> 814992 T3285 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:170)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)
[junit4] 2>
[junit4] 2> 814992 T3285 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:404)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)
[junit4] 2>
[junit4] 2> 814993 T3285 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:404)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)
[junit4] 2>
[junit4] 2> 814993 T3285 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:404)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)
[junit4] 2>
[junit4] 2> 814993 T3285 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:404)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)
[junit4] 2>
[junit4] 2> 814993 T3285 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:404)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)
[junit4] 2>
[junit4] 2> 814994 T3285 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:404)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:200)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:131)
[junit4] 2>
[junit4] 2> 814995 T3285 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:170)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:200)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:131)
[junit4] 2>
[junit4] 2> 814995 T3285 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:170)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:200)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:131)
[junit4] 2>
[junit4] 2> 814995 T3285 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:170)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:200)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:131)
[junit4] 2>
[junit4] 2> 814996 T3285 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:170)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:200)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:131)
[junit4] 2>
[junit4] 2> 814996 T3285 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:170)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:200)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:131)
[junit4] 2>
[junit4] 2> 814997 T3309 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 814998 T3285 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.process(NIOServerCnxn.java:1118)
[junit4] 2> at org.apache.zookeeper.server.WatchManager.triggerWatch(WatchManager.java:120)
[junit4] 2> at org.apache.zookeeper.server.WatchManager.triggerWatch(WatchManager.java:92)
[junit4] 2> at org.apache.zookeeper.server.DataTree.setData(DataTree.java:620)
[junit4] 2> at org.apache.zookeeper.server.DataTree.processTxn(DataTree.java:807)
[junit4] 2> at org.apache.zookeeper.server.ZKDatabase.processTxn(ZKDatabase.java:329)
[junit4] 2> at org.apache.zookeeper.server.ZooKeeperServer.processTxn(ZooKeeperServer.java:994)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:116)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:200)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:131)
[junit4] 2>
[junit4] 2> 815000 T3285 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.process(NIOServerCnxn.java:1118)
[junit4] 2> at org.apache.zookeeper.server.WatchManager.triggerWatch(WatchManager.java:120)
[junit4] 2> at org.apache.zookeeper.server.WatchManager.triggerWatch(WatchManager.java:92)
[junit4] 2> at org.apache.zookeeper.server.DataTree.setData(DataTree.java:620)
[junit4] 2> at org.apache.zookeeper.server.DataTree.processTxn(DataTree.java:807)
[junit4] 2> at org.apache.zookeeper.server.ZKDatabase.processTxn(ZKDatabase.java:329)
[junit4] 2> at org.apache.zookeeper.server.ZooKeeperServer.processTxn(ZooKeeperServer.java:994)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:116)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:200)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:131)
[junit4] 2>
[junit4] 2> 815000 T3309 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 815000 T3314 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 815013 T3285 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.process(NIOServerCnxn.java:1118)
[junit4] 2> at org.apache.zookeeper.server.WatchManager.triggerWatch(WatchManager.java:120)
[junit4] 2> at org.apache.zookeeper.server.WatchManager.triggerWatch(WatchManager.java:92)
[junit4] 2> at org.apache.zookeeper.server.DataTree.setData(DataTree.java:620)
[junit4] 2> at org.apache.zookeeper.server.DataTree.processTxn(DataTree.java:807)
[junit4] 2> at org.apache.zookeeper.server.ZKDatabase.processTxn(ZKDatabase.java:329)
[junit4] 2> at org.apache.zookeeper.server.ZooKeeperServer.processTxn(ZooKeeperServer.java:994)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:116)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:200)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:131)
[junit4] 2>
[junit4] 2> 815014 T3285 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.process(NIOServerCnxn.java:1118)
[junit4] 2> at org.apache.zookeeper.server.WatchManager.triggerWatch(WatchManager.java:120)
[junit4] 2> at org.apache.zookeeper.server.WatchManager.triggerWatch(WatchManager.java:92)
[junit4] 2> at org.apache.zookeeper.server.DataTree.setData(DataTree.java:620)
[junit4] 2> at org.apache.zookeeper.server.DataTree.processTxn(DataTree.java:807)
[junit4] 2> at org.apache.zookeeper.server.ZKDatabase.processTxn(ZKDatabase.java:329)
[junit4] 2> at org.apache.zookeeper.server.ZooKeeperServer.processTxn(ZooKeeperServer.java:994)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:116)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:200)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:131)
[junit4] 2>
[junit4] 2> 815014 T3285 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.process(NIOServerCnxn.java:1118)
[junit4] 2> at org.apache.zookeeper.server.WatchManager.triggerWatch(WatchManager.java:120)
[junit4] 2> at org.apache.zookeeper.server.WatchManager.triggerWatch(WatchManager.java:92)
[junit4] 2> at org.apache.zookeeper.server.DataTree.setData(DataTree.java:620)
[junit4] 2> at org.apache.zookeeper.server.DataTree.processTxn(DataTree.java:807)
[junit4] 2> at org.apache.zookeeper.server.ZKDatabase.processTxn(ZKDatabase.java:329)
[junit4] 2> at org.apache.zookeeper.server.ZooKeeperServer.processTxn(ZooKeeperServer.java:994)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:116)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:200)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:131)
[junit4] 2>
[junit4] 2> 815015 T3285 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.process(NIOServerCnxn.java:1118)
[junit4] 2> at org.apache.zookeeper.server.WatchManager.triggerWatch(WatchManager.java:120)
[junit4] 2> at org.apache.zookeeper.server.WatchManager.triggerWatch(WatchManager.java:92)
[junit4] 2> at org.apache.zookeeper.server.DataTree.setData(DataTree.java:620)
[junit4] 2> at org.apache.zookeeper.server.DataTree.processTxn(DataTree.java:807)
[junit4] 2> at org.apache.zookeeper.server.ZKDatabase.processTxn(ZKDatabase.java:329)
[junit4] 2> at org.apache.zookeeper.server.ZooKeeperServer.processTxn(ZooKeeperServer.java:994)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:116)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:200)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:131)
[junit4] 2>
[junit4] 2> 815026 T3311 oasc.OverseerCollectionProcessor.createCollection Creating SolrCores for new collection, shardNames [shard1, shard2] , replicationFactor : 2
[junit4] 2> 815026 T3311 oasc.
[...truncated too long message...]
ShardLeaderElectionContext.rejoinLeaderElection(ElectionContext.java:372)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:210)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:142)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:110)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:303)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$9.execute(SolrZkClient.java:312)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$9.execute(SolrZkClient.java:309)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:309)
[junit4] 2> at org.apache.solr.cloud.Overseer.createOverseerNode(Overseer.java:1324)
[junit4] 2> ... 14 more
[junit4] 2>
[junit4] 2> 821687 T3341 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 821688 T3341 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 821688 T3341 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 821688 T3341 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 821688 T3341 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 821688 T3341 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 821688 T3341 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> NOTE: leaving temporary files on disk at: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-6A915C65C2BEC277-001
[junit4] 2> 50560 T3280 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 4 leaked thread(s).
[junit4] 2> 821773 T3394 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:277)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:274)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:274)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:329)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:85)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:293)
[junit4] 2>
[junit4] 2> 821784 T3355 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 821861 T3397 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:277)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:274)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:274)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:329)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:85)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:293)
[junit4] 2>
[junit4] 2> 821862 T3369 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> NOTE: test params are: codec=Lucene46: {}, docValues:{}, sim=DefaultSimilarity, locale=pl, timezone=Asia/Shanghai
[junit4] 2> NOTE: Linux 3.8.0-38-generic amd64/Oracle Corporation 1.7.0_60-ea (64-bit)/cpus=8,threads=1,free=44533376,total=265940992
[junit4] 2> NOTE: All tests run in this JVM: [HdfsUnloadDistributedZkTest, TestRTGBase, StandardRequestHandlerTest, SimplePostToolTest, NoFacetTest, SortByFunctionTest, TestFreeTextSuggestions, BasicDistributedZk2Test, TestFieldTypeCollectionResource, TestSolrCoreProperties, HdfsChaosMonkeySafeLeaderTest, TestFuzzyAnalyzedSuggestions, DirectSolrConnectionTest, HdfsDirectoryTest, TestCloudManagedSchemaAddField, DocValuesMultiTest, OutputWriterTest, DirectUpdateHandlerTest, TestSweetSpotSimilarityFactory, DocumentAnalysisRequestHandlerTest, CachingDirectoryFactoryTest, HdfsRecoveryZkTest, SolrPluginUtilsTest, TestIBSimilarityFactory, TestMiniSolrCloudCluster, TestArbitraryIndexDir, BasicZkTest, BlockDirectoryTest, TestQuerySenderNoQuery, JSONWriterTest, ZkNodePropsTest, LegacyHTMLStripCharFilterTest, StatsComponentTest, TestSchemaResource, BlockCacheTest, StressHdfsTest, OverseerStatusTest, NumericFieldsTest, AbstractAnalyticsStatsTest, TestCloudManagedSchema, TestStressRecovery, TestQueryTypes, TestIndexSearcher, TestAnalyzedSuggestions, ExpressionTest, TestSolr4Spatial, TestCursorMarkWithoutUniqueKey, DistributedQueryComponentOptimizationTest, InfoHandlerTest, BadIndexSchemaTest, DeleteReplicaTest, HighlighterConfigTest, TestSolrQueryParserDefaultOperatorResource, PluginInfoTest, TestJmxIntegration, DisMaxRequestHandlerTest, TestCollationField, PingRequestHandlerTest, SSLMigrationTest, DirectSolrSpellCheckerTest, FieldAnalysisRequestHandlerTest, OverseerRolesTest, ZkSolrClientTest, PrimUtilsTest, TestFastWriter, TestManagedSchema, TestHighFrequencyDictionaryFactory, TestUniqueKeyFieldResource, TestCSVLoader, TestLRUCache, IndexSchemaRuntimeFieldTest, SpellCheckComponentTest, DefaultValueUpdateProcessorTest, TestXIncludeConfig, RemoteQueryErrorTest, TestCollectionAPI, SuggesterWFSTTest, TestRecovery, DeleteInactiveReplicaTest, DateMathParserTest, MigrateRouteKeyTest, TestUpdate, ExternalCollectionsTest, DistributedDebugComponentTest, TestBlendedInfixSuggestions, DocValuesMissingTest, AsyncMigrateRouteKeyTest, DistributedExpandComponentTest, TestPhraseSuggestions, FileUtilsTest, TestSerializedLuceneMatchVersion, CoreContainerCoreInitFailuresTest, TestLMDirichletSimilarityFactory, TestConfigSets, AddBlockUpdateTest, TestRandomMergePolicy, SignatureUpdateProcessorFactoryTest, TestFoldingMultitermQuery, ChaosMonkeySafeLeaderTest, UnloadDistributedZkTest, CollectionsAPIDistributedZkTest]
[junit4] Completed on J1 in 50.84s, 1 test, 1 error <<< FAILURES!
[...truncated 716 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:467: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:447: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:45: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:496: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1296: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:920: There were test failures: 399 suites, 1668 tests, 1 error, 37 ignored (16 assumptions)
Total time: 56 minutes 59 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0_60-ea-b14 -XX:+UseCompressedOops -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure