You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/02/05 18:47:16 UTC
[JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.7.0_51) - Build #
9371 - Failure!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/9371/
Java: 64bit/jdk1.7.0_51 -XX:+UseCompressedOops -XX:+UseSerialGC
1 tests failed.
REGRESSION: org.apache.solr.cloud.OverseerRolesTest.testDistribSearch
Error Message:
Captured an uncaught exception in thread: Thread[id=756, name=Overseer-91201280644415496-127.0.0.1:51971_-n_0000000002, state=RUNNABLE, group=Overseer collection creation process.]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=756, name=Overseer-91201280644415496-127.0.0.1:51971_-n_0000000002, state=RUNNABLE, group=Overseer collection creation process.]
Caused by: org.apache.solr.common.cloud.ZooKeeperException:
at __randomizedtesting.SeedInfo.seed([2B98039E523392DC]:0)
at org.apache.solr.cloud.OverseerCollectionProcessor.run(OverseerCollectionProcessor.java:209)
at java.lang.Thread.run(Thread.java:744)
Caused by: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /overseer/collection-queue-work/qn-0000000004
at org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:173)
at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:170)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:170)
at org.apache.solr.cloud.DistributedQueue.remove(DistributedQueue.java:193)
at org.apache.solr.cloud.OverseerCollectionProcessor.run(OverseerCollectionProcessor.java:200)
... 1 more
Build Log:
[...truncated 10019 lines...]
[junit4] Suite: org.apache.solr.cloud.OverseerRolesTest
[junit4] 2> 87182 T599 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4] 2> 87186 T599 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-OverseerRolesTest-1391621103581
[junit4] 2> 87186 T599 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 87187 T600 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 87287 T599 oasc.ZkTestServer.run start zk server on port:54019
[junit4] 2> 87288 T599 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 87411 T606 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2bfb3ef3 name:ZooKeeperConnection Watcher:127.0.0.1:54019 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 87411 T599 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 87411 T599 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 87416 T599 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 87418 T608 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1eb0b508 name:ZooKeeperConnection Watcher:127.0.0.1:54019/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 87418 T599 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 87418 T599 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 87421 T599 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 87424 T599 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 87427 T599 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 87435 T599 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 87436 T599 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 87441 T599 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 87441 T599 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 87445 T599 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 87445 T599 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 87448 T599 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 87448 T599 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 87451 T599 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 87452 T599 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 87455 T599 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 87455 T599 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 87458 T599 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 87458 T599 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 87461 T599 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 87462 T599 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 87464 T599 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 87465 T599 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 87468 T599 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 87468 T599 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 87471 T599 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 87472 T599 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 87547 T599 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 87550 T599 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:40033
[junit4] 2> 87551 T599 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 87551 T599 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 87551 T599 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.OverseerRolesTest-controljetty-1391621103870
[junit4] 2> 87551 T599 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.OverseerRolesTest-controljetty-1391621103870/'
[junit4] 2> 87561 T599 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.OverseerRolesTest-controljetty-1391621103870/solr.xml
[junit4] 2> 87591 T599 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 87591 T599 oasc.CoreContainer.<init> New CoreContainer 1259858973
[junit4] 2> 87592 T599 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.OverseerRolesTest-controljetty-1391621103870/]
[junit4] 2> 87592 T599 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 87593 T599 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 87593 T599 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 87593 T599 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 87593 T599 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 87594 T599 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 87594 T599 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 87594 T599 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 87594 T599 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 87597 T599 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 87597 T599 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 87597 T599 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 87597 T599 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54019/solr
[junit4] 2> 87598 T599 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 87598 T599 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 87600 T619 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f8e8a6f name:ZooKeeperConnection Watcher:127.0.0.1:54019 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 87600 T599 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 87602 T599 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 87604 T621 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@469e93a7 name:ZooKeeperConnection Watcher:127.0.0.1:54019/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 87604 T599 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 87605 T599 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 87609 T599 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 87612 T599 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 87614 T599 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40033_
[junit4] 2> 87615 T599 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:40033_
[junit4] 2> 87618 T599 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 87621 T599 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 87624 T599 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:40033_
[junit4] 2> 87625 T599 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 87627 T599 oasc.Overseer.start Overseer (id=91201280644415491-127.0.0.1:40033_-n_0000000000) starting
[junit4] 2> 87631 T599 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 87635 T623 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 87636 T599 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 87636 T623 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
[junit4] 2> 87647 T599 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 87650 T599 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 87653 T622 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 87655 T599 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.OverseerRolesTest-controljetty-1391621103870
[junit4] 2> 87656 T599 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.OverseerRolesTest-controljetty-1391621103870/conf/
[junit4] 2> 87685 T599 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 87685 T599 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4] 2> 87685 T599 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 87686 T599 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 87688 T626 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@142cbaa1 name:ZooKeeperConnection Watcher:127.0.0.1:54019/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 87688 T599 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 87689 T599 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 87693 T599 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 87763 T599 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 87764 T599 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 87765 T599 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52538
[junit4] 2> 87766 T599 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 87766 T599 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 87766 T599 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.OverseerRolesTest-jetty1-1391621104088
[junit4] 2> 87766 T599 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.OverseerRolesTest-jetty1-1391621104088/'
[junit4] 2> 87776 T599 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.OverseerRolesTest-jetty1-1391621104088/solr.xml
[junit4] 2> 87806 T599 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 87806 T599 oasc.CoreContainer.<init> New CoreContainer 1537587037
[junit4] 2> 87806 T599 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.OverseerRolesTest-jetty1-1391621104088/]
[junit4] 2> 87807 T599 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 87807 T599 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 87808 T599 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 87808 T599 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 87808 T599 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 87808 T599 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 87808 T599 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 87809 T599 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 87809 T599 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 87818 T599 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 87818 T599 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 87818 T599 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 87819 T599 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54019/solr
[junit4] 2> 87819 T599 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 87819 T599 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 87821 T637 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7658caba name:ZooKeeperConnection Watcher:127.0.0.1:54019 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 87821 T599 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 87824 T599 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 87825 T639 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7e8f8e16 name:ZooKeeperConnection Watcher:127.0.0.1:54019/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 87825 T599 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 87829 T599 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 88833 T599 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52538_
[junit4] 2> 88834 T599 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52538_
[junit4] 2> 88838 T626 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 88838 T621 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 88838 T639 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 88843 T599 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.OverseerRolesTest-jetty1-1391621104088
[junit4] 2> 88844 T599 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.OverseerRolesTest-jetty1-1391621104088/conf/
[junit4] 2> 88866 T599 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 88866 T599 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4] 2> 88866 T599 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 88956 T599 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 88956 T599 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 88958 T599 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:51971
[junit4] 2> 88959 T599 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 88959 T599 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 88959 T599 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.OverseerRolesTest-jetty2-1391621105262
[junit4] 2> 88959 T599 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.OverseerRolesTest-jetty2-1391621105262/'
[junit4] 2> 88969 T599 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.OverseerRolesTest-jetty2-1391621105262/solr.xml
[junit4] 2> 88999 T599 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 89000 T599 oasc.CoreContainer.<init> New CoreContainer 80150087
[junit4] 2> 89000 T599 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.OverseerRolesTest-jetty2-1391621105262/]
[junit4] 2> 89001 T599 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 89001 T599 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 89001 T599 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 89001 T599 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 89002 T599 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 89002 T599 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 89002 T599 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 89002 T599 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 89002 T599 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 89013 T599 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 89013 T599 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 89013 T599 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 89013 T599 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54019/solr
[junit4] 2> 89014 T599 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 89014 T599 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 89016 T651 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14ec5584 name:ZooKeeperConnection Watcher:127.0.0.1:54019 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 89016 T599 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 89019 T599 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 89020 T653 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@647750ac name:ZooKeeperConnection Watcher:127.0.0.1:54019/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 89020 T599 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 89024 T599 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 90028 T599 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51971_
[junit4] 2> 90029 T599 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51971_
[junit4] 2> 90032 T653 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 90033 T639 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 90033 T626 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 90033 T621 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 90038 T599 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.OverseerRolesTest-jetty2-1391621105262
[junit4] 2> 90039 T599 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.OverseerRolesTest-jetty2-1391621105262/conf/
[junit4] 2> 90067 T599 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 90067 T599 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4] 2> 90067 T599 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 90137 T599 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 90137 T599 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 90139 T599 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:45744
[junit4] 2> 90140 T599 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 90140 T599 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 90140 T599 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.OverseerRolesTest-jetty3-1391621106463
[junit4] 2> 90141 T599 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.OverseerRolesTest-jetty3-1391621106463/'
[junit4] 2> 90150 T599 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.OverseerRolesTest-jetty3-1391621106463/solr.xml
[junit4] 2> 90180 T599 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 90180 T599 oasc.CoreContainer.<init> New CoreContainer 877216264
[junit4] 2> 90180 T599 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.OverseerRolesTest-jetty3-1391621106463/]
[junit4] 2> 90181 T599 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 90181 T599 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 90181 T599 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 90182 T599 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 90182 T599 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 90182 T599 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 90182 T599 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 90182 T599 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 90189 T599 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 90191 T599 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 90192 T599 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 90192 T599 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 90192 T599 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54019/solr
[junit4] 2> 90192 T599 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 90193 T599 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 90194 T665 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b7da457 name:ZooKeeperConnection Watcher:127.0.0.1:54019 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 90195 T599 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 90197 T599 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 90199 T667 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@519b34b0 name:ZooKeeperConnection Watcher:127.0.0.1:54019/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 90199 T599 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 90205 T599 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 91208 T599 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45744_
[junit4] 2> 91209 T599 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:45744_
[junit4] 2> 91212 T621 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 91213 T626 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 91213 T653 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 91213 T667 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 91213 T639 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 91219 T599 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.OverseerRolesTest-jetty3-1391621106463
[junit4] 2> 91220 T599 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.OverseerRolesTest-jetty3-1391621106463/conf/
[junit4] 2> 91249 T599 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 91250 T599 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4] 2> 91250 T599 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 91322 T599 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 4
[junit4] 2> 91323 T599 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 91325 T599 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:48980
[junit4] 2> 91326 T599 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 91326 T599 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 91326 T599 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.OverseerRolesTest-jetty4-1391621107645
[junit4] 2> 91326 T599 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.OverseerRolesTest-jetty4-1391621107645/'
[junit4] 2> 91336 T599 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.OverseerRolesTest-jetty4-1391621107645/solr.xml
[junit4] 2> 91367 T599 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 91368 T599 oasc.CoreContainer.<init> New CoreContainer 496660776
[junit4] 2> 91368 T599 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.OverseerRolesTest-jetty4-1391621107645/]
[junit4] 2> 91369 T599 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 91369 T599 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 91369 T599 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 91369 T599 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 91370 T599 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 91370 T599 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 91370 T599 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 91370 T599 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 91370 T599 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 91380 T599 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 91380 T599 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 91381 T599 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 91381 T599 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54019/solr
[junit4] 2> 91381 T599 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 91382 T599 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 91383 T679 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@775c70a3 name:ZooKeeperConnection Watcher:127.0.0.1:54019 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 91384 T599 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 91386 T599 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 91388 T681 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f0b1e03 name:ZooKeeperConnection Watcher:127.0.0.1:54019/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 91388 T599 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 91392 T599 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 92397 T599 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48980_
[junit4] 2> 92398 T599 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:48980_
[junit4] 2> 92402 T626 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 92402 T621 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 92402 T653 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 92402 T667 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 92402 T639 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 92403 T681 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 92410 T599 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.OverseerRolesTest-jetty4-1391621107645
[junit4] 2> 92411 T599 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.OverseerRolesTest-jetty4-1391621107645/conf/
[junit4] 2> 92433 T599 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 92433 T599 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4] 2> 92434 T599 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 92505 T599 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 5
[junit4] 2> 92506 T599 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 92508 T599 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:39527
[junit4] 2> 92509 T599 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 92509 T599 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 92509 T599 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.OverseerRolesTest-jetty5-1391621108829
[junit4] 2> 92509 T599 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.OverseerRolesTest-jetty5-1391621108829/'
[junit4] 2> 92520 T599 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.OverseerRolesTest-jetty5-1391621108829/solr.xml
[junit4] 2> 92553 T599 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 92554 T599 oasc.CoreContainer.<init> New CoreContainer 531450870
[junit4] 2> 92554 T599 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.OverseerRolesTest-jetty5-1391621108829/]
[junit4] 2> 92555 T599 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 92555 T599 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 92555 T599 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 92555 T599 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 92556 T599 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 92556 T599 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 92556 T599 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 92556 T599 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 92557 T599 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 92566 T599 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 92566 T599 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 92566 T599 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 92567 T599 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54019/solr
[junit4] 2> 92567 T599 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 92567 T599 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 92569 T693 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7928ec65 name:ZooKeeperConnection Watcher:127.0.0.1:54019 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 92570 T599 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 92572 T599 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 92574 T695 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3a5f5e4a name:ZooKeeperConnection Watcher:127.0.0.1:54019/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 92574 T599 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 92578 T599 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 93581 T599 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39527_
[junit4] 2> 93583 T599 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:39527_
[junit4] 2> 93587 T639 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 93587 T667 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 93587 T626 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 93587 T653 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 93588 T695 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 93587 T621 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 93587 T681 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 93593 T599 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.OverseerRolesTest-jetty5-1391621108829
[junit4] 2> 93594 T599 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.OverseerRolesTest-jetty5-1391621108829/conf/
[junit4] 2> 93616 T599 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 93617 T599 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4] 2> 93617 T599 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 93689 T599 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 6
[junit4] 2> 93690 T599 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 93692 T599 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:38144
[junit4] 2> 93693 T599 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 93693 T599 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 93693 T599 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.OverseerRolesTest-jetty6-1391621110012
[junit4] 2> 93693 T599 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.OverseerRolesTest-jetty6-1391621110012/'
[junit4] 2> 93703 T599 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.OverseerRolesTest-jetty6-1391621110012/solr.xml
[junit4] 2> 93733 T599 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 93734 T599 oasc.CoreContainer.<init> New CoreContainer 1770113589
[junit4] 2> 93734 T599 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.OverseerRolesTest-jetty6-1391621110012/]
[junit4] 2> 93735 T599 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 93735 T599 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 93735 T599 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 93735 T599 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 93735 T599 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 93736 T599 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 93736 T599 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 93736 T599 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 93736 T599 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 93739 T599 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 93739 T599 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 93739 T599 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 93740 T599 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54019/solr
[junit4] 2> 93740 T599 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 93747 T599 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 93748 T707 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@480293b0 name:ZooKeeperConnection Watcher:127.0.0.1:54019 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 93749 T599 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 93751 T599 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 93752 T709 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@28c48ef9 name:ZooKeeperConnection Watcher:127.0.0.1:54019/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 93752 T599 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 93757 T599 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 94760 T599 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38144_
[junit4] 2> 94762 T599 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:38144_
[junit4] 2> 94766 T667 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 94767 T653 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 94767 T681 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 94767 T626 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 94767 T695 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 94767 T639 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 94767 T621 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 94767 T709 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 94775 T599 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.OverseerRolesTest-jetty6-1391621110012
[junit4] 2> 94776 T599 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.OverseerRolesTest-jetty6-1391621110012/conf/
[junit4] 2> 94802 T599 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 94803 T599 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4] 2> 94803 T599 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 94805 T599 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 94808 T712 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5b8dcb1 name:ZooKeeperConnection Watcher:127.0.0.1:54019/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 94809 T599 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 94811 T599 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 94818 T599 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 94821 T714 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@44cfa258 name:ZooKeeperConnection Watcher:127.0.0.1:54019/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 94821 T599 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 94824 T599 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 94834 T634 oasha.CollectionsHandler.handleCreateAction Creating Collection : name=testOverseerCol&version=2&numShards=4&action=CREATE&wt=javabin&maxShardsPerNode=2&replicationFactor=2
[junit4] 2> 94850 T621 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4] 2> 94855 T623 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
[junit4] 2> "operation":"createcollection",
[junit4] 2> "fromApi":"true",
[junit4] 2> "name":"testOverseerCol",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "numShards":"4",
[junit4] 2> "maxShardsPerNode":"2"}
[junit4] 2> 94856 T623 oasc.OverseerCollectionProcessor.processMessage WARN OverseerCollectionProcessor.processMessage : createcollection , {
[junit4] 2> "operation":"createcollection",
[junit4] 2> "fromApi":"true",
[junit4] 2> "name":"testOverseerCol",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "numShards":"4",
[junit4] 2> "maxShardsPerNode":"2"}
[junit4] 2> 94857 T623 oasc.OverseerCollectionProcessor.createConfNode Only one config set found in zk - using it:conf1
[junit4] 2> 94857 T623 oasc.OverseerCollectionProcessor.createConfNode creating collections conf node /collections/testOverseerCol
[junit4] 2> 94857 T623 oascc.SolrZkClient.makePath makePath: /collections/testOverseerCol
[junit4] 2> 94862 T621 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 94864 T622 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 94865 T622 oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: testOverseerCol
[junit4] 2> 94865 T622 oasc.Overseer$ClusterStateUpdater.createCollection Create collection testOverseerCol with shards [shard1, shard2, shard3, shard4]
[junit4] 2> 94868 T621 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 94869 T712 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 94870 T709 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 94870 T639 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 94870 T621 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 94870 T626 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 94870 T681 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 94871 T667 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 94871 T714 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 94871 T695 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 94872 T653 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 94963 T623 oasc.OverseerCollectionProcessor.createCollection going to create cores replicas shardNames [shard1, shard2, shard3, shard4] , repFactor : 2
[junit4] 2> 94963 T623 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard1_replica1 as part of slice shard1 of collection testOverseerCol on 127.0.0.1:52538_
[junit4] 2> 94963 T623 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard1_replica2 as part of slice shard1 of collection testOverseerCol on 127.0.0.1:48980_
[junit4] 2> 94964 T623 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard2_replica1 as part of slice shard2 of collection testOverseerCol on 127.0.0.1:51971_
[junit4] 2> 94964 T623 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard2_replica2 as part of slice shard2 of collection testOverseerCol on 127.0.0.1:40033_
[junit4] 2> 94965 T623 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard3_replica1 as part of slice shard3 of collection testOverseerCol on 127.0.0.1:39527_
[junit4] 2> 94966 T623 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard3_replica2 as part of slice shard3 of collection testOverseerCol on 127.0.0.1:38144_
[junit4] 2> 94966 T623 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard4_replica1 as part of slice shard4 of collection testOverseerCol on 127.0.0.1:45744_
[junit4] 2> 94966 T623 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard4_replica2 as part of slice shard4 of collection testOverseerCol on 127.0.0.1:52538_
[junit4] 2> 94966 T649 oasc.ZkController.publish publishing core=testOverseerCol_shard2_replica1 state=down
[junit4] 2> 94973 T632 oasc.ZkController.publish publishing core=testOverseerCol_shard4_replica2 state=down
[junit4] 2> 94970 T617 oasc.ZkController.publish publishing core=testOverseerCol_shard2_replica2 state=down
[junit4] 2> 94969 T676 oasc.ZkController.publish publishing core=testOverseerCol_shard1_replica2 state=down
[junit4] 2> 94968 T661 oasc.ZkController.publish publishing core=testOverseerCol_shard4_replica1 state=down
[junit4] 2> 94968 T704 oasc.ZkController.publish publishing core=testOverseerCol_shard3_replica2 state=down
[junit4] 2> 94967 T691 oasc.ZkController.publish publishing core=testOverseerCol_shard3_replica1 state=down
[junit4] 2> 94976 T676 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 94976 T649 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 94977 T621 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 94975 T632 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 94974 T633 oasc.ZkController.publish publishing core=testOverseerCol_shard1_replica1 state=down
[junit4] 2> 94977 T691 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 94977 T704 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 94977 T661 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 94978 T617 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 94979 T621 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 94979 T633 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 94980 T622 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 94981 T622 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:51971",
[junit4] 2> "core":"testOverseerCol_shard2_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:51971_",
[junit4] 2> "shard":"shard2",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"testOverseerCol",
[junit4] 2> "numShards":"4",
[junit4] 2> "core_node_name":null}
[junit4] 2> 94986 T622 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:52538",
[junit4] 2> "core":"testOverseerCol_shard4_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:52538_",
[junit4] 2> "shard":"shard4",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"testOverseerCol",
[junit4] 2> "numShards":"4",
[junit4] 2> "core_node_name":null}
[junit4] 2> 94989 T621 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 94990 T622 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:40033",
[junit4] 2> "core":"testOverseerCol_shard2_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:40033_",
[junit4] 2> "shard":"shard2",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"testOverseerCol",
[junit4] 2> "numShards":"4",
[junit4] 2> "core_node_name":null}
[junit4] 2> 94993 T621 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 94995 T622 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:48980",
[junit4] 2> "core":"testOverseerCol_shard1_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:48980_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"testOverseerCol",
[junit4] 2> "numShards":"4",
[junit4] 2> "core_node_name":null}
[junit4] 2> 94999 T621 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 95000 T622 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:45744",
[junit4] 2> "core":"testOverseerCol_shard4_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:45744_",
[junit4] 2> "shard":"shard4",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"testOverseerCol",
[junit4] 2> "numShards":"4",
[junit4] 2> "core_node_name":null}
[junit4] 2> 95005 T621 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 95006 T622 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:38144",
[junit4] 2> "core":"testOverseerCol_shard3_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:38144_",
[junit4] 2> "shard":"shard3",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"testOverseerCol",
[junit4] 2> "numShards":"4",
[junit4] 2> "core_node_name":null}
[junit4] 2> 95009 T621 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 95010 T622 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:39527",
[junit4] 2> "core":"testOverseerCol_shard3_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:39527_",
[junit4] 2> "shard":"shard3",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"testOverseerCol",
[junit4] 2> "numShards":"4",
[junit4] 2> "core_node_name":null}
[junit4] 2> 95013 T621 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 95014 T622 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:52538",
[junit4] 2> "core":"testOverseerCol_shard1_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:52538_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"testOverseerCol",
[junit4] 2> "numShards":"4",
[junit4] 2> "core_node_name":null}
[junit4] 2> 95017 T621 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 95120 T667 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 95120 T621 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 95121 T626 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 95120 T695 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 95121 T709 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 95121 T653 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 95121 T681 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 95121 T639 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 95123 T714 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 95121 T712 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 95976 T676 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard1_replica2
[junit4] 2> 95977 T649 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard2_replica1
[junit4] 2> 95978 T676 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard1_replica2' using instanceDir: ./org.apache.solr.cloud.OverseerRolesTest-jetty4-1391621107645/testOverseerCol_shard1_replica2
[junit4] 2> 95978 T676 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
[junit4] 2> 95978 T691 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard3_replica1
[junit4] 2> 95979 T617 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard2_replica2
[junit4] 2> 95979 T649 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard2_replica1' using instanceDir: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.OverseerRolesTest-jetty2-1391621105262/testOverseerCol_shard2_replica1
[junit4] 2> 95980 T649 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
[junit4] 2> 95979 T661 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard4_replica1
[junit4] 2> 95979 T632 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard4_replica2
[junit4] 2> 95978 T704 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard3_replica2
[junit4] 2> 95981 T676 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 95981 T676 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
[junit4] 2> 95982 T632 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard4_replica2' using instanceDir: ./org.apache.solr.cloud.OverseerRolesTest-jetty1-1391621104088/testOverseerCol_shard4_replica2
[junit4] 2> 95982 T632 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
[junit4] 2> 95980 T691 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard3_replica1' using instanceDir: ./org.apache.solr.cloud.OverseerRolesTest-jetty5-1391621108829/testOverseerCol_shard3_replica1
[junit4] 2> 95983 T691 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
[junit4] 2> 95980 T633 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard1_replica1
[junit4] 2> 95982 T704 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard3_replica2' using instanceDir: ./org.apache.solr.cloud.OverseerRolesTest-jetty6-1391621110012/testOverseerCol_shard3_replica2
[junit4] 2> 95984 T704 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
[junit4] 2> 95982 T649 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 95984 T649 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
[junit4] 2> 95985 T691 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 95982 T661 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard4_replica1' using instanceDir: ./org.apache.solr.cloud.OverseerRolesTest-jetty3-1391621106463/testOverseerCol_shard4_replica1
[junit4] 2> 95985 T661 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
[junit4] 2> 95986 T676 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.OverseerRolesTest-jetty4-1391621107645/testOverseerCol_shard1_replica2/'
[junit4] 2> 95982 T617 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard2_replica2' using instanceDir: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.OverseerRolesTest-controljetty-1391621103870/testOverseerCol_shard2_replica2
[junit4] 2> 95986 T617 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
[junit4] 2> 95985 T704 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 95987 T704 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
[junit4] 2> 95985 T691 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
[junit4] 2> 95987 T632 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 95988 T632 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
[junit4] 2> 95989 T633 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard1_replica1' using instanceDir: ./org.apache.solr.cloud.OverseerRolesTest-jetty1-1391621104088/testOverseerCol_shard1_replica1
[junit4] 2> 95990 T633 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
[junit4] 2> 95993 T649 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.OverseerRolesTest-jetty2-1391621105262/testOverseerCol_shard2_replica1/'
[junit4] 2> 95994 T617 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 95994 T617 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
[junit4] 2> 95993 T661 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 95995 T661 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
[junit4] 2> 95995 T633 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 95995 T633 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
[junit4] 2> 95996 T632 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.OverseerRolesTest-jetty1-1391621104088/testOverseerCol_shard4_replica2/'
[junit4] 2> 95996 T704 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.OverseerRolesTest-jetty6-1391621110012/testOverseerCol_shard3_replica2/'
[junit4] 2> 95998 T691 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.OverseerRolesTest-jetty5-1391621108829/testOverseerCol_shard3_replica1/'
[junit4] 2> 95998 T617 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.OverseerRolesTest-controljetty-1391621103870/testOverseerCol_shard2_replica2/'
[junit4] 2> 96004 T633 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.OverseerRolesTest-jetty1-1391621104088/testOverseerCol_shard1_replica1/'
[junit4] 2> 96005 T661 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.OverseerRolesTest-jetty3-1391621106463/testOverseerCol_shard4_replica1/'
[junit4] 2> 96110 T617 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 96111 T632 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 96114 T649 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 96117 T676 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 96135 T691 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 96139 T661 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 96155 T704 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 96169 T633 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 96217 T632 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 96224 T632 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 96257 T632 oass.IndexSchema.readSchema [testOverseerCol_shard4_replica2] Schema name=test
[junit4] 2> 96259 T649 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 96261 T649 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 96264 T676 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 96264 T617 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 96266 T676 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 96268 T617 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 96282 T649 oass.IndexSchema.readSchema [testOverseerCol_shard2_replica1] Schema name=test
[junit4] 2> 96288 T691 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 96290 T691 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 96297 T676 oass.IndexSchema.readSchema [testOverseerCol_shard1_replica2] Schema name=test
[junit4] 2> 96298 T617 oass.IndexSchema.readSchema [testOverseerCol_shard2_replica2] Schema name=test
[junit4] 2> 96320 T704 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 96322 T633 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 96324 T704 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 96336 T691 oass.IndexSchema.readSchema [testOverseerCol_shard3_replica1] Schema name=test
[junit4] 2> 96341 T633 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 96349 T704 oass.IndexSchema.readSchema [testOverseerCol_shard3_replica2] Schema name=test
[junit4] 2> 96351 T633 oass.IndexSchema.readSchema [testOverseerCol_shard1_replica1] Schema name=test
[junit4] 2> 96366 T661 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 96374 T661 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 96402 T661 oass.IndexSchema.readSchema [testOverseerCol_shard4_replica1] Schema name=test
[junit4] 2> 97317 T632 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 97328 T632 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 97338 T632 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 97339 T676 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 97341 T704 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 97348 T676 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 97350 T704 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 97352 T676 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 97354 T704 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 97363 T649 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 97366 T691 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 97372 T649 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 97374 T691 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 97374 T632 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 97380 T633 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 97380 T691 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 97376 T649 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 97384 T676 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 97398 T633 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 97399 T632 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 97401 T633 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 97406 T676 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 97412 T632 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 97413 T704 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 97416 T632 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 97422 T632 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 97423 T632 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 97416 T617 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 97424 T704 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 97416 T676 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 97423 T661 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 97427 T632 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 97428 T632 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 97429 T632 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 97429 T632 oasc.SolrCore.<init> [testOverseerCol_shard4_replica2] Opening new SolrCore at ./org.apache.solr.cloud.OverseerRolesTest-jetty1-1391621104088/testOverseerCol_shard4_replica2/, dataDir=./org.apache.solr.cloud.OverseerRolesTest-jetty1-1391621104088/testOverseerCol_shard4_replica2/data/
[junit4] 2> 97430 T649 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 97430 T632 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@318f05ef
[junit4] 2> 97431 T704 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 97432 T676 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 97432 T617 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 97432 T632 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.OverseerRolesTest-jetty1-1391621104088/testOverseerCol_shard4_replica2/data
[junit4] 2> 97432 T676 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 97433 T661 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 97433 T632 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.OverseerRolesTest-jetty1-1391621104088/testOverseerCol_shard4_replica2/data/index/
[junit4] 2> 97434 T632 oasc.SolrCore.initIndex WARN [testOverseerCol_shard4_replica2] Solr index directory './org.apache.solr.cloud.OverseerRolesTest-jetty1-1391621104088/testOverseerCol_shard4_replica2/data/index' doesn't exist. Creating new index...
[junit4] 2> 97434 T676 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 97437 T661 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 97436 T617 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 97438 T676 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 97439 T676 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 97435 T704 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 97439 T704 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 97439 T676 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 97439 T633 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 97437 T649 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 97437 T632 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.OverseerRolesTest-jetty1-1391621104088/testOverseerCol_shard4_replica2/data/index
[junit4] 2> 97440 T676 oasc.SolrCore.<init> [testOverseerCol_shard1_replica2] Opening new SolrCore at ./org.apache.solr.cloud.OverseerRolesTest-jetty4-1391621107645/testOverseerCol_shard1_replica2/, dataDir=./org.apache.solr.cloud.OverseerRolesTest-jetty4-1391621107645/testOverseerCol_shard1_replica2/data/
[junit4] 2> 97440 T704 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 97441 T676 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@318f05ef
[junit4] 2> 97441 T632 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=22, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 97442 T691 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 97442 T676 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.OverseerRolesTest-jetty4-1391621107645/testOverseerCol_shard1_replica2/data
[junit4] 2> 97443 T676 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.OverseerRolesTest-jetty4-1391621107645/testOverseerCol_shard1_replica2/data/index/
[junit4] 2> 97443 T632 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@21065fec lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4fbf92b9),segFN=segments_1,generation=1}
[junit4] 2> 97443 T676 oasc.SolrCore.initIndex WARN [testOverseerCol_shard1_replica2] Solr index directory './org.apache.solr.cloud.OverseerRolesTest-jetty4-1391621107645/testOverseerCol_shard1_replica2/data/index' doesn't exist. Creating new index...
[junit4] 2> 97443 T632 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 97444 T676 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.OverseerRolesTest-jetty4-1391621107645/testOverseerCol_shard1_replica2/data/index
[junit4] 2> 97444 T676 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=22, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 97445 T676 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@4e78c870 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4463db73),segFN=segments_1,generation=1}
[junit4] 2> 97445 T676 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 97450 T632 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 97451 T632 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 97451 T632 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 97451 T632 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 97452 T632 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 97452 T632 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 97452 T676 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 97452 T632 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 97452 T676 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 97453 T632 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 97453 T676 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 97453 T632 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 97453 T676 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 97454 T676 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 97454 T676 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 97454 T632 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 97454 T676 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 97455 T676 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 97455 T676 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 97455 T632 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 97455 T632 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 97456 T632 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 97456 T676 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 97456 T676 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 97457 T676 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 97457 T632 oasc.RequestHandlers.initHandlersFromConfig created /upd
[...truncated too long message...]
RN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> ASYNC NEW_CORE C164 name=testOverseerCol_shard4_replica1 org.apache.solr.core.SolrCore@1624bdb0 url=http://127.0.0.1:45744/testOverseerCol_shard4_replica1 node=127.0.0.1:45744_ C164_STATE=coll:testOverseerCol core:testOverseerCol_shard4_replica1 props:{state=active, base_url=http://127.0.0.1:45744, core=testOverseerCol_shard4_replica1, node_name=127.0.0.1:45744_}
[junit4] 2> 105928 T667 C164 P45744 oasc.SyncStrategy.sync WARN Closed, skipping sync up.
[junit4] 2> 105929 T667 oasc.ShardLeaderElectionContext.runLeaderProcess We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 105929 T667 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:45744/testOverseerCol_shard4_replica1/ shard4
[junit4] 2> 105929 T667 oasc.SolrCore.close [testOverseerCol_shard4_replica1] CLOSING SolrCore org.apache.solr.core.SolrCore@1624bdb0
[junit4] 2> 105941 T667 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0,transaction_logs_total_size=0,transaction_logs_total_number=0}
[junit4] 2> 105941 T667 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 105941 T667 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 105941 T667 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 105941 T667 oasc.SolrCore.closeSearcher [testOverseerCol_shard4_replica1] Closing main searcher on request.
[junit4] 2> 105942 T667 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 105942 T667 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.OverseerRolesTest-jetty3-1391621106463/testOverseerCol_shard4_replica1/data/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.OverseerRolesTest-jetty3-1391621106463/testOverseerCol_shard4_replica1/data/index;done=false>>]
[junit4] 2> 105942 T667 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.OverseerRolesTest-jetty3-1391621106463/testOverseerCol_shard4_replica1/data/index
[junit4] 2> 105942 T667 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.OverseerRolesTest-jetty3-1391621106463/testOverseerCol_shard4_replica1/data [CachedDir<<refCount=0;path=./org.apache.solr.cloud.OverseerRolesTest-jetty3-1391621106463/testOverseerCol_shard4_replica1/data;done=false>>]
[junit4] 2> 105942 T667 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.OverseerRolesTest-jetty3-1391621106463/testOverseerCol_shard4_replica1/data
[junit4] 2> 105942 T667 oascc.SolrZkClient.makePath makePath: /collections/testOverseerCol/leaders/shard4
[junit4] 2> 105943 T667 oasc.SolrException.log ERROR There was a problem trying to register as the leader:org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1041)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:205)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:202)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:202)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:413)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:382)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:369)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:112)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:273)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:164)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:108)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 105943 T667 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/testOverseerCol/leader_elect/shard4/election/91201280644415498-core_node5-n_0000000001
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:173)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:170)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:170)
[junit4] 2> at org.apache.solr.cloud.ElectionContext.cancelElection(ElectionContext.java:67)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:293)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:164)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:108)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 105943 T667 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 105944 T667 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 105944 T667 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 105944 T667 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 105944 T667 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 105944 T667 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> NOTE: test params are: codec=Lucene46: {}, docValues:{}, sim=DefaultSimilarity, locale=es_UY, timezone=Pacific/Fiji
[junit4] 2> NOTE: Linux 3.8.0-35-generic amd64/Oracle Corporation 1.7.0_51 (64-bit)/cpus=8,threads=6,free=50605592,total=126484480
[junit4] 2> NOTE: All tests run in this JVM: [TestDistributedGrouping, TermVectorComponentDistributedTest, TestLazyCores, CachingDirectoryFactoryTest, HardAutoCommitTest, CoreMergeIndexesAdminHandlerTest, DirectSolrSpellCheckerTest, DocValuesMultiTest, SolrCmdDistributorTest, StressHdfsTest, TestRangeQuery, TestComponentsName, PreAnalyzedFieldTest, TestCSVLoader, TestShardHandlerFactory, ShardRoutingCustomTest, OverseerRolesTest]
[junit4] Completed on J1 in 18.92s, 1 test, 1 error <<< FAILURES!
[...truncated 1049 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:453: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:433: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:491: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1268: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:901: There were test failures: 368 suites, 1593 tests, 1 error, 41 ignored (7 assumptions)
Total time: 48 minutes 16 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0_51 -XX:+UseCompressedOops -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure