You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2013/08/19 06:47:09 UTC
[JENKINS] Lucene-Solr-4.x-Linux (64bit/jdk1.7.0_25) - Build # 6991
- Failure!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/6991/
Java: 64bit/jdk1.7.0_25 -XX:-UseCompressedOops -XX:+UseG1GC
1 tests failed.
REGRESSION: org.apache.solr.cloud.UnloadDistributedZkTest.testDistribSearch
Error Message:
Captured an uncaught exception in thread: Thread[id=1751, name=testExecutor-1168-thread-1, state=RUNNABLE, group=TGRP-UnloadDistributedZkTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=1751, name=testExecutor-1168-thread-1, state=RUNNABLE, group=TGRP-UnloadDistributedZkTest]
Caused by: java.lang.RuntimeException: org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:43842
at __randomizedtesting.SeedInfo.seed([45A42261C6B4F179]:0)
at org.apache.solr.cloud.UnloadDistributedZkTest$1.run(UnloadDistributedZkTest.java:399)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
Caused by: org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:43842
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:431)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.cloud.UnloadDistributedZkTest$1.run(UnloadDistributedZkTest.java:397)
... 3 more
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:150)
at java.net.SocketInputStream.read(SocketInputStream.java:121)
at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:166)
at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:90)
at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:281)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:92)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:62)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:254)
at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:289)
at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:252)
at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:191)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:300)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:127)
at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:717)
at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:522)
at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:906)
at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:805)
at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:784)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:365)
... 5 more
Build Log:
[...truncated 9986 lines...]
[junit4] Suite: org.apache.solr.cloud.UnloadDistributedZkTest
[junit4] 2> 405609 T1565 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4] 2> 405613 T1565 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1376886638484
[junit4] 2> 405614 T1565 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 405614 T1566 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 405714 T1565 oasc.ZkTestServer.run start zk server on port:46183
[junit4] 2> 405715 T1565 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 405761 T1572 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@218036e1 name:ZooKeeperConnection Watcher:127.0.0.1:46183 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 405761 T1565 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 405762 T1565 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 405766 T1565 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 405767 T1574 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b8d5e81 name:ZooKeeperConnection Watcher:127.0.0.1:46183/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 405767 T1565 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 405768 T1565 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 405772 T1565 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 405774 T1565 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 405777 T1565 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 405779 T1565 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 405780 T1565 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 405784 T1565 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 405785 T1565 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 405787 T1565 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 405788 T1565 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 405790 T1565 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 405790 T1565 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 405793 T1565 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 405794 T1565 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 405796 T1565 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 405796 T1565 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 405798 T1565 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 405799 T1565 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 405801 T1565 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 405801 T1565 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 405803 T1565 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 405804 T1565 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 405806 T1565 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 405806 T1565 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 405894 T1565 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 405912 T1565 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:37181
[junit4] 2> 405913 T1565 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 405913 T1565 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 405913 T1565 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1376886638678
[junit4] 2> 405914 T1565 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1376886638678/'
[junit4] 2> 405924 T1565 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1376886638678/solr.xml
[junit4] 2> 405982 T1565 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 405983 T1565 oasc.CoreContainer.<init> New CoreContainer 674801413
[junit4] 2> 405984 T1565 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1376886638678/]
[junit4] 2> 405985 T1565 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4] 2> 405985 T1565 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 405986 T1565 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 405986 T1565 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 405986 T1565 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 405987 T1565 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 405987 T1565 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 405987 T1565 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 405988 T1565 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 405988 T1565 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4] 2> 405992 T1565 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:46183/solr
[junit4] 2> 405993 T1565 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 405993 T1565 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 405995 T1585 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b3423d0 name:ZooKeeperConnection Watcher:127.0.0.1:46183 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 405995 T1565 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 405996 T1565 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4] 2> 405999 T1565 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 406000 T1587 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@464b387 name:ZooKeeperConnection Watcher:127.0.0.1:46183/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 406000 T1565 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 406001 T1565 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 406003 T1565 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 406005 T1565 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 406006 T1565 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37181_
[junit4] 2> 406006 T1565 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:37181_
[junit4] 2> 406008 T1565 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 406011 T1565 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 406012 T1565 oasc.Overseer.start Overseer (id=90235642739818499-127.0.0.1:37181_-n_0000000000) starting
[junit4] 2> 406015 T1565 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 406017 T1589 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 406017 T1565 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 406019 T1565 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 406020 T1565 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 406021 T1588 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 406024 T1565 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1376886638678
[junit4] 2> 406057 T1565 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-controljetty-1376886638678/conf/
[junit4] 2> 406058 T1565 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 406058 T1565 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4] 2> 406058 T1565 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 406059 T1565 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 406062 T1565 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4] 2> 406063 T1565 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 406064 T1592 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4b3402fc name:ZooKeeperConnection Watcher:127.0.0.1:46183/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 406064 T1565 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 406065 T1565 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 406066 T1565 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4] 2> 406131 T1565 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 406133 T1565 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:49259
[junit4] 2> 406134 T1565 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 406134 T1565 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 406134 T1565 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1376886638936
[junit4] 2> 406135 T1565 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1376886638936/'
[junit4] 2> 406145 T1565 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1376886638936/solr.xml
[junit4] 2> 406178 T1565 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 406179 T1565 oasc.CoreContainer.<init> New CoreContainer 516079868
[junit4] 2> 406179 T1565 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1376886638936/]
[junit4] 2> 406181 T1565 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4] 2> 406181 T1565 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 406182 T1565 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 406182 T1565 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 406183 T1565 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 406183 T1565 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 406183 T1565 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 406184 T1565 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 406184 T1565 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 406185 T1565 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4] 2> 406188 T1565 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:46183/solr
[junit4] 2> 406189 T1565 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 406190 T1565 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 406191 T1603 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@78211a52 name:ZooKeeperConnection Watcher:127.0.0.1:46183 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 406191 T1565 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 406192 T1565 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4] 2> 406197 T1565 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 406198 T1605 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e6631aa name:ZooKeeperConnection Watcher:127.0.0.1:46183/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 406198 T1565 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 406201 T1565 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 407203 T1565 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49259_
[junit4] 2> 407204 T1565 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49259_
[junit4] 2> 407206 T1592 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 407206 T1605 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 407206 T1587 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 407211 T1565 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1376886638936
[junit4] 2> 407247 T1565 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1376886638936/conf/
[junit4] 2> 407248 T1565 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 407248 T1565 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4] 2> 407249 T1565 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 407249 T1565 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 407323 T1565 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 407326 T1565 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:57401
[junit4] 2> 407326 T1565 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 407327 T1565 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 407327 T1565 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1376886640122
[junit4] 2> 407327 T1565 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1376886640122/'
[junit4] 2> 407337 T1565 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1376886640122/solr.xml
[junit4] 2> 407369 T1565 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 407369 T1565 oasc.CoreContainer.<init> New CoreContainer 2004554158
[junit4] 2> 407369 T1565 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1376886640122/]
[junit4] 2> 407370 T1565 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4] 2> 407371 T1565 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 407371 T1565 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 407371 T1565 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 407371 T1565 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 407372 T1565 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 407372 T1565 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 407372 T1565 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 407372 T1565 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 407373 T1565 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4] 2> 407376 T1565 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:46183/solr
[junit4] 2> 407376 T1565 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 407377 T1565 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 407379 T1617 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@34dca50c name:ZooKeeperConnection Watcher:127.0.0.1:46183 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 407379 T1565 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 407380 T1565 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4] 2> 407384 T1565 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 407385 T1619 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@744eeb3f name:ZooKeeperConnection Watcher:127.0.0.1:46183/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 407385 T1565 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 407387 T1565 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 408389 T1565 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:57401_
[junit4] 2> 408390 T1565 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:57401_
[junit4] 2> 408392 T1605 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 408392 T1592 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 408392 T1587 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 408392 T1619 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 408396 T1565 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1376886640122
[junit4] 2> 408427 T1565 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1376886640122/conf/
[junit4] 2> 408427 T1565 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 408428 T1565 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4] 2> 408428 T1565 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 408429 T1565 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 408540 T1565 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 408543 T1565 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:43842
[junit4] 2> 408544 T1565 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 408544 T1565 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 408545 T1565 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1376886641303
[junit4] 2> 408545 T1565 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1376886641303/'
[junit4] 2> 408557 T1565 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1376886641303/solr.xml
[junit4] 2> 408591 T1565 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 408591 T1565 oasc.CoreContainer.<init> New CoreContainer 222049002
[junit4] 2> 408591 T1565 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1376886641303/]
[junit4] 2> 408593 T1565 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4] 2> 408593 T1565 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 408593 T1565 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 408593 T1565 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 408594 T1565 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 408594 T1565 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 408594 T1565 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 408595 T1565 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 408595 T1565 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 408595 T1565 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4] 2> 408599 T1565 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:46183/solr
[junit4] 2> 408599 T1565 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 408600 T1565 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 408601 T1631 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@59828479 name:ZooKeeperConnection Watcher:127.0.0.1:46183 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 408601 T1565 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 408602 T1565 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4] 2> 408607 T1565 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 408608 T1633 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@51e043b2 name:ZooKeeperConnection Watcher:127.0.0.1:46183/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 408608 T1565 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 408611 T1565 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 409613 T1565 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43842_
[junit4] 2> 409614 T1565 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:43842_
[junit4] 2> 409617 T1605 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 409617 T1592 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 409617 T1587 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 409617 T1619 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 409617 T1633 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 409624 T1565 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1376886641303
[junit4] 2> 409647 T1565 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1376886641303/conf/
[junit4] 2> 409647 T1565 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 409648 T1565 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4] 2> 409648 T1565 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 409648 T1565 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 409716 T1565 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 409718 T1565 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:43446
[junit4] 2> 409719 T1565 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 409719 T1565 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 409720 T1565 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1376886642521
[junit4] 2> 409720 T1565 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1376886642521/'
[junit4] 2> 409730 T1565 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1376886642521/solr.xml
[junit4] 2> 409762 T1565 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 409762 T1565 oasc.CoreContainer.<init> New CoreContainer 654442890
[junit4] 2> 409762 T1565 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1376886642521/]
[junit4] 2> 409763 T1565 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4] 2> 409764 T1565 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 409764 T1565 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 409764 T1565 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 409765 T1565 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 409765 T1565 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 409765 T1565 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 409765 T1565 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 409766 T1565 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 409766 T1565 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4] 2> 409769 T1565 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:46183/solr
[junit4] 2> 409769 T1565 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 409770 T1565 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 409771 T1645 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@60db80ac name:ZooKeeperConnection Watcher:127.0.0.1:46183 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 409772 T1565 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 409772 T1565 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4] 2> 409775 T1565 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 409776 T1647 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@76a7a693 name:ZooKeeperConnection Watcher:127.0.0.1:46183/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 409777 T1565 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 409779 T1565 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 410783 T1565 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43446_
[junit4] 2> 410785 T1565 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:43446_
[junit4] 2> 410787 T1605 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 410787 T1619 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 410787 T1647 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 410787 T1633 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 410787 T1592 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 410787 T1587 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 410792 T1565 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1376886642521
[junit4] 2> 410824 T1565 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty4-1376886642521/conf/
[junit4] 2> 410825 T1565 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 410826 T1565 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
[junit4] 2> 410826 T1565 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 410826 T1565 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 410830 T1565 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 410834 T1599 oasc.ZkController.publish publishing core=unloadcollection1 state=down
[junit4] 2> 410835 T1599 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 412028 T1588 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 412029 T1588 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "numShards":"1",
[junit4] 2> "shard":null,
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"unloadcollection1",
[junit4] 2> "collection":"unloadcollection",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:49259_",
[junit4] 2> "base_url":"http://127.0.0.1:49259"}
[junit4] 2> 412029 T1588 oasc.Overseer$ClusterStateUpdater.createCollection Create collection unloadcollection with shards [shard1]
[junit4] 2> 412029 T1588 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 412032 T1605 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 412032 T1587 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 412032 T1633 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 412032 T1592 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 412032 T1647 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 412032 T1619 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 412835 T1599 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for unloadcollection1
[junit4] 2> 412837 T1599 oasc.CoreContainer.create Creating SolrCore 'unloadcollection1' using instanceDir: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1376886638936/unloadcollection1
[junit4] 2> 412837 T1599 oasc.ZkController.createCollectionZkNode Check for collection zkNode:unloadcollection
[junit4] 2> 412838 T1599 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:unloadcollection
[junit4] 2> 412838 T1599 oasc.ZkController.getConfName Looking for collection configName
[junit4] 2> 412839 T1599 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4] 2> 412839 T1599 oascc.SolrZkClient.makePath makePath: /collections/unloadcollection
[junit4] 2> 412841 T1599 oasc.ZkController.readConfigName Load collection config from:/collections/unloadcollection
[junit4] 2> 412842 T1599 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1376886638936/unloadcollection1/'
[junit4] 2> 412877 T1599 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
[junit4] 2> 412927 T1599 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 412928 T1599 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 412935 T1599 oass.IndexSchema.readSchema [null] Schema name=test
[junit4] 2> 413282 T1599 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 413283 T1599 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 413283 T1599 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 413289 T1599 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 413291 T1599 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 413302 T1599 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 413305 T1599 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 413307 T1599 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 413308 T1599 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 413308 T1599 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 413308 T1599 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 413309 T1599 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 413310 T1599 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 413310 T1599 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 413310 T1599 oasc.SolrCore.<init> [unloadcollection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.UnloadDistributedZkTest-jetty1-1376886638936/unloadcollection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1376886638484/1376886643702unloadcollection1_1n/
[junit4] 2> 413310 T1599 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@22f41c09
[junit4] 2> 413311 T1599 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1376886638484/1376886643702unloadcollection1_1n
[junit4] 2> 413311 T1599 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1376886638484/1376886643702unloadcollection1_1n/index/
[junit4] 2> 413312 T1599 oasc.SolrCore.initIndex WARN [unloadcollection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1376886638484/1376886643702unloadcollection1_1n/index' doesn't exist. Creating new index...
[junit4] 2> 413312 T1599 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1376886638484/1376886643702unloadcollection1_1n/index
[junit4] 2> 413312 T1599 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=35, maxMergeAtOnceExplicit=44, maxMergedSegmentMB=6.662109375, floorSegmentMB=0.9794921875, forceMergeDeletesPctAllowed=16.398459554896437, segmentsPerTier=13.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5123788444242491
[junit4] 2> 413313 T1599 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@615b7bb4 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@34e51c9e),segFN=segments_1,generation=1}
[junit4] 2> 413313 T1599 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 413316 T1599 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 413317 T1599 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 413317 T1599 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 413317 T1599 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 413317 T1599 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 413318 T1599 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 413318 T1599 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 413318 T1599 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 413319 T1599 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 413319 T1599 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 413320 T1599 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 413320 T1599 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 413320 T1599 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 413321 T1599 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 413321 T1599 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 413323 T1599 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 413326 T1599 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 413326 T1599 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 413327 T1599 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1869373202, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 413327 T1599 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@615b7bb4 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@34e51c9e),segFN=segments_1,generation=1}
[junit4] 2> 413328 T1599 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 413328 T1599 oass.SolrIndexSearcher.<init> Opening Searcher@5b6b4271 main
[junit4] 2> 413331 T1649 oasc.SolrCore.registerSearcher [unloadcollection1] Registered new searcher Searcher@5b6b4271 main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 413332 T1599 oasc.CoreContainer.registerCore registering core: unloadcollection1
[junit4] 2> 413332 T1599 oasc.ZkController.register Register replica - core:unloadcollection1 address:http://127.0.0.1:49259 collection:unloadcollection shard:shard1
[junit4] 2> 413332 T1599 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=15000&socketTimeout=30000&retry=false
[junit4] 2> 413335 T1599 oascc.SolrZkClient.makePath makePath: /collections/unloadcollection/leader_elect/shard1/election
[junit4] 2> 413342 T1599 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 413344 T1599 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 413344 T1599 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 413344 T1599 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:49259/unloadcollection1/
[junit4] 2> 413345 T1599 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 413345 T1599 oasc.SyncStrategy.syncToMe http://127.0.0.1:49259/unloadcollection1/ has no replicas
[junit4] 2> 413345 T1599 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:49259/unloadcollection1/ shard1
[junit4] 2> 413345 T1599 oascc.SolrZkClient.makePath makePath: /collections/unloadcollection/leaders/shard1
[junit4] 2> 413535 T1588 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 413542 T1647 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 413542 T1587 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 413542 T1633 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 413542 T1592 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 413542 T1605 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 413542 T1619 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 413550 T1599 oasc.ZkController.register We are http://127.0.0.1:49259/unloadcollection1/ and leader is http://127.0.0.1:49259/unloadcollection1/
[junit4] 2> 413550 T1599 oasc.ZkController.register No LogReplay needed for core=unloadcollection1 baseURL=http://127.0.0.1:49259
[junit4] 2> 413550 T1599 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 413551 T1599 oasc.ZkController.publish publishing core=unloadcollection1 state=active
[junit4] 2> 413552 T1599 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 413553 T1599 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=1&name=unloadcollection1&action=CREATE&collection=unloadcollection&dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1376886638484/1376886643702unloadcollection1_1n&wt=javabin&version=2} status=0 QTime=2720
[junit4] 2> 413553 T1565 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4] 2> 413554 T1565 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 413556 T1651 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7e6794c6 name:ZooKeeperConnection Watcher:127.0.0.1:46183/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 413556 T1565 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 413557 T1565 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 413559 T1565 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 413559 T1565 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 413563 T1613 oasc.ZkController.publish publishing core=unloadcollection2 state=down
[junit4] 2> 413563 T1613 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 413565 T1613 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 415046 T1588 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 415047 T1588 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "numShards":"1",
[junit4] 2> "shard":"shard1",
[junit4] 2> "roles":null,
[junit4] 2> "state":"active",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"unloadcollection1",
[junit4] 2> "collection":"unloadcollection",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:49259_",
[junit4] 2> "base_url":"http://127.0.0.1:49259"}
[junit4] 2> 415049 T1588 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node2",
[junit4] 2> "numShards":"2",
[junit4] 2> "shard":null,
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"unloadcollection2",
[junit4] 2> "collection":"unloadcollection",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:57401_",
[junit4] 2> "base_url":"http://127.0.0.1:57401"}
[junit4] 2> 415050 T1588 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4] 2> 415050 T1588 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 415053 T1619 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 415053 T1651 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 415053 T1587 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 415053 T1633 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 415053 T1605 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 415053 T1592 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 415053 T1647 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 415565 T1613 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for unloadcollection2
[junit4] 2> 415566 T1613 oasc.CoreContainer.create Creating SolrCore 'unloadcollection2' using instanceDir: ./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1376886640122/unloadcollection2
[junit4] 2> 415566 T1613 oasc.ZkController.createCollectionZkNode Check for collection zkNode:unloadcollection
[junit4] 2> 415567 T1613 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 415567 T1613 oasc.ZkController.readConfigName Load collection config from:/collections/unloadcollection
[junit4] 2> 415568 T1613 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1376886640122/unloadcollection2/'
[junit4] 2> 415601 T1613 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_45
[junit4] 2> 415640 T1613 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 415642 T1613 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 415648 T1613 oass.IndexSchema.readSchema [null] Schema name=test
[junit4] 2> 416025 T1613 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 416025 T1613 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 416026 T1613 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 416031 T1613 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 416033 T1613 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 416041 T1613 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 416044 T1613 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 416047 T1613 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 416048 T1613 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 416048 T1613 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 416049 T1613 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 416050 T1613 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 416050 T1613 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 416050 T1613 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 416050 T1613 oasc.SolrCore.<init> [unloadcollection2] Opening new SolrCore at ./org.apache.solr.cloud.UnloadDistributedZkTest-jetty2-1376886640122/unloadcollection2/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1376886638484/1376886646432unloadcollection1_2n/
[junit4] 2> 416051 T1613 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@22f41c09
[junit4] 2> 416052 T1613 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1376886638484/1376886646432unloadcollection1_2n
[junit4] 2> 416052 T1613 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1376886638484/1376886646432unloadcollection1_2n/index/
[junit4] 2> 416052 T1613 oasc.SolrCore.initIndex WARN [unloadcollection2] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1376886638484/1376886646432unloadcollection1_2n/index' doesn't exist. Creating new index...
[junit4] 2> 416053 T1613 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1376886638484/1376886646432unloadcollection1_2n/index
[junit4] 2> 416053 T1613 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=35, maxMergeAtOnceExplicit=44, maxMergedSegmentMB=6.662109375, floorSegmentMB=0.9794921875, forceMergeDeletesPctAllowed=16.398459554896437, segmentsPerTier=13.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5123788444242491
[junit4] 2> 416054 T1613 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3b2921bb lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@31e7f981),segFN=segments_1,generation=1}
[junit4] 2> 416054 T1613 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 416057 T1613 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 416057 T1613 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 416058 T1613 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 416058 T1613 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 416058 T1613 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 416058 T1613 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 416059 T1613 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 416059 T1613 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 416060 T1613 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 416060 T1613 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 416061 T1613 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 416061 T1613 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 416061 T1613 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 416062 T1613 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 416062 T1613 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 416063 T1613 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 416066 T1613 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 416066 T1613 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 416067 T1613 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1869373202, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 416068 T1613 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3b2921bb lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@31e7f981),segFN=segments_1,generation=1}
[junit4] 2> 416068 T1613 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 416068 T1613 oass.SolrIndexSearcher.<init> Opening Searcher@7727a0db main
[junit4] 2> 416071 T1652 oasc.SolrCore.registerSearcher [unloadcollection2] Registered new searcher Searcher@7727a0db main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 416073 T1613 oasc.CoreContainer.registerCore registering core: unloadcollection2
[junit4] 2> 416073 T1613 oasc.ZkController.register Register replica - core:unloadcollection2 address:http://127.0.0.1:57401 collection:unloadcollection shard:shard1
[junit4] 2> 416074 T1613 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=15000&socketTimeout=30000&retry=false
[junit4] 2> 416078 T1613 oasc.ZkController.register We are http://127.0.0.1:57401/unloadcollection2/ and leader is http://127.0.0.1:49259/unloadcollection1/
[junit4] 2> 416079 T1613 oasc.ZkController.register No LogReplay needed for core=unloadcollection2 baseURL=http://127.0.0.1:57401
[junit4] 2> 416079 T1613 oasc.ZkController.checkRecovery Core needs to recover:unloadcollection2
[junit4] 2> 416079 T1613 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4] 2> ASYNC NEW_CORE C365 name=unloadcollection2 org.apache.solr.core.SolrCore@4394dc1b url=http://127.0.0.1:57401/unloadcollection2 node=127.0.0.1:57401_ C365_STATE=coll:unloadcollection core:unloadcollection2 props:{state=down, core=unloadcollection2, node_name=127.0.0.1:57401_, base_url=http://127.0.0.1:57401}
[junit4] 2> 416080 T1653 C365 P57401 oasc.RecoveryStrategy.run Starting recovery process. core=unloadcollection2 recoveringAfterStartup=true
[junit4] 2> 416080 T1613 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 416080 T1653 C365 P57401 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4] 2> 416081 T1653 C365 P57401 oasc.ZkController.publish publishing core=unloadcollection2 state=recovering
[junit4] 2> 416081 T1613 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={name=unloadcollection2&action=CREATE&collection=unloadcollection&dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./solrtest-UnloadDistributedZkTest-1376886638484/1376886646432unloadcollection1_2n&wt=javabin&version=2} status=0 QTime=2518
[junit4] 2> 416081 T1653 C365 P57401 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 416082 T1653 C365 P57401 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 416082 T1565 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 416083 T1565 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: unloadcollection failOnTimeout:true timeout (sec):330
[junit4] 2> 416083 T1565 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 416086 T1598 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: core_node2, state: recovering, checkLive: true, onlyIfLeader: true
[junit4] 2> 416557 T1588 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 416557 T1588 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node2",
[junit4] 2> "numShards":"2",
[junit4] 2> "shard":"shard1",
[junit4] 2> "roles":null,
[junit4] 2> "state":"recovering",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"unloadcollection2",
[junit4] 2> "collection":"unloadcollection",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:57401_",
[junit4] 2> "base_url":"http://127.0.0.1:57401"}
[junit4] 2> 416560 T1605 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 416560 T1587 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 416560 T1651 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 416560 T1619 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 416560 T1633 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 416560 T1592 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 416560 T1647 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 417084 T1565 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 417086 T1598 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: core_node2, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4] 2> 417086 T1598 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=core_node2&state=recovering&nodeName=127.0.0.1:57401_&action=PREPRECOVERY&checkLive=true&core=unloadcollection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1000
[junit4] 2> 418086 T1565 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> C365_STATE=coll:unloadcollection core:unloadcollection2 props:{state=recovering, core=unloadcollection2, node_name=127.0.0.1:57401_, base_url=http://127.0.0.1:57401}
[junit4] 2> 419087 T1653 C365 P57401 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:49259/unloadcollection1/ core=unloadcollection2 - recoveringAfterStartup=true
[junit4] 2> 419088 T1565 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 419088 T1653 C365 P57401 oasu.PeerSync.sync PeerSync: core=unloadcollection2 url=http://127.0.0.1:57401 START replicas=[http://127.0.0.1:49259/unloadcollection1/] nUpdates=100
[junit4] 2> 419089 T1653 C365 P57401 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4] 2> 419090 T1653 C365 P57401 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=unloadcollection2
[junit4] 2> 419090 T1653 C365 P57401 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=unloadcollection2
[junit4] 2> 419090 T1653 C365 P57401 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=unloadcollection2
[junit4] 2> 419090 T1653 C365 P57401 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4] 2> 419091 T1653 C365 P57401 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:49259/unloadcollection1/. core=unloadcollection2
[junit4] 2> 419091 T1653 C365 P57401 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> ASYNC NEW_CORE C366 name=unloadcollection1 org.apache.solr.core.SolrCore@23b5df3a url=http://127.0.0.1:49259/unloadcollection1 node=127.0.0.1:49259_ C366_STATE=coll:unloadcollection core:unloadcollection1 props:{state=active, core=unloadcollection1, node_name=127.0.0.1:49259_, base_url=http://127.0.0.1:49259, leader=true}
[junit4] 2> 419101 T1600 C366 P49259 oasc.SolrCore.execute [unloadcollection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4] 2> 419106 T1601 C366 P49259 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 419106 T1601 C366 P49259 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4] 2> 419107 T1601 C366 P49259 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4] 2> 419107 T1601 C366 P49259 oasup.LogUpdateProcessor.finish [unloadcollection1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 2
[junit4] 2> 419109 T1653 C365 P57401 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 419109 T1653 C365 P57401 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4] 2> 419112 T1598 C366 P49259 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 419113 T1598 C366 P49259 oasc.SolrCore.execute [unloadcollection1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=2
[junit4] 2> 419114 T1653 C365 P57401 oasc.RecoveryStrategy.replay No replay needed. core=unloadcollection2
[junit4] 2> 419114 T1653 C365 P57401 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=unloadcollection2
[junit4] 2> 419114 T1653 C365 P57401 oasc.ZkController.publish publishing core=unloadcollection2 state=active
[junit4] 2> 419115 T1653 C365 P57401 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 419116 T1653 C365 P57401 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=unloadcollection2
[junit4] 2> 419565 T1588 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 419566 T1588 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node2",
[junit4] 2> "numShards":"2",
[junit4] 2> "shard":"shard1",
[junit4] 2> "roles":null,
[junit4] 2> "state":"active",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"unloadcollection2",
[junit4] 2> "collection":"unloadcollection",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:57401_",
[junit4] 2> "base_url":"http://127.0.0.1:57401"}
[junit4] 2> 419570 T1619 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 419570 T1651 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 419570 T1633 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 419570 T1587 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 419570 T1647 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 419570 T1592 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 419570 T1605 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 420090 T1565 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 420091 T1565 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: unloadcollection
[junit4] 2> 420091 T1565 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> C365_STATE=coll:unloadcollection core:unloadcollection2 props:{state=active, core=unloadcollection2, node_name=127.0.0.1:57401_, base_url=http://127.0.0.1:57401}
[junit4] 2> 420106 T1612 C365 P57401 oasup.LogUpdateProcessor.finish [unloadcollection2] webapp= path=/update params={distrib.from=http://127.0.0.1:49259/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[6 (1443770299020476416)]} 0 2
[junit4] 2> 420107 T1598 C366 P49259 oasup.LogUpdateProcessor.finish [unloadcollection1] webapp= path=/update params={wt=javabin&version=2} {add=[6 (1443770299020476416)]} 0 12
[junit4] 2> 420114 T1614 C365 P57401 oasup.LogUpdateProcessor.finish [unloadcollection2] webapp= path=/update params={distrib.from=http://127.0.0.1:49259/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[7 (1443770299034107904)]} 0 2
[junit4] 2> 420114 T1600 C366 P49259 oasup.LogUpdateProcessor.finish [unloadcollection1] webapp= path=/update params={wt=javabin&version=2} {add=[7 (1443770299034107904)]} 0 5
[junit4] 2> 420121 T1615 C365 P57401 oasup.LogUpdateProcessor.finish [unloadcollection2] webapp= path=/update params={distrib.from=http://127.0.0.1:49259/unloadcollection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[8 (1443770299042496512)]} 0 1
[junit4] 2> 420122 T1601 C366 P49259 oasup.LogUpdateProcessor.finish [unloadcollection1] webapp= path=/update params={wt=javabin&version=2} {add=[8 (1443770299042496512)]} 0 5
[junit4] 2> 420126 T1599 C366 P49259 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:49259/unloadcollection1/, StdNode: http://127.0.0.1:57401/unloadcollection2/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4] 2> 420139 T1613 C365 P57401 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 420140 T1600 C366 P49259 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 420144 T1600 C366 P49259 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@615b7bb4 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@34e51c9e),segFN=segments_1,generation=1}
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@615b7bb4 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@34e51c9e),segFN=segments_2,generation=2}
[junit4] 2> 420144 T1613 C365 P57401 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3b2921bb lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@31e7f981),segFN=segments_1,generation=1}
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3b2921bb lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@31e7f981),segFN=segments_2,generation=2}
[junit4] 2> 420145 T1613 C365 P57401 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4] 2> 420145 T1600 C366 P49259 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4] 2> 420147 T1613 C365 P57401 oass.SolrIndexSearcher.<init> Opening Searcher@2c70d93e main
[junit4] 2> 420147 T1600 C366 P49259 oass.SolrIndexSearcher.<init> Opening Searcher@6124d9ce main
[junit4] 2> 420148 T1613 C365 P57401 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4] 2> 420148 T1600 C366 P49259 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4] 2> 420149 T1652 oasc.SolrCore.registerSearcher [unloadcollection2] Registered new searcher Searcher@2c70d93e main{StandardDirectoryReader(segments_2:3:nrt _0(4.5):c3)}
[junit4] 2> 420149 T1649 oasc.SolrCore.registerSearcher [unloadcollection1] Registered new searcher Searcher@6124d9ce main{StandardDirectoryReader(segments_2:3:nrt _0(4.5):c3)}
[junit4] 2> 420150 T1613 C365 P57401 oasup.LogUpdateProcessor.finish [unloadcollection2] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 11
[junit4] 2> 420150 T1600 C366 P49259 oasup.LogUpdateProcessor.finish [unloadcollection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 10
[junit4] 2> 420151 T1599 C366 P49259 oasup.LogUpdateProcessor.finish [unloadcollection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 25
[junit4] 2> 420151 T1565 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 420155 T1628 oasc.ZkController.publish publishing core=unloadcollection3 state=down
[junit4] 2> 420156 T1628 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 420157 T1628 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 421073 T1588 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 421074 T1588 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node3",
[junit4] 2> "numShards":"2",
[junit4] 2> "shard":null,
[junit4] 2> "roles":null,
[junit4] 2> "state":"down",
[junit4] 2> "shard_state":"active",
[junit4] 2> "core":"unloadcollection3",
[junit4] 2> "collection":"unloadcollection",
[junit4] 2> "shard_range":null,
[junit4] 2> "node_name":"127.0.0.1:43842_",
[junit4] 2> "base_url":"http://127.0.0.1:43842"}
[junit4] 2> 421074 T1588 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4] 2> 421075 T1588 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 421077 T1647 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 421078 T1651 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 421078 T1633 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 421077 T1587 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 421078 T1592 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 421077 T1605 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 421077 T1619 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 421157 T1628 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for unloadcollection3
[junit4] 2> 421158 T1628 oasc.CoreContainer.create Creating SolrCore 'unloadcollection3' using instanceDir: ./org.apache.solr.cloud.UnloadDistributedZkTest-jetty3-1376886641303/unloadcollection3
[junit4] 2> 421159 T1628 oasc.ZkController.createCollectionZkNode Check for collection zkNode:unloadcollection
[junit4] 2> 421159 T1628 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 421159 T1628 oasc.ZkController.readConfigName Load collection config from:/collections/unloadcollection
[junit4] 2> 421161 T1628 oasc.Solr
[...truncated too long message...]
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:431)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
[junit4] > at org.apache.solr.cloud.UnloadDistributedZkTest$1.run(UnloadDistributedZkTest.java:397)
[junit4] > ... 3 more
[junit4] > Caused by: java.net.SocketTimeoutException: Read timed out
[junit4] > at java.net.SocketInputStream.socketRead0(Native Method)
[junit4] > at java.net.SocketInputStream.read(SocketInputStream.java:150)
[junit4] > at java.net.SocketInputStream.read(SocketInputStream.java:121)
[junit4] > at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:166)
[junit4] > at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:90)
[junit4] > at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:281)
[junit4] > at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:92)
[junit4] > at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:62)
[junit4] > at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:254)
[junit4] > at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:289)
[junit4] > at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:252)
[junit4] > at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:191)
[junit4] > at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:300)
[junit4] > at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:127)
[junit4] > at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:717)
[junit4] > at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:522)
[junit4] > at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:906)
[junit4] > at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:805)
[junit4] > at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:784)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:365)
[junit4] > ... 5 moreThrowable #4: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=1756, name=testExecutor-1168-thread-6, state=RUNNABLE, group=TGRP-UnloadDistributedZkTest]
[junit4] > Caused by: java.lang.RuntimeException: org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:43842
[junit4] > at __randomizedtesting.SeedInfo.seed([45A42261C6B4F179]:0)
[junit4] > at org.apache.solr.cloud.UnloadDistributedZkTest$1.run(UnloadDistributedZkTest.java:399)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] > at java.lang.Thread.run(Thread.java:724)
[junit4] > Caused by: org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:43842
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:431)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
[junit4] > at org.apache.solr.cloud.UnloadDistributedZkTest$1.run(UnloadDistributedZkTest.java:397)
[junit4] > ... 3 more
[junit4] > Caused by: java.net.SocketTimeoutException: Read timed out
[junit4] > at java.net.SocketInputStream.socketRead0(Native Method)
[junit4] > at java.net.SocketInputStream.read(SocketInputStream.java:150)
[junit4] > at java.net.SocketInputStream.read(SocketInputStream.java:121)
[junit4] > at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:166)
[junit4] > at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:90)
[junit4] > at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:281)
[junit4] > at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:92)
[junit4] > at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:62)
[junit4] > at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:254)
[junit4] > at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:289)
[junit4] > at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:252)
[junit4] > at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:191)
[junit4] > at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:300)
[junit4] > at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:127)
[junit4] > at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:717)
[junit4] > at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:522)
[junit4] > at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:906)
[junit4] > at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:805)
[junit4] > at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:784)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:365)
[junit4] > ... 5 more
[junit4] 2> 550910 T1565 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> 145340 T1564 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 3 leaked thread(s).
[junit4] 2> 551461 T1647 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 551461 T1647 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4] 2> 551462 T1647 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> NOTE: test params are: codec=Lucene41, sim=DefaultSimilarity, locale=pl, timezone=Europe/Zaporozhye
[junit4] 2> NOTE: Linux 3.2.0-51-generic amd64/Oracle Corporation 1.7.0_25 (64-bit)/cpus=8,threads=1,free=432044360,total=536870912
[junit4] 2> NOTE: All tests run in this JVM: [TestSolrQueryParserDefaultOperatorResource, SampleTest, ParsingFieldUpdateProcessorsTest, TestUniqueKeyFieldResource, SolrCoreTest, IndexSchemaTest, HdfsDirectoryTest, SolrInfoMBeanTest, BinaryUpdateRequestHandlerTest, TestRealTimeGet, StatelessScriptUpdateProcessorFactoryTest, TestBadConfig, SynonymTokenizerTest, TestJmxMonitoredMap, TestDocumentBuilder, SOLR749Test, TestImplicitCoreProperties, TestFaceting, JsonLoaderTest, RegexBoostProcessorTest, TestGroupingSearch, TestPerFieldSimilarity, BlockDirectoryTest, CSVRequestHandlerTest, TestElisionMultitermQuery, BasicFunctionalityTest, AnalysisAfterCoreReloadTest, EchoParamsTest, LukeRequestHandlerTest, TestAddFieldRealTimeGet, TestMaxScoreQueryParser, BadComponentTest, MBeansHandlerTest, CircularListTest, SearchHandlerTest, TestSolrIndexConfig, TestSurroundQueryParser, SliceStateUpdateTest, FieldMutatingUpdateProcessorTest, ZkControllerTest, DeleteShardTest, OverseerCollectionProcessorTest, SchemaVersionSpecificBehaviorTest, DOMUtilTest, SuggesterFSTTest, QueryParsingTest, TestPseudoReturnFields, SuggesterTest, UUIDFieldTest, PrimitiveFieldTypeTest, PeerSyncTest, TestCoreContainer, TestWriterPerf, AutoCommitTest, SolrTestCaseJ4Test, TermsComponentTest, BasicDistributedZkTest, OverseerTest, TestReversedWildcardFilterFactory, TestPostingsSolrHighlighter, HdfsBasicDistributedZk2Test, TestConfig, DistributedSpellCheckComponentTest, TestSuggestSpellingConverter, TestMergePolicyConfig, SoftAutoCommitTest, UnloadDistributedZkTest]
[junit4] Completed on J0 in 146.12s, 1 test, 1 error <<< FAILURES!
[...truncated 540 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:395: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:375: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:181: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:450: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1233: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:876: There were test failures: 323 suites, 1376 tests, 1 error, 34 ignored (6 assumptions)
Total time: 45 minutes 13 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0_25 -XX:-UseCompressedOops -XX:+UseG1GC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure