You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/02/15 06:59:13 UTC
[JENKINS] Lucene-Solr-trunk-Windows (32bit/jdk1.8.0-fcs-b129) -
Build # 3781 - Still Failing!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Windows/3781/
Java: 32bit/jdk1.8.0-fcs-b129 -client -XX:+UseSerialGC
2 tests failed.
REGRESSION: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.testDistribSearch
Error Message:
Test abandoned because suite timeout was reached.
Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
at __randomizedtesting.SeedInfo.seed([187849E2C3279F5B]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
Error Message:
Suite timeout exceeded (>= 7200000 msec).
Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
at __randomizedtesting.SeedInfo.seed([187849E2C3279F5B]:0)
Build Log:
[...truncated 10535 lines...]
[junit4] Suite: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
[junit4] 2> 1436345 T6131 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (true)
[junit4] 2> 1436346 T6131 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4] 2> 1436351 T6131 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-ChaosMonkeySafeLeaderTest-1392435779346
[junit4] 2> 1436354 T6131 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 1436355 T6132 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 1436455 T6131 oasc.ZkTestServer.run start zk server on port:55892
[junit4] 2> 1436459 T6131 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1436467 T6138 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1363296 name:ZooKeeperConnection Watcher:127.0.0.1:55892 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1436468 T6131 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1436469 T6131 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 1436477 T6133 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14433a3d7200000, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 1436479 T6131 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1436483 T6140 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@18f829e name:ZooKeeperConnection Watcher:127.0.0.1:55892/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1436484 T6131 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1436484 T6131 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 1436490 T6131 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 1436494 T6131 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 1436498 T6131 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 1436502 T6131 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1436502 T6131 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 1436509 T6131 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 1436509 T6131 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 1436516 T6131 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1436516 T6131 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1436521 T6131 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1436521 T6131 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 1436526 T6131 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1436526 T6131 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 1436531 T6131 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1436531 T6131 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 1436537 T6131 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 1436537 T6131 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 1436543 T6131 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1436543 T6131 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 1436550 T6131 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1436550 T6131 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1436558 T6131 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1436558 T6131 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 1436564 T6131 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1436565 T6131 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 1436574 T6133 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14433a3d7200001, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 1436577 T6131 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1436581 T6142 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@33740 name:ZooKeeperConnection Watcher:127.0.0.1:55892/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1436581 T6131 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1437128 T6131 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1437141 T6131 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 1437145 T6131 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:55902
[junit4] 2> 1437149 T6131 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1437150 T6131 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1437150 T6131 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1392435779578
[junit4] 2> 1437150 T6131 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1392435779578\'
[junit4] 2> 1437187 T6131 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1392435779578\solr.xml
[junit4] 2> 1437202 T6131 oasc.CoreContainer.<init> New CoreContainer 7529129
[junit4] 2> 1437202 T6131 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1392435779578\]
[junit4] 2> 1437203 T6131 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1437203 T6131 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1437203 T6131 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1437203 T6131 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1437203 T6131 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1437203 T6131 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1437203 T6131 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1437203 T6131 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1437203 T6131 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1437215 T6131 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1437216 T6131 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1437216 T6131 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1437216 T6131 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55892/solr
[junit4] 2> 1437216 T6131 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1437220 T6131 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1437228 T6153 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ea46d6 name:ZooKeeperConnection Watcher:127.0.0.1:55892 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1437229 T6131 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1437235 T6131 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1437240 T6155 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@325533 name:ZooKeeperConnection Watcher:127.0.0.1:55892/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1437240 T6131 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1437242 T6131 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 1437249 T6131 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 1437257 T6131 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 1437261 T6131 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55902_
[junit4] 2> 1437263 T6131 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55902_
[junit4] 2> 1437269 T6131 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 1437275 T6131 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 1437283 T6131 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:55902_
[junit4] 2> 1437283 T6131 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 1437288 T6131 oasc.Overseer.start Overseer (id=91254671236136964-127.0.0.1:55902_-n_0000000000) starting
[junit4] 2> 1437299 T6131 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 1437308 T6157 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 1437309 T6131 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 1437310 T6157 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
[junit4] 2> 1437315 T6131 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 1437319 T6131 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1437323 T6156 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 1437330 T6158 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 1437330 T6158 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1437332 T6158 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1437332 T6155 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1437335 T6156 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1437337 T6156 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:55902",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:55902_",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1437337 T6156 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 1437337 T6156 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 1437342 T6155 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1437344 T6155 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1438332 T6158 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1438332 T6158 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1392435779578\collection1
[junit4] 2> 1438332 T6158 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 1438334 T6158 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1438334 T6158 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 1438336 T6158 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1438336 T6158 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1392435779578\collection1\'
[junit4] 2> 1438339 T6158 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1392435779578/collection1/lib/classes/' to classloader
[junit4] 2> 1438339 T6158 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1392435779578/collection1/lib/README' to classloader
[junit4] 2> 1438374 T6158 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 1438385 T6158 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1438389 T6158 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1438394 T6158 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1438539 T6158 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1438543 T6158 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1438543 T6158 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1438548 T6158 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1438593 T6158 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 1438630 T6158 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1392435779578\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392435779344/control/data\
[junit4] 2> 1438630 T6158 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@9dab08
[junit4] 2> 1438632 T6158 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392435779344\control\data
[junit4] 2> 1438633 T6158 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392435779344/control/data\index/
[junit4] 2> 1438634 T6158 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392435779344\control\data\index' doesn't exist. Creating new index...
[junit4] 2> 1438634 T6158 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392435779344\control\data\index
[junit4] 2> 1438635 T6158 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=833381015, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 1438641 T6158 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392435779344\control\data\index,segFN=segments_1,generation=1}
[junit4] 2> 1438641 T6158 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1438644 T6158 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1438645 T6158 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1438645 T6158 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1438645 T6158 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1438646 T6158 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1438646 T6158 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1438647 T6158 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1438647 T6158 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1438647 T6158 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1438649 T6158 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1438649 T6158 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 1438649 T6158 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 1438649 T6158 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 1438651 T6158 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 1438651 T6158 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 1438652 T6158 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 1438652 T6158 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 1438659 T6158 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1438663 T6158 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1438663 T6158 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1438664 T6158 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=42, maxMergeAtOnceExplicit=50, maxMergedSegmentMB=43.95703125, floorSegmentMB=0.6923828125, forceMergeDeletesPctAllowed=27.981192404696003, segmentsPerTier=41.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 1438665 T6158 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392435779344\control\data\index,segFN=segments_1,generation=1}
[junit4] 2> 1438665 T6158 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1438665 T6158 oass.SolrIndexSearcher.<init> Opening Searcher@ab4125[collection1] main
[junit4] 2> 1438671 T6159 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@ab4125[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 1438673 T6158 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1438676 T6131 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
[junit4] 2> 1438676 T6162 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:55902 collection:control_collection shard:shard1
[junit4] 2> 1438676 T6131 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1438678 T6162 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 1438693 T6131 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1438699 T6164 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@995c35 name:ZooKeeperConnection Watcher:127.0.0.1:55892/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1438700 T6131 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1438701 T6162 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 1438703 T6131 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1438706 T6155 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1438707 T6162 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 1438707 T6162 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C3106 name=collection1 org.apache.solr.core.SolrCore@4d8e75 url=https://127.0.0.1:55902/collection1 node=127.0.0.1:55902_ C3106_STATE=coll:control_collection core:collection1 props:{state=down, base_url=https://127.0.0.1:55902, core=collection1, node_name=127.0.0.1:55902_}
[junit4] 2> 1438707 T6162 C3106 P55902 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:55902/collection1/
[junit4] 2> 1438707 T6162 C3106 P55902 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 1438708 T6162 C3106 P55902 oasc.SyncStrategy.syncToMe https://127.0.0.1:55902/collection1/ has no replicas
[junit4] 2> 1438708 T6162 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:55902/collection1/ shard1
[junit4] 2> 1438708 T6162 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 1438708 T6131 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 1438711 T6156 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1438722 T6155 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1438726 T6155 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1438734 T6155 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1438840 T6155 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1438840 T6164 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1438881 T6162 oasc.ZkController.register We are https://127.0.0.1:55902/collection1/ and leader is https://127.0.0.1:55902/collection1/
[junit4] 2> 1438881 T6162 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:55902
[junit4] 2> 1438881 T6162 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 1438881 T6162 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 1438881 T6162 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1438885 T6155 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1438885 T6155 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1438885 T6155 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1438887 T6162 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1438891 T6156 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1438892 T6156 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:55902",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:55902_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 1438898 T6155 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1439004 T6164 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1439005 T6155 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1439267 T6131 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 1439268 T6131 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1439280 T6131 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 1439282 T6131 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:55914
[junit4] 2> 1439287 T6131 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1439288 T6131 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1439288 T6131 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1392435781702
[junit4] 2> 1439289 T6131 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1392435781702\'
[junit4] 2> 1439321 T6131 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1392435781702\solr.xml
[junit4] 2> 1439351 T6131 oasc.CoreContainer.<init> New CoreContainer 32451498
[junit4] 2> 1439352 T6131 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1392435781702\]
[junit4] 2> 1439352 T6131 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1439353 T6131 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1439353 T6131 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1439354 T6131 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1439354 T6131 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1439354 T6131 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1439355 T6131 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1439355 T6131 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1439356 T6131 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1439370 T6131 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1439370 T6131 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1439371 T6131 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1439371 T6131 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55892/solr
[junit4] 2> 1439372 T6131 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1439373 T6131 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1439381 T6175 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@197e12c name:ZooKeeperConnection Watcher:127.0.0.1:55892 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1439381 T6131 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1439390 T6133 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14433a3d7200006, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 1439392 T6131 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1439396 T6177 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ad3a6c name:ZooKeeperConnection Watcher:127.0.0.1:55892/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1439397 T6131 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1439407 T6131 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1440412 T6131 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55914_
[junit4] 2> 1440415 T6131 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55914_
[junit4] 2> 1440422 T6155 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 1440422 T6164 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 1440423 T6177 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 1440433 T6178 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 1440433 T6178 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1440437 T6155 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1440437 T6155 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1440437 T6155 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1440437 T6178 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1440440 T6156 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1440441 T6156 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:55914",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:55914_",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1440441 T6156 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3]
[junit4] 2> 1440441 T6156 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 1440449 T6155 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1440554 T6177 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1440554 T6155 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1440554 T6164 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1441425 T6178 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1441426 T6178 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: .\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1392435781702\collection1
[junit4] 2> 1441426 T6178 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 1441427 T6178 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1441427 T6178 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1441430 T6178 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1441430 T6178 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1392435781702\collection1\'
[junit4] 2> 1441432 T6178 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1392435781702/collection1/lib/classes/' to classloader
[junit4] 2> 1441432 T6178 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1392435781702/collection1/lib/README' to classloader
[junit4] 2> 1441463 T6178 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 1441472 T6178 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1441476 T6178 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1441481 T6178 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1441609 T6178 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1441611 T6178 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1441613 T6178 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1441617 T6178 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1441651 T6178 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 1441651 T6178 oasc.SolrCore.<init> [collection1] Opening new SolrCore at .\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1392435781702\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392435779344/jetty1\
[junit4] 2> 1441652 T6178 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@9dab08
[junit4] 2> 1441653 T6178 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392435779344\jetty1
[junit4] 2> 1441654 T6178 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392435779344/jetty1\index/
[junit4] 2> 1441655 T6178 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392435779344\jetty1\index' doesn't exist. Creating new index...
[junit4] 2> 1441656 T6178 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392435779344\jetty1\index
[junit4] 2> 1441657 T6178 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=833381015, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 1441661 T6178 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392435779344\jetty1\index,segFN=segments_1,generation=1}
[junit4] 2> 1441662 T6178 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1441665 T6178 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1441665 T6178 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1441666 T6178 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1441666 T6178 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1441666 T6178 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1441666 T6178 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1441667 T6178 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1441667 T6178 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1441668 T6178 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1441668 T6178 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1441669 T6178 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 1441669 T6178 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 1441670 T6178 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 1441671 T6178 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 1441671 T6178 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 1441671 T6178 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 1441672 T6178 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 1441678 T6178 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1441681 T6178 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1441681 T6178 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1441682 T6178 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=42, maxMergeAtOnceExplicit=50, maxMergedSegmentMB=43.95703125, floorSegmentMB=0.6923828125, forceMergeDeletesPctAllowed=27.981192404696003, segmentsPerTier=41.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 1441684 T6178 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392435779344\jetty1\index,segFN=segments_1,generation=1}
[junit4] 2> 1441684 T6178 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1441685 T6178 oass.SolrIndexSearcher.<init> Opening Searcher@cd6884[collection1] main
[junit4] 2> 1441689 T6179 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@cd6884[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 1441693 T6178 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1441695 T6131 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
[junit4] 2> 1441695 T6131 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1441695 T6182 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:55914 collection:collection1 shard:shard2
[junit4] 2> 1441698 T6182 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 1441718 T6182 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 1441723 T6155 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1441723 T6155 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1441724 T6155 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1441725 T6182 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 1441725 T6182 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C3107 name=collection1 org.apache.solr.core.SolrCore@13d0b2 url=https://127.0.0.1:55914/collection1 node=127.0.0.1:55914_ C3107_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:55914, core=collection1, node_name=127.0.0.1:55914_}
[junit4] 2> 1441725 T6182 C3107 P55914 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:55914/collection1/
[junit4] 2> 1441727 T6182 C3107 P55914 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 1441727 T6182 C3107 P55914 oasc.SyncStrategy.syncToMe https://127.0.0.1:55914/collection1/ has no replicas
[junit4] 2> 1441727 T6182 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:55914/collection1/ shard2
[junit4] 2> 1441727 T6182 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 1441732 T6156 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1441744 T6155 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1441750 T6155 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1441762 T6155 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1441858 T6177 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1441859 T6164 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1441859 T6155 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1441888 T6182 oasc.ZkController.register We are https://127.0.0.1:55914/collection1/ and leader is https://127.0.0.1:55914/collection1/
[junit4] 2> 1441888 T6182 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:55914
[junit4] 2> 1441888 T6182 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 1441888 T6182 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 1441889 T6182 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1441895 T6155 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1441896 T6155 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1441896 T6155 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1441896 T6182 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1441901 T6156 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1441903 T6156 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:55914",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:55914_",
[junit4] 2> "shard":"shard2",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 1441910 T6155 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1442005 T6164 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1442005 T6155 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1442007 T6177 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1442337 T6131 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 1442337 T6131 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1442352 T6131 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 1442353 T6131 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:55923
[junit4] 2> 1442360 T6131 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1442361 T6131 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1442362 T6131 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1392435784693
[junit4] 2> 1442362 T6131 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1392435784693\'
[junit4] 2> 1442409 T6131 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1392435784693\solr.xml
[junit4] 2> 1442428 T6131 oasc.CoreContainer.<init> New CoreContainer 15406119
[junit4] 2> 1442429 T6131 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1392435784693\]
[junit4] 2> 1442430 T6131 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1442430 T6131 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1442431 T6131 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1442431 T6131 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1442431 T6131 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1442432 T6131 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1442432 T6131 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1442433 T6131 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1442433 T6131 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1442448 T6131 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1442450 T6131 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1442450 T6131 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1442450 T6131 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55892/solr
[junit4] 2> 1442450 T6131 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1442454 T6131 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1442462 T6193 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a1bf90 name:ZooKeeperConnection Watcher:127.0.0.1:55892 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1442462 T6131 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1442471 T6131 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1442474 T6195 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@15e101b name:ZooKeeperConnection Watcher:127.0.0.1:55892/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1442475 T6131 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1442489 T6131 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1443394 T6131 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55923_
[junit4] 2> 1443397 T6131 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55923_
[junit4] 2> 1443404 T6177 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1443406 T6155 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1443406 T6164 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1443407 T6195 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1443417 T6196 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 1443417 T6196 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1443419 T6155 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1443420 T6155 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1443420 T6155 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1443419 T6196 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1443423 T6156 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1443423 T6156 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:55923",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:55923_",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1443423 T6156 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 1443423 T6156 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
[junit4] 2> 1443430 T6155 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1443524 T6177 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1443524 T6155 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1443524 T6164 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1443524 T6195 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1444320 T6196 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1444320 T6196 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: .\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1392435784693\collection1
[junit4] 2> 1444320 T6196 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 1444323 T6196 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1444323 T6196 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1444327 T6196 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1444327 T6196 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1392435784693\collection1\'
[junit4] 2> 1444329 T6196 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1392435784693/collection1/lib/classes/' to classloader
[junit4] 2> 1444331 T6196 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1392435784693/collection1/lib/README' to classloader
[junit4] 2> 1444364 T6196 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 1444393 T6196 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1444397 T6196 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1444405 T6196 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1444541 T6196 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1444543 T6196 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1444544 T6196 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1444548 T6196 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1444595 T6196 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 1444595 T6196 oasc.SolrCore.<init> [collection1] Opening new SolrCore at .\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1392435784693\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392435779344/jetty2\
[junit4] 2> 1444596 T6196 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@9dab08
[junit4] 2> 1444596 T6196 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392435779344\jetty2
[junit4] 2> 1444598 T6196 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392435779344/jetty2\index/
[junit4] 2> 1444598 T6196 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392435779344\jetty2\index' doesn't exist. Creating new index...
[junit4] 2> 1444600 T6196 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392435779344\jetty2\index
[junit4] 2> 1444601 T6196 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=833381015, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 1444608 T6196 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392435779344\jetty2\index,segFN=segments_1,generation=1}
[junit4] 2> 1444608 T6196 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1444614 T6196 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1444614 T6196 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1444615 T6196 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1444615 T6196 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1444615 T6196 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1444616 T6196 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1444617 T6196 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1444617 T6196 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1444617 T6196 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1444617 T6196 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1444618 T6196 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 1444618 T6196 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 1444618 T6196 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 1444620 T6196 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 1444620 T6196 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 1444621 T6196 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 1444622 T6196 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 1444625 T6196 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1444629 T6196 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1444629 T6196 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1444630 T6196 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=42, maxMergeAtOnceExplicit=50, maxMergedSegmentMB=43.95703125, floorSegmentMB=0.6923828125, forceMergeDeletesPctAllowed=27.981192404696003, segmentsPerTier=41.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 1444631 T6196 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392435779344\jetty2\index,segFN=segments_1,generation=1}
[junit4] 2> 1444631 T6196 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1444631 T6196 oass.SolrIndexSearcher.<init> Opening Searcher@eec772[collection1] main
[junit4] 2> 1444638 T6197 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@eec772[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 1444640 T6196 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1444643 T6131 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
[junit4] 2> 1444643 T6131 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1444643 T6200 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:55923 collection:collection1 shard:shard3
[junit4] 2> 1444646 T6200 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election
[junit4] 2> 1444657 T6200 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard3
[junit4] 2> 1444661 T6155 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1444661 T6155 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1444661 T6155 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1444664 T6200 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 1444664 T6200 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C3108 name=collection1 org.apache.solr.core.SolrCore@8e87b3 url=https://127.0.0.1:55923/collection1 node=127.0.0.1:55923_ C3108_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:55923, core=collection1, node_name=127.0.0.1:55923_}
[junit4] 2> 1444664 T6200 C3108 P55923 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:55923/collection1/
[junit4] 2> 1444664 T6200 C3108 P55923 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 1444664 T6200 C3108 P55923 oasc.SyncStrategy.syncToMe https://127.0.0.1:55923/collection1/ has no replicas
[junit4] 2> 1444666 T6200 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:55923/collection1/ shard3
[junit4] 2> 1444666 T6200 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard3
[junit4] 2> 1444669 T6156 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1444678 T6155 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1444682 T6155 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1444690 T6155 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1444785 T6177 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1444787 T6195 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1444788 T6164 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1444789 T6155 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1444822 T6200 oasc.ZkController.register We are https://127.0.0.1:55923/collection1/ and leader is https://127.0.0.1:55923/collection1/
[junit4] 2> 1444822 T6200 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:55923
[junit4] 2> 1444822 T6200 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 1444822 T6200 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 1444823 T6200 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1444826 T6155 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1444827 T6155 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1444827 T6155 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1444833 T6200 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1444834 T6156 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1444835 T6156 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:55923",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:55923_",
[junit4] 2> "shard":"shard3",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":"core_node2"}
[junit4] 2> 1444844 T6155 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1444947 T6177 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1444948 T6195 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1444948 T6164 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1444949 T6155 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1445183 T6131 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 1445184 T6131 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1445195 T6131 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 1445196 T6131 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:55933
[junit4] 2> 1445200 T6131 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1445200 T6131 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1445200 T6131 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1392435787641
[junit4] 2> 1445200 T6131 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1392435787641\'
[junit4] 2> 1445232 T6131 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1392435787641\solr.xml
[junit4] 2> 1445246 T6131 oasc.CoreContainer.<init> New CoreContainer 9024127
[junit4] 2> 1445246 T6131 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1392435787641\]
[junit4] 2> 1445248 T6131 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1445248 T6131 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1445248 T6131 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1445248 T6131 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1445248 T6131 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1445248 T6131 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1445248 T6131 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1445248 T6131 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1445251 T6131 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1445261 T6131 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1445261 T6131 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1445261 T6131 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1445261 T6131 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55892/solr
[junit4] 2> 1445261 T6131 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1445264 T6131 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1445269 T6211 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@18cd5d4 name:ZooKeeperConnection Watcher:127.0.0.1:55892 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1445270 T6131 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1445276 T6131 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1445280 T6213 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1114271 name:ZooKeeperConnection Watcher:127.0.0.1:55892/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1445281 T6131 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1445291 T6131 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1446196 T6131 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55933_
[junit4] 2> 1446200 T6131 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55933_
[junit4] 2> 1446205 T6177 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1446205 T6195 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1446207 T6213 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1446207 T6155 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1446208 T6164 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1446217 T6214 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 1446218 T6214 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1446220 T6155 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1446220 T6155 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1446221 T6155 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1446220 T6214 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1446223 T6156 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1446224 T6156 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:55933",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:55933_",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1446224 T6156 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 1446224 T6156 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 1446231 T6155 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1446327 T6195 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 1446328 T6164 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 1446328 T6155 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 1446329 T6177 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 1446329 T6213 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 1447121 T6214 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1447121 T6214 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1392435787641\collection1
[junit4] 2> 1447121 T6214 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 1447122 T6214 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1447122 T6214 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1447124 T6214 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1447124 T6214 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1392435787641\collection1\'
[junit4] 2> 1447126 T6214 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1392435787641/collection1/lib/classes/' to classloader
[junit4] 2> 1447126 T6214 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1392435787641/collection1/lib/README' to classloader
[junit4] 2> 1447162 T6214 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 1447171 T6214 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1447175 T6214 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1447179 T6214 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1447312 T6214 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1447314 T6214 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1447314 T6214 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1447323 T6214 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1447360 T6214 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 1447360 T6214 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1392435787641\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392435779344/jetty3\
[junit4] 2> 1447360 T6214 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@9dab08
[junit4] 2> 1447363 T6214 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392435779344\jetty3
[junit4] 2> 1447363 T6214 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392435779344/jetty3\index/
[junit4] 2> 1447365 T6214 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392435779344\jetty3\index' doesn't exist. Creating new index...
[junit4] 2> 1447366 T6214 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392435779344\jetty3\index
[junit4] 2> 1447367 T6214 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=833381015, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 1447372 T6214 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\t
[...truncated too long message...]
nect java.net.ConnectException: Connection refused: no further information
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:712)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4] 2>
[junit4] 2> 9117609 T6329 oaz.ClientCnxn$SendThread.run WARN Session 0x14433a3d7200017 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:712)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4] 2>
[junit4] 2> 9117883 T6249 oaz.ClientCnxn$SendThread.run WARN Session 0x14433a3d720000f for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:712)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4] 2>
[junit4] 2> NOTE: Windows 7 6.1 x86/Oracle Corporation 1.8.0 (32-bit)/cpus=2,threads=136,free=358231408,total=446472192
[junit4] 2> NOTE: All tests run in this JVM: [AnalysisErrorHandlingTest, TermVectorComponentDistributedTest, TestFastOutputStream, TestFunctionQuery, AbstractAnalyticsStatsTest, TestCustomSort, HdfsDirectoryTest, PrimitiveFieldTypeTest, TestCoreDiscovery, TestDefaultSimilarityFactory, ZkNodePropsTest, AddSchemaFieldsUpdateProcessorFactoryTest, BasicDistributedZk2Test, TestCloudManagedSchemaAddField, QueryFacetTest, TestZkChroot, IndexBasedSpellCheckerTest, TimeZoneUtilsTest, TestSolrDeletionPolicy2, DeleteShardTest, TestSolrCoreProperties, TestRangeQuery, TestSchemaNameResource, TestTrie, UpdateRequestProcessorFactoryTest, TestSolrQueryParser, TestIBSimilarityFactory, TestStressUserVersions, JsonLoaderTest, DisMaxRequestHandlerTest, TestXIncludeConfig, TestSchemaResource, OpenCloseCoreStressTest, TestJmxMonitoredMap, TestStressReorder, TestPerFieldSimilarity, ScriptEngineTest, SynonymTokenizerTest, TestDistributedMissingSort, TestClassNameShortening, DateMathParserTest, TestCollapseQParserPlugin, TestLuceneMatchVersion, TriLevelCompositeIdRoutingTest, TestRandomDVFaceting, TestBadConfig, HighlighterConfigTest, TestAnalyzeInfixSuggestions, TestDocSet, ZkCLITest, TestWriterPerf, TestAddFieldRealTimeGet, DirectSolrSpellCheckerTest, BinaryUpdateRequestHandlerTest, TestReversedWildcardFilterFactory, SampleTest, TestCopyFieldCollectionResource, BlockDirectoryTest, BasicFunctionalityTest, TestSerializedLuceneMatchVersion, TestModifyConfFiles, CachingDirectoryFactoryTest, TestImplicitCoreProperties, StatsComponentTest, TestFuzzyAnalyzedSuggestions, HdfsCollectionsAPIDistributedZkTest, TestSolrXml, TestManagedSchemaFieldResource, TestBinaryResponseWriter, ConnectionManagerTest, PingRequestHandlerTest, TestDynamicFieldCollectionResource, TestExtendedDismaxParser, NumericFieldsTest, FieldAnalysisRequestHandlerTest, CoreMergeIndexesAdminHandlerTest, AddBlockUpdateTest, TestFastWriter, AbstractAnalyticsFacetTest, TestCloudManagedSchema, TestStressRecovery, TestWordDelimiterFilterFactory, CoreContainerCoreInitFailuresTest, TestCursorMarkWithoutUniqueKey, RemoteQueryErrorTest, TestCharFilters, InfoHandlerTest, DocValuesMultiTest, TestRealTimeGet, SolrCmdDistributorTest, TestIndexSearcher, DistribCursorPagingTest, TestHighFrequencyDictionaryFactory, WordBreakSolrSpellCheckerTest, CoreAdminCreateDiscoverTest, TestPseudoReturnFields, HardAutoCommitTest, TestFastLRUCache, CacheHeaderTest, RangeFacetTest, EchoParamsTest, TestReplicationHandler, UUIDFieldTest, PrimUtilsTest, PolyFieldTest, CollectionsAPIDistributedZkTest, TestLMJelinekMercerSimilarityFactory, TestSolrDeletionPolicy1, ConvertedLegacyTest, ResponseLogComponentTest, TestUtils, TestSolrJ, SolrRequestParserTest, TestSweetSpotSimilarityFactory, TestQuerySenderListener, TestDistributedGrouping, StandardRequestHandlerTest, ExternalFileFieldSortTest, TestFaceting, TestSchemaSimilarityResource, PreAnalyzedUpdateProcessorTest, SolrXmlInZkTest, CurrencyFieldXmlFileTest, ParsingFieldUpdateProcessorsTest, DefaultValueUpdateProcessorTest, TestDFRSimilarityFactory, UniqFieldsUpdateProcessorFactoryTest, TestDistributedSearch, TestReloadAndDeleteDocs, FullSolrCloudDistribCmdsTest, FieldMutatingUpdateProcessorTest, TestDynamicFieldResource, TestPhraseSuggestions, TestStressLucene, DirectSolrConnectionTest, TestUpdate, ReturnFieldsTest, ZkControllerTest, TestArbitraryIndexDir, AlternateDirectoryTest, IndexSchemaTest, TestInfoStreamLogging, TestFieldTypeCollectionResource, SimplePostToolTest, TestFieldResource, TestCSVResponseWriter, HdfsRecoveryZkTest, TestGroupingSearch, TestPostingsSolrHighlighter, MultiTermTest, TestRemoteStreaming, TestCodecSupport, TestMaxScoreQueryParser, TestLFUCache, CSVRequestHandlerTest, OverseerCollectionProcessorTest, RecoveryZkTest, TestQuerySenderNoQuery, FileBasedSpellCheckerTest, DistributedSpellCheckComponentTest, TestManagedSchema, TestSolrIndexConfig, DocValuesMissingTest, TestInitQParser, ClusterStateTest, UpdateParamsTest, SpellCheckCollatorTest, TestQueryUtils, ChangedSchemaMergeTest, TestLazyCores, DistributedTermsComponentTest, JSONWriterTest, SpellPossibilityIteratorTest, TestBinaryField, TestSolrQueryParserResource, SearchHandlerTest, TestCSVLoader, BasicDistributedZkTest, ChaosMonkeySafeLeaderTest]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ChaosMonkeySafeLeaderTest -Dtests.seed=187849E2C3279F5B -Dtests.slow=true -Dtests.locale=vi -Dtests.timezone=US/Pacific-New -Dtests.file.encoding=Cp1252
[junit4] 2> 9118687 T6289 oaz.ClientCnxn$SendThread.run WARN Session 0x14433a3d7200013 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:712)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4] 2>
[junit4] 2> 9119510 T6448 oaz.ClientCnxn$SendThread.run WARN Session 0x14433a3d720001f for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:712)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4] 2>
[junit4] 2> 9120265 T6349 oaz.ClientCnxn$SendThread.run WARN Session 0x14433a3d7200019 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:712)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4] 2>
[junit4] ERROR 0.00s | ChaosMonkeySafeLeaderTest (suite) <<<
[junit4] > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
[junit4] > at __randomizedtesting.SeedInfo.seed([187849E2C3279F5B]:0)
[junit4] Completed in 7684.03s, 1 test, 2 errors <<< FAILURES!
[...truncated 562 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:453: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:433: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\extra-targets.xml:37: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build.xml:189: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\common-build.xml:491: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:1268: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:901: There were test failures: 372 suites, 1604 tests, 1 suite-level error, 1 error, 793 ignored (7 assumptions)
Total time: 186 minutes 22 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.8.0-fcs-b129 -client -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure