You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/02/15 21:44:11 UTC
[JENKINS] Lucene-Solr-4.x-Windows (32bit/jdk1.7.0_60-ea-b04) -
Build # 3707 - Still Failing!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Windows/3707/
Java: 32bit/jdk1.7.0_60-ea-b04 -server -XX:+UseG1GC
1 tests failed.
REGRESSION: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.testDistribSearch
Error Message:
Captured an uncaught exception in thread: Thread[id=6755, name=RecoveryThread, state=RUNNABLE, group=TGRP-ChaosMonkeySafeLeaderTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=6755, name=RecoveryThread, state=RUNNABLE, group=TGRP-ChaosMonkeySafeLeaderTest]
at __randomizedtesting.SeedInfo.seed([FDE582CE1E149C32:7C030CD6694BFC0E]:0)
Caused by: java.lang.AssertionError: file _0_1.del does not exist
at __randomizedtesting.SeedInfo.seed([FDE582CE1E149C32]:0)
at org.apache.lucene.index.IndexWriter.filesExist(IndexWriter.java:4363)
at org.apache.lucene.index.IndexWriter.startCommit(IndexWriter.java:4429)
at org.apache.lucene.index.IndexWriter.prepareCommitInternal(IndexWriter.java:2926)
at org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:3022)
at org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:2989)
at org.apache.solr.update.DirectUpdateHandler2.commit(DirectUpdateHandler2.java:578)
at org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:396)
at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:247)
Build Log:
[...truncated 10541 lines...]
[junit4] Suite: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
[junit4] 2> 1613693 T6314 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (true)
[junit4] 2> 1613693 T6314 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4] 2> 1613703 T6314 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-ChaosMonkeySafeLeaderTest-1392495447960
[junit4] 2> 1613706 T6314 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 1613707 T6315 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 1613819 T6314 oasc.ZkTestServer.run start zk server on port:52520
[junit4] 2> 1613824 T6314 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1613843 T6321 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@18f6175 name:ZooKeeperConnection Watcher:127.0.0.1:52520 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1613844 T6314 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1613844 T6314 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 1613860 T6316 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14437324fa70000, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 1613865 T6314 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1613872 T6323 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5b941a name:ZooKeeperConnection Watcher:127.0.0.1:52520/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1613872 T6314 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1613872 T6314 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 1613889 T6314 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 1613906 T6314 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 1613916 T6314 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 1613931 T6314 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1613932 T6314 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 1613954 T6314 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 1613955 T6314 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 1613970 T6314 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1613970 T6314 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1613985 T6314 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1613988 T6314 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 1614002 T6314 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1614003 T6314 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 1614017 T6314 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1614018 T6314 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 1614032 T6314 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 1614033 T6314 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 1614046 T6314 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1614048 T6314 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 1614062 T6314 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1614062 T6314 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1614082 T6314 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1614084 T6314 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 1614098 T6314 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1614100 T6314 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 1614112 T6316 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14437324fa70001, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 1614114 T6314 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1614123 T6325 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6e0735 name:ZooKeeperConnection Watcher:127.0.0.1:52520/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1614124 T6314 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1614131 T6316 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14437324fa70002, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 1614768 T6314 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1614780 T6314 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 1614787 T6314 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:52530
[junit4] 2> 1614790 T6314 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1614790 T6314 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1614790 T6314 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1392495448386
[junit4] 2> 1614790 T6314 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1392495448386\'
[junit4] 2> 1614828 T6314 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1392495448386\solr.xml
[junit4] 2> 1614907 T6314 oasc.CoreContainer.<init> New CoreContainer 9618272
[junit4] 2> 1614908 T6314 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1392495448386\]
[junit4] 2> 1614909 T6314 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1614910 T6314 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1614910 T6314 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1614910 T6314 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1614911 T6314 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1614911 T6314 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1614912 T6314 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1614913 T6314 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1614913 T6314 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1614927 T6314 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1614929 T6314 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1614929 T6314 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1614930 T6314 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52520/solr
[junit4] 2> 1614930 T6314 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1614933 T6314 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1614945 T6336 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1d1fc93 name:ZooKeeperConnection Watcher:127.0.0.1:52520 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1614945 T6314 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1614952 T6314 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1614957 T6338 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@122fe0d name:ZooKeeperConnection Watcher:127.0.0.1:52520/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1614958 T6314 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1614960 T6314 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 1614967 T6314 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 1614975 T6314 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 1614980 T6314 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52530_
[junit4] 2> 1614983 T6314 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52530_
[junit4] 2> 1614990 T6314 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 1614994 T6314 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 1615003 T6314 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:52530_
[junit4] 2> 1615003 T6314 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 1615008 T6314 oasc.Overseer.start Overseer (id=91258581678489604-127.0.0.1:52530_-n_0000000000) starting
[junit4] 2> 1615016 T6314 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 1615032 T6340 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 1615034 T6314 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 1615036 T6340 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
[junit4] 2> 1615045 T6314 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 1615051 T6314 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1615058 T6339 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 1615064 T6341 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 1615065 T6341 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1615067 T6341 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1615067 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1615072 T6339 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1615074 T6339 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:52530",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:52530_",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1615075 T6339 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 1615075 T6339 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 1615086 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1615090 T6338 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1616185 T6341 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1616185 T6341 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1392495448386\collection1
[junit4] 2> 1616186 T6341 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 1616187 T6341 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1616188 T6341 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 1616192 T6341 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1616193 T6341 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1392495448386\collection1\'
[junit4] 2> 1616198 T6341 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1392495448386/collection1/lib/classes/' to classloader
[junit4] 2> 1616201 T6341 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1392495448386/collection1/lib/README' to classloader
[junit4] 2> 1616280 T6341 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 1616336 T6341 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1616340 T6341 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1616358 T6341 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1616837 T6341 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1616841 T6341 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1616842 T6341 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1616850 T6341 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1616894 T6341 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 1616894 T6341 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1392495448386\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392495447958/control/data\
[junit4] 2> 1616894 T6341 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@d6b082
[junit4] 2> 1616894 T6341 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392495447958\control\data
[junit4] 2> 1616896 T6341 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392495447958/control/data\index/
[junit4] 2> 1616896 T6341 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392495447958\control\data\index' doesn't exist. Creating new index...
[junit4] 2> 1616899 T6341 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392495447958\control\data\index
[junit4] 2> 1616900 T6341 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=25, maxMergeAtOnceExplicit=38, maxMergedSegmentMB=28.2216796875, floorSegmentMB=2.1982421875, forceMergeDeletesPctAllowed=25.02451102621665, segmentsPerTier=35.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 1616905 T6341 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392495447958\control\data\index,segFN=segments_1,generation=1}
[junit4] 2> 1616905 T6341 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1616910 T6341 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1616910 T6341 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1616911 T6341 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1616911 T6341 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1616911 T6341 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1616911 T6341 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1616912 T6341 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1616912 T6341 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1616912 T6341 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1616913 T6341 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1616913 T6341 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 1616913 T6341 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 1616913 T6341 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 1616915 T6341 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 1616915 T6341 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 1616916 T6341 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 1616925 T6341 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1616929 T6341 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1616929 T6341 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1616931 T6341 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=43, maxMergeAtOnceExplicit=18, maxMergedSegmentMB=49.826171875, floorSegmentMB=2.095703125, forceMergeDeletesPctAllowed=6.7001584543928185, segmentsPerTier=15.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 1616932 T6341 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392495447958\control\data\index,segFN=segments_1,generation=1}
[junit4] 2> 1616932 T6341 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1616932 T6341 oass.SolrIndexSearcher.<init> Opening Searcher@1ce3bd7[collection1] main
[junit4] 2> 1616938 T6341 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1616938 T6342 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1ce3bd7[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 1616939 T6314 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4] 2> 1616939 T6314 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1616950 T6314 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1616951 T6345 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:52530 collection:control_collection shard:shard1
[junit4] 2> 1616954 T6345 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 1616965 T6347 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1bc2492 name:ZooKeeperConnection Watcher:127.0.0.1:52520/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1616966 T6314 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1616971 T6314 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1616977 T6345 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 1616980 T6314 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 1617080 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1617118 T6345 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 1617118 T6345 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C1380 name=collection1 org.apache.solr.core.SolrCore@abf1ea url=https://127.0.0.1:52530/collection1 node=127.0.0.1:52530_ C1380_STATE=coll:control_collection core:collection1 props:{state=down, base_url=https://127.0.0.1:52530, core=collection1, node_name=127.0.0.1:52530_}
[junit4] 2> 1617118 T6345 C1380 P52530 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:52530/collection1/
[junit4] 2> 1617118 T6345 C1380 P52530 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 1617118 T6345 C1380 P52530 oasc.SyncStrategy.syncToMe https://127.0.0.1:52530/collection1/ has no replicas
[junit4] 2> 1617118 T6345 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:52530/collection1/ shard1
[junit4] 2> 1617118 T6345 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 1617146 T6339 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1617254 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1617257 T6338 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1617258 T6347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1617276 T6339 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1617282 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1617405 T6347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1617406 T6338 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1617443 T6345 oasc.ZkController.register We are https://127.0.0.1:52530/collection1/ and leader is https://127.0.0.1:52530/collection1/
[junit4] 2> 1617443 T6345 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:52530
[junit4] 2> 1617443 T6345 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 1617443 T6345 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 1617443 T6345 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1617446 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1617446 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1617446 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1617448 T6345 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1617451 T6339 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1617453 T6339 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:52530",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:52530_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 1617459 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1617576 T6347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1617577 T6338 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1617603 T6314 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 1617605 T6314 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1617618 T6314 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 1617620 T6314 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:52542
[junit4] 2> 1617626 T6314 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1617626 T6314 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1617626 T6314 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1392495451235
[junit4] 2> 1617628 T6314 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1392495451235\'
[junit4] 2> 1617673 T6314 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1392495451235\solr.xml
[junit4] 2> 1617756 T6314 oasc.CoreContainer.<init> New CoreContainer 29346211
[junit4] 2> 1617756 T6314 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1392495451235\]
[junit4] 2> 1617761 T6314 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1617761 T6314 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1617761 T6314 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1617762 T6314 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1617763 T6314 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1617763 T6314 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1617763 T6314 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1617766 T6314 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1617766 T6314 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1617782 T6314 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1617782 T6314 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1617782 T6314 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1617782 T6314 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52520/solr
[junit4] 2> 1617782 T6314 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1617787 T6314 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1617794 T6358 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ad36b7 name:ZooKeeperConnection Watcher:127.0.0.1:52520 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1617796 T6314 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1617802 T6314 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1617806 T6360 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@12db90d name:ZooKeeperConnection Watcher:127.0.0.1:52520/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1617808 T6314 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1617816 T6314 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1619057 T6314 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52542_
[junit4] 2> 1619065 T6314 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52542_
[junit4] 2> 1619080 T6338 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 1619081 T6360 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 1619081 T6347 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 1619114 T6361 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 1619115 T6361 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1619121 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1619121 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1619122 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1619121 T6361 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1619130 T6339 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1619134 T6339 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:52542",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:52542_",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1619135 T6339 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3]
[junit4] 2> 1619135 T6339 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
[junit4] 2> 1619153 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1619158 T6360 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1619159 T6338 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1619159 T6347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1620351 T6361 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1620351 T6361 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1392495451235\collection1
[junit4] 2> 1620351 T6361 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 1620354 T6361 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1620354 T6361 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1620356 T6361 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1620356 T6361 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1392495451235\collection1\'
[junit4] 2> 1620359 T6361 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1392495451235/collection1/lib/classes/' to classloader
[junit4] 2> 1620359 T6361 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1392495451235/collection1/lib/README' to classloader
[junit4] 2> 1620443 T6361 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 1620500 T6361 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1620504 T6361 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1620516 T6361 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1621030 T6361 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1621033 T6361 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1621036 T6361 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1621044 T6361 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1621105 T6361 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 1621107 T6361 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1392495451235\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392495447958/jetty1\
[junit4] 2> 1621107 T6361 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@d6b082
[junit4] 2> 1621107 T6361 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392495447958\jetty1
[junit4] 2> 1621107 T6361 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392495447958/jetty1\index/
[junit4] 2> 1621110 T6361 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392495447958\jetty1\index' doesn't exist. Creating new index...
[junit4] 2> 1621110 T6361 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392495447958\jetty1\index
[junit4] 2> 1621111 T6361 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=25, maxMergeAtOnceExplicit=38, maxMergedSegmentMB=28.2216796875, floorSegmentMB=2.1982421875, forceMergeDeletesPctAllowed=25.02451102621665, segmentsPerTier=35.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 1621119 T6361 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392495447958\jetty1\index,segFN=segments_1,generation=1}
[junit4] 2> 1621119 T6361 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1621124 T6361 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1621124 T6361 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1621125 T6361 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1621125 T6361 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1621125 T6361 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1621126 T6361 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1621126 T6361 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1621126 T6361 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1621126 T6361 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1621129 T6361 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1621129 T6361 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 1621129 T6361 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 1621129 T6361 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 1621130 T6361 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 1621131 T6361 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 1621131 T6361 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 1621142 T6361 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1621148 T6361 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1621148 T6361 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1621149 T6361 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=43, maxMergeAtOnceExplicit=18, maxMergedSegmentMB=49.826171875, floorSegmentMB=2.095703125, forceMergeDeletesPctAllowed=6.7001584543928185, segmentsPerTier=15.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 1621149 T6361 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392495447958\jetty1\index,segFN=segments_1,generation=1}
[junit4] 2> 1621149 T6361 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1621149 T6361 oass.SolrIndexSearcher.<init> Opening Searcher@1f5fab6[collection1] main
[junit4] 2> 1621159 T6362 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1f5fab6[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 1621161 T6361 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1621163 T6314 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4] 2> 1621163 T6314 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1621163 T6365 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:52542 collection:collection1 shard:shard3
[junit4] 2> 1621168 T6365 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election
[junit4] 2> 1621196 T6365 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard3
[junit4] 2> 1621204 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1621208 T6365 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 1621208 T6365 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C1381 name=collection1 org.apache.solr.core.SolrCore@38a8ae url=https://127.0.0.1:52542/collection1 node=127.0.0.1:52542_ C1381_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:52542, core=collection1, node_name=127.0.0.1:52542_}
[junit4] 2> 1621208 T6365 C1381 P52542 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:52542/collection1/
[junit4] 2> 1621208 T6365 C1381 P52542 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 1621208 T6365 C1381 P52542 oasc.SyncStrategy.syncToMe https://127.0.0.1:52542/collection1/ has no replicas
[junit4] 2> 1621210 T6365 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:52542/collection1/ shard3
[junit4] 2> 1621210 T6365 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard3
[junit4] 2> 1621215 T6339 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1621240 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1621244 T6347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1621244 T6338 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1621245 T6360 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1621261 T6339 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1621269 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1621397 T6338 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1621399 T6347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1621399 T6360 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1621441 T6365 oasc.ZkController.register We are https://127.0.0.1:52542/collection1/ and leader is https://127.0.0.1:52542/collection1/
[junit4] 2> 1621441 T6365 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:52542
[junit4] 2> 1621441 T6365 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 1621442 T6365 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 1621442 T6365 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1621445 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1621445 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1621445 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1621448 T6365 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1621450 T6339 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1621453 T6339 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:52542",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:52542_",
[junit4] 2> "shard":"shard3",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 1621459 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1621587 T6338 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1621587 T6347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1621588 T6360 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1621852 T6314 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 1621854 T6314 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1621865 T6314 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 1621870 T6314 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:52551
[junit4] 2> 1621875 T6314 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1621875 T6314 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1621875 T6314 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1392495455426
[junit4] 2> 1621875 T6314 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1392495455426\'
[junit4] 2> 1621914 T6314 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1392495455426\solr.xml
[junit4] 2> 1621986 T6314 oasc.CoreContainer.<init> New CoreContainer 18175100
[junit4] 2> 1621986 T6314 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1392495455426\]
[junit4] 2> 1621989 T6314 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1621989 T6314 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1621989 T6314 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1621989 T6314 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1621989 T6314 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1621989 T6314 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1621991 T6314 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1621991 T6314 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1621991 T6314 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1622008 T6314 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1622008 T6314 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1622008 T6314 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1622011 T6314 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52520/solr
[junit4] 2> 1622011 T6314 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1622014 T6314 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1622022 T6376 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1240545 name:ZooKeeperConnection Watcher:127.0.0.1:52520 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1622022 T6314 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1622031 T6316 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14437324fa70008, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 1622032 T6314 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1622037 T6378 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f55b5f name:ZooKeeperConnection Watcher:127.0.0.1:52520/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1622037 T6314 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1622061 T6314 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1623302 T6314 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52551_
[junit4] 2> 1623308 T6314 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52551_
[junit4] 2> 1623327 T6360 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1623328 T6347 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1623330 T6338 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1623331 T6378 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1623362 T6379 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 1623363 T6379 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1623369 T6379 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1623369 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1623369 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1623370 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1623379 T6339 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1623382 T6339 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:52551",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:52551_",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1623384 T6339 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 1623384 T6339 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 1623402 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1623406 T6360 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1623409 T6378 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1623409 T6338 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1623410 T6347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1624597 T6379 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1624597 T6379 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1392495455426\collection1
[junit4] 2> 1624597 T6379 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 1624600 T6379 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1624600 T6379 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1624603 T6379 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1624603 T6379 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1392495455426\collection1\'
[junit4] 2> 1624606 T6379 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1392495455426/collection1/lib/classes/' to classloader
[junit4] 2> 1624607 T6379 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1392495455426/collection1/lib/README' to classloader
[junit4] 2> 1624684 T6379 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 1624748 T6379 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1624752 T6379 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1624766 T6379 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1625341 T6379 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1625345 T6379 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1625346 T6379 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1625353 T6379 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1625405 T6379 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 1625406 T6379 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1392495455426\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392495447958/jetty2\
[junit4] 2> 1625406 T6379 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@d6b082
[junit4] 2> 1625408 T6379 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392495447958\jetty2
[junit4] 2> 1625409 T6379 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392495447958/jetty2\index/
[junit4] 2> 1625411 T6379 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392495447958\jetty2\index' doesn't exist. Creating new index...
[junit4] 2> 1625411 T6379 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392495447958\jetty2\index
[junit4] 2> 1625412 T6379 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=25, maxMergeAtOnceExplicit=38, maxMergedSegmentMB=28.2216796875, floorSegmentMB=2.1982421875, forceMergeDeletesPctAllowed=25.02451102621665, segmentsPerTier=35.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 1625418 T6379 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392495447958\jetty2\index,segFN=segments_1,generation=1}
[junit4] 2> 1625418 T6379 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1625423 T6379 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1625423 T6379 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1625424 T6379 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1625424 T6379 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1625424 T6379 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1625424 T6379 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1625425 T6379 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1625425 T6379 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1625425 T6379 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1625427 T6379 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1625429 T6379 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 1625429 T6379 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 1625429 T6379 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 1625430 T6379 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 1625430 T6379 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 1625431 T6379 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 1625439 T6379 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1625447 T6379 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1625447 T6379 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1625448 T6379 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=43, maxMergeAtOnceExplicit=18, maxMergedSegmentMB=49.826171875, floorSegmentMB=2.095703125, forceMergeDeletesPctAllowed=6.7001584543928185, segmentsPerTier=15.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 1625449 T6379 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392495447958\jetty2\index,segFN=segments_1,generation=1}
[junit4] 2> 1625449 T6379 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1625450 T6379 oass.SolrIndexSearcher.<init> Opening Searcher@150f686[collection1] main
[junit4] 2> 1625454 T6380 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@150f686[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 1625457 T6379 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1625460 T6314 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4] 2> 1625461 T6314 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1625460 T6383 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:52551 collection:collection1 shard:shard2
[junit4] 2> 1625463 T6383 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 1625480 T6383 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 1625495 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1625499 T6383 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 1625499 T6383 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C1382 name=collection1 org.apache.solr.core.SolrCore@a78fa4 url=https://127.0.0.1:52551/collection1 node=127.0.0.1:52551_ C1382_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:52551, core=collection1, node_name=127.0.0.1:52551_}
[junit4] 2> 1625499 T6383 C1382 P52551 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:52551/collection1/
[junit4] 2> 1625501 T6383 C1382 P52551 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 1625501 T6383 C1382 P52551 oasc.SyncStrategy.syncToMe https://127.0.0.1:52551/collection1/ has no replicas
[junit4] 2> 1625501 T6383 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:52551/collection1/ shard2
[junit4] 2> 1625501 T6383 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 1625505 T6339 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1625521 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1625526 T6360 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1625526 T6347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1625527 T6338 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1625527 T6378 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1625542 T6339 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1625550 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1625679 T6360 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1625680 T6338 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1625680 T6378 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1625682 T6347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1625727 T6383 oasc.ZkController.register We are https://127.0.0.1:52551/collection1/ and leader is https://127.0.0.1:52551/collection1/
[junit4] 2> 1625728 T6383 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:52551
[junit4] 2> 1625728 T6383 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 1625728 T6383 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 1625728 T6383 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1625732 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1625732 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1625732 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1625734 T6383 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1625738 T6339 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1625739 T6339 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:52551",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:52551_",
[junit4] 2> "shard":"shard2",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":"core_node2"}
[junit4] 2> 1625745 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1625876 T6360 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1625876 T6338 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1625877 T6347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1625877 T6378 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1626107 T6314 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 1626107 T6314 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1626124 T6314 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 1626129 T6314 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:52560
[junit4] 2> 1626134 T6314 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1626134 T6314 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1626134 T6314 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1392495459722
[junit4] 2> 1626134 T6314 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1392495459722\'
[junit4] 2> 1626176 T6314 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1392495459722\solr.xml
[junit4] 2> 1626253 T6314 oasc.CoreContainer.<init> New CoreContainer 18672263
[junit4] 2> 1626253 T6314 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1392495459722\]
[junit4] 2> 1626255 T6314 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1626255 T6314 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1626255 T6314 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1626255 T6314 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1626255 T6314 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1626255 T6314 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1626257 T6314 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1626257 T6314 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1626257 T6314 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1626272 T6314 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1626272 T6314 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1626272 T6314 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1626273 T6314 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52520/solr
[junit4] 2> 1626275 T6314 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1626278 T6314 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1626290 T6394 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1a239fc name:ZooKeeperConnection Watcher:127.0.0.1:52520 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1626292 T6314 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1626299 T6316 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14437324fa7000a, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 1626302 T6314 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1626313 T6396 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@534e51 name:ZooKeeperConnection Watcher:127.0.0.1:52520/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1626314 T6314 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1626332 T6314 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1627569 T6314 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52560_
[junit4] 2> 1627572 T6314 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52560_
[junit4] 2> 1627580 T6360 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1627581 T6396 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1627581 T6347 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1627583 T6378 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1627583 T6338 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1627599 T6397 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 1627601 T6397 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1627603 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1627603 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1627603 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1627603 T6397 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1627608 T6339 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1627609 T6339 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:52560",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:52560_",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1627609 T6339 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 1627609 T6339 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 1627616 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1627617 T6396 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 1627617 T6360 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 1627617 T6347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 1627617 T6378 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 1627617 T6338 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 1628832 T6397 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1628832 T6397 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1392495459722\collection1
[junit4] 2> 1628832 T6397 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 1628836 T6397 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1628836 T6397 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1628838 T6397 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[...truncated too long message...]
] 2> at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:174)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:171)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:171)
[junit4] 2> at org.apache.solr.cloud.ElectionContext.cancelElection(ElectionContext.java:67)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:293)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:164)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:108)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 1821972 T6573 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 1821972 T6573 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:254)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:254)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 1821971 T6433 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:254)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:254)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> NOTE: test params are: codec=Lucene3x, sim=RandomSimilarityProvider(queryNorm=false,coord=crazy): {}, locale=ar_EG, timezone=Asia/Baghdad
[junit4] 2> NOTE: Windows 7 6.1 x86/Oracle Corporation 1.7.0_60-ea (32-bit)/cpus=2,threads=1,free=165091048,total=536870912
[junit4] 2> NOTE: All tests run in this JVM: [TermsComponentTest, ConvertedLegacyTest, TestDistributedMissingSort, QueryEqualityTest, TestSolrIndexConfig, ClusterStateUpdateTest, TestZkChroot, TestCopyFieldCollectionResource, FileBasedSpellCheckerTest, SignatureUpdateProcessorFactoryTest, TestConfig, TestSolrQueryParserResource, DistributedQueryElevationComponentTest, RequiredFieldsTest, TestBM25SimilarityFactory, RegexBoostProcessorTest, TestCollapseQParserPlugin, SyncSliceTest, CursorMarkTest, TestIndexingPerformance, DirectSolrSpellCheckerTest, AutoCommitTest, TestLFUCache, HdfsLockFactoryTest, TestManagedSchemaFieldResource, TestSchemaSimilarityResource, LeaderElectionTest, CircularListTest, TestSort, TestFiltering, PrimUtilsTest, ChangedSchemaMergeTest, HdfsDirectoryTest, TestSurroundQueryParser, HdfsUnloadDistributedZkTest, TestDistributedGrouping, ReturnFieldsTest, TestLMJelinekMercerSimilarityFactory, TestRTGBase, TestCloudManagedSchemaAddField, RecoveryZkTest, DistributedTermsComponentTest, TestDFRSimilarityFactory, PolyFieldTest, TestSuggestSpellingConverter, TestLRUCache, TestManagedSchema, DefaultValueUpdateProcessorTest, TestUniqueKeyFieldResource, BinaryUpdateRequestHandlerTest, LukeRequestHandlerTest, TestJoin, ZkSolrClientTest, StatsComponentTest, DocValuesTest, SolrCoreCheckLockOnStartupTest, TestWordDelimiterFilterFactory, TestInfoStreamLogging, TestDocBasedVersionConstraints, CacheHeaderTest, CurrencyFieldXmlFileTest, TestHighFrequencyDictionaryFactory, TestReplicationHandler, TestNonDefinedSimilarityFactory, TestPostingsSolrHighlighter, SolrCoreTest, FileUtilsTest, TestBadConfig, TestAddFieldRealTimeGet, SpellingQueryConverterTest, JSONWriterTest, CoreContainerCoreInitFailuresTest, CachingDirectoryFactoryTest, TestLuceneMatchVersion, PingRequestHandlerTest, TestFieldResource, TestUtils, NotRequiredUniqueKeyTest, FastVectorHighlighterTest, AnalysisAfterCoreReloadTest, TestDistribDocBasedVersion, TestStressReorder, OpenCloseCoreStressTest, DistributedDebugComponentTest, TestCodecSupport, ResponseLogComponentTest, TestFastLRUCache, TestFuzzyAnalyzedSuggestions, SampleTest, UpdateRequestProcessorFactoryTest, TestPseudoReturnFields, TestReload, TestGroupingSearch, OverseerCollectionProcessorTest, TestMergePolicyConfig, TestFieldTypeCollectionResource, TestLazyCores, SoftAutoCommitTest, TestAnalyzeInfixSuggestions, DirectUpdateHandlerOptimizeTest, PreAnalyzedFieldTest, DisMaxRequestHandlerTest, DOMUtilTest, PeerSyncTest, TestExtendedDismaxParser, TestHighlightDedupGrouping, TestFastOutputStream, CollectionsAPIDistributedZkTest, NoCacheHeaderTest, URLClassifyProcessorTest, TestRandomDVFaceting, TestFastWriter, BadComponentTest, SolrTestCaseJ4Test, SynonymTokenizerTest, TestSolrJ, ZkNodePropsTest, MBeansHandlerTest, SolrIndexConfigTest, DistributedSpellCheckComponentTest, SchemaVersionSpecificBehaviorTest, BJQParserTest, IndexBasedSpellCheckerTest, TestFaceting, BasicDistributedZk2Test, TestDefaultSimilarityFactory, TestSolrXml, TestSearchPerf, TestWriterPerf, TestFunctionQuery, IndexSchemaRuntimeFieldTest, SimpleFacetsTest, CoreMergeIndexesAdminHandlerTest, TestOverriddenPrefixQueryForCustomFieldType, TestCoreDiscovery, CurrencyFieldOpenExchangeTest, DateMathParserTest, TestFieldCollectionResource, XsltUpdateRequestHandlerTest, SuggesterTSTTest, DebugComponentTest, AnalysisErrorHandlingTest, HdfsRecoveryZkTest, SOLR749Test, FieldMutatingUpdateProcessorTest, TriLevelCompositeIdRoutingTest, MultiTermTest, OutputWriterTest, TestSolrXmlPersistence, TestClassNameShortening, CopyFieldTest, BasicDistributedZkTest, SolrIndexSplitterTest, SpellCheckCollatorTest, StandardRequestHandlerTest, SpellPossibilityIteratorTest, ShardRoutingTest, ResourceLoaderTest, HighlighterConfigTest, EnumFieldTest, TestSolrXMLSerializer, TestIBSimilarityFactory, TestCoreContainer, DocumentBuilderTest, SuggesterFSTTest, TestJmxMonitoredMap, FullSolrCloudDistribCmdsTest, TestRandomFaceting, XmlUpdateRequestHandlerTest, BasicFunctionalityTest, LeaderElectionIntegrationTest, DistanceFunctionTest, UpdateParamsTest, TestSolrCoreProperties, MinimalSchemaTest, ChaosMonkeySafeLeaderTest]
[junit4] Completed in 209.41s, 1 test, 1 error <<< FAILURES!
[...truncated 565 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:459: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:439: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\extra-targets.xml:37: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build.xml:189: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\common-build.xml:491: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:1308: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:941: There were test failures: 362 suites, 1563 tests, 1 error, 40 ignored (12 assumptions)
Total time: 81 minutes 26 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.7.0_60-ea-b04 -server -XX:+UseG1GC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure