You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/11/20 23:47:01 UTC
[JENKINS] Lucene-Solr-trunk-Windows (64bit/jdk1.7.0_67) - Build #
4443 - Still Failing!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Windows/4443/
Java: 64bit/jdk1.7.0_67 -XX:-UseCompressedOops -XX:+UseSerialGC (asserts: true)
2 tests failed.
REGRESSION: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.testDistribSearch
Error Message:
Test abandoned because suite timeout was reached.
Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
at __randomizedtesting.SeedInfo.seed([3DCF993F0F4631A6]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
Error Message:
Suite timeout exceeded (>= 7200000 msec).
Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
at __randomizedtesting.SeedInfo.seed([3DCF993F0F4631A6]:0)
Build Log:
[...truncated 10853 lines...]
[junit4] Suite: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
[junit4] 2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\init-core-data-001
[junit4] 2> 2182043 T3968 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (false)
[junit4] 2> 2182043 T3968 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /ugpw/
[junit4] 2> 2182067 T3968 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> 2182067 T3968 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 2182073 T3969 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 2182196 T3968 oasc.ZkTestServer.run start zk server on port:56899
[junit4] 2> 2182196 T3968 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 2182199 T3968 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2182206 T3976 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2bb960f6 name:ZooKeeperConnection Watcher:127.0.0.1:56899 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2182206 T3968 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2182206 T3968 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 2182206 T3968 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 2182215 T3968 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 2182217 T3968 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2182226 T3979 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@70e505b9 name:ZooKeeperConnection Watcher:127.0.0.1:56899/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2182227 T3968 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2182227 T3968 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 2182227 T3968 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 2182232 T3968 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 2182236 T3968 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 2182240 T3968 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 2182244 T3968 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 2182244 T3968 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 2182250 T3968 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 2182250 T3968 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 2182258 T3968 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 2182258 T3968 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 2182264 T3968 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 2182264 T3968 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 2182269 T3968 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 2182269 T3968 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 2182273 T3968 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
[junit4] 2> 2182273 T3968 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 2182278 T3968 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 2182278 T3968 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 2182283 T3968 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 2182283 T3968 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 2182288 T3968 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 2182288 T3968 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 2182293 T3968 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 2182293 T3968 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 2182298 T3968 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 2182298 T3968 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 2182305 T3968 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 2182310 T3968 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2182311 T3982 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1592d7fc name:ZooKeeperConnection Watcher:127.0.0.1:56899/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2182311 T3968 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2182311 T3968 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 2184355 T3968 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2184365 T3968 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 2184390 T3968 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:56909
[junit4] 2> 2184395 T3968 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 2184395 T3968 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2184397 T3968 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-002
[junit4] 2> 2184397 T3968 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-002\'
[junit4] 2> 2184438 T3968 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-002\solr.xml
[junit4] 2> 2184539 T3968 oasc.CoreContainer.<init> New CoreContainer 933801199
[junit4] 2> 2184539 T3968 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-002\]
[junit4] 2> 2184543 T3968 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 2184543 T3968 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 2184543 T3968 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 2184543 T3968 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 2184543 T3968 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
[junit4] 2> 2184543 T3968 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 2184543 T3968 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 2184545 T3968 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 2184547 T3968 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 2184547 T3968 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 2184554 T3968 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 2184558 T3968 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2184558 T3968 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2184558 T3968 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 2184558 T3968 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:56899/solr
[junit4] 2> 2184558 T3968 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 2184562 T3968 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 2184563 T3968 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2184568 T3994 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@73d99907 name:ZooKeeperConnection Watcher:127.0.0.1:56899 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2184569 T3968 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2184569 T3968 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 2184572 T3970 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x149ceec0cfa0003, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 2184575 T3968 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2184578 T3997 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1af76892 name:ZooKeeperConnection Watcher:127.0.0.1:56899/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2184579 T3968 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2184580 T3968 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 2184586 T3968 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 2184591 T3968 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 2184596 T3968 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 2184601 T3968 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 2184607 T3968 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 2184610 T3968 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56909_ugpw
[junit4] 2> 2184611 T3968 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56909_ugpw
[junit4] 2> 2184618 T3968 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 2184623 T3968 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 2184627 T3968 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 2184630 T3968 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:56909_ugpw
[junit4] 2> 2184630 T3968 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 2184634 T3968 oasc.Overseer.start Overseer (id=92832780563120132-127.0.0.1:56909_ugpw-n_0000000000) starting
[junit4] 2> 2184639 T3968 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 2184656 T3968 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 2184657 T3999 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 2184657 T3968 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 2184663 T3968 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 2184666 T3968 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2184674 T3998 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 2184683 T4001 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
[junit4] 2> 2184683 T4001 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 2184684 T3997 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 2184684 T4001 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2184692 T3998 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "node_name":"127.0.0.1:56909_ugpw",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "roles":null,
[junit4] 2> "operation":"state",
[junit4] 2> "shard":null,
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:56909/ugpw"}
[junit4] 2> 2184692 T3998 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 2184692 T3998 oasc.Overseer$ClusterStateUpdater.createCollection state version control_collection 1
[junit4] 2> 2184692 T3998 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 2184698 T3997 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2185937 T4001 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 2185937 T4001 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 2185940 T4001 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 2185940 T4001 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 2185942 T4001 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2185942 T4001 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-002\collection1\'
[junit4] 2> 2185946 T4001 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001/tempDir-002/collection1/lib/.svn/' to classloader
[junit4] 2> 2185947 T4001 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001/tempDir-002/collection1/lib/classes/' to classloader
[junit4] 2> 2185949 T4001 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001/tempDir-002/collection1/lib/README' to classloader
[junit4] 2> 2186033 T4001 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
[junit4] 2> 2186110 T4001 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2186113 T4001 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 2186126 T4001 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 2186609 T4001 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2186613 T4001 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2186615 T4001 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2186623 T4001 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2186669 T4001 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 2186669 T4001 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 2186669 T4001 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-002\collection1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-001/control/data\
[junit4] 2> 2186670 T4001 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@78900845
[junit4] 2> 2186675 T4001 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-001\control\data
[junit4] 2> 2186676 T4001 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-001/control/data\index/
[junit4] 2> 2186676 T4001 oasc.SolrCore.initIndex WARN [collection1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-001\control\data\index' doesn't exist. Creating new index...
[junit4] 2> 2186679 T4001 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-001\control\data\index
[junit4] 2> 2186680 T4001 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=26, maxMergeAtOnceExplicit=21, maxMergedSegmentMB=74.3994140625, floorSegmentMB=0.2451171875, forceMergeDeletesPctAllowed=21.877032830230924, segmentsPerTier=46.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.70661642771861
[junit4] 2> 2186691 T4001 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-001\control\data\index,segFN=segments_1,generation=1}
[junit4] 2> 2186692 T4001 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2186698 T4001 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 2186700 T4001 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 2186700 T4001 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2186700 T4001 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 2186700 T4001 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2186701 T4001 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 2186701 T4001 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2186701 T4001 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2186702 T4001 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 2186702 T4001 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2186703 T4001 oasc.RequestHandlers.initHandlersFromConfig created /config: org.apache.solr.handler.SolrConfigHandler
[junit4] 2> 2186703 T4001 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2186703 T4001 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2186705 T4001 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 2186705 T4001 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 2186706 T4001 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 2186706 T4001 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 2186706 T4001 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 2186707 T4001 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 2186707 T4001 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 2186708 T4001 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 2186731 T4001 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2186739 T4001 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2186745 T4001 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2186747 T4001 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2186753 T4001 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 2186753 T4001 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 2186756 T4001 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=33, maxMergeAtOnceExplicit=48, maxMergedSegmentMB=51.18359375, floorSegmentMB=1.099609375, forceMergeDeletesPctAllowed=27.14054831119371, segmentsPerTier=12.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 2186758 T4001 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-001\control\data\index,segFN=segments_1,generation=1}
[junit4] 2> 2186760 T4001 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2186760 T4001 oass.SolrIndexSearcher.<init> Opening Searcher@4f6cfbd0[collection1] main
[junit4] 2> 2186760 T4001 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 2186763 T4001 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2186763 T4001 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 2186764 T4001 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 2186764 T4001 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 2186764 T4001 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2186767 T4001 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 2186767 T4001 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2186768 T4001 oascc.SolrZkClient.makePath makePath: /configs/conf1/_rest_managed.json
[junit4] 2> 2186773 T4001 oasr.ManagedResourceStorage$ZooKeeperStorageIO$1.close Wrote 38 bytes to new znode /configs/conf1/_rest_managed.json
[junit4] 2> 2186773 T4001 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2186774 T4001 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 2186780 T4001 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 2186780 T4002 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4f6cfbd0[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2186782 T4006 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:56909/ugpw collection:control_collection shard:shard1
[junit4] 2> 2186783 T3968 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
[junit4] 2> 2186783 T3968 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 2186786 T4006 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 2186799 T4006 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 2186800 T3968 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 2186802 T3968 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2186802 T3997 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 2186805 T4006 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 2186805 T4006 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C15982 name=collection1 org.apache.solr.core.SolrCore@190095fd url=https://127.0.0.1:56909/ugpw/collection1 node=127.0.0.1:56909_ugpw C15982_STATE=coll:control_collection core:collection1 props:{core=collection1, node_name=127.0.0.1:56909_ugpw, state=down, base_url=https://127.0.0.1:56909/ugpw}
[junit4] 2> 2186805 T4006 C15982 P56909 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:56909/ugpw/collection1/
[junit4] 2> 2186806 T4006 C15982 P56909 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 2186806 T4006 C15982 P56909 oasc.SyncStrategy.syncToMe https://127.0.0.1:56909/ugpw/collection1/ has no replicas
[junit4] 2> 2186806 T4006 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:56909/ugpw/collection1/ shard1
[junit4] 2> 2186806 T4006 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 2186809 T4009 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@21c07652 name:ZooKeeperConnection Watcher:127.0.0.1:56899/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2186811 T3968 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2186811 T3968 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 2186816 T3968 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2186826 T3968 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 2186827 T3968 oasc.AbstractFullDistribZkTestBase.createJettys Creating collection1 with stateFormat=2
[junit4] 2> 2186827 T3968 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 2186828 T3997 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2186829 T4009 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2186829 T3968 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2186835 T4012 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7d57497d name:ZooKeeperConnection Watcher:127.0.0.1:56899/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2186835 T3968 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2186837 T3968 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 2186843 T3970 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x149ceec0cfa0006, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 2186853 T3997 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 2186855 T3998 oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: collection1
[junit4] 2> 2186855 T3998 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3]
[junit4] 2> 2186855 T3998 oasc.Overseer$ClusterStateUpdater.createCollection state version collection1 2
[junit4] 2> 2186860 T3997 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 2186861 T3998 oasc.Overseer$ClusterStateUpdater.updateZkStates going to create_collection /collections/collection1/state.json
[junit4] 2> 2186865 T4009 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2186866 T3997 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2186888 T4006 oasc.ZkController.register We are https://127.0.0.1:56909/ugpw/collection1/ and leader is https://127.0.0.1:56909/ugpw/collection1/
[junit4] 2> 2186888 T4006 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:56909/ugpw
[junit4] 2> 2186888 T4006 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 2186888 T4006 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
[junit4] 2> 2186888 T4006 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 2186893 T3997 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 2186904 T3998 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "node_name":"127.0.0.1:56909_ugpw",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"3",
[junit4] 2> "roles":null,
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "operation":"state",
[junit4] 2> "shard":"shard1",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:56909/ugpw"}
[junit4] 2> 2187040 T3997 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2187041 T4009 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2188911 T3968 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 2188912 T3968 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2188925 T3968 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 2188929 T3968 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:56924
[junit4] 2> 2188935 T3968 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 2188935 T3968 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2188935 T3968 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-003
[junit4] 2> 2188936 T3968 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-003\'
[junit4] 2> 2188972 T3968 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-003\solr.xml
[junit4] 2> 2189072 T3968 oasc.CoreContainer.<init> New CoreContainer 942879475
[junit4] 2> 2189072 T3968 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-003\]
[junit4] 2> 2189075 T3968 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 2189075 T3968 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 2189075 T3968 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 2189075 T3968 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 2189075 T3968 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
[junit4] 2> 2189077 T3968 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 2189077 T3968 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 2189077 T3968 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 2189077 T3968 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 2189077 T3968 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 2189084 T3968 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 2189088 T3968 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2189088 T3968 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2189088 T3968 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 2189092 T3968 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:56899/solr
[junit4] 2> 2189092 T3968 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 2189092 T3968 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 2189095 T3968 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2189098 T4024 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@311405af name:ZooKeeperConnection Watcher:127.0.0.1:56899 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2189099 T3968 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2189099 T3968 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 2189105 T3968 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2189108 T4027 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@753cdc90 name:ZooKeeperConnection Watcher:127.0.0.1:56899/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2189108 T3968 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2189122 T3968 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2190261 T3968 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56924_ugpw
[junit4] 2> 2190262 T3968 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56924_ugpw
[junit4] 2> 2190271 T3968 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 2190289 T4028 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 2190289 T4028 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 2190292 T3997 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 2190293 T4028 oasc.ZkController.preRegister Registering watch for external collection collection1
[junit4] 2> 2190293 T4028 oascc.ZkStateReader.addZkWatch addZkWatch collection1
[junit4] 2> 2190294 T4028 oascc.ZkStateReader.addZkWatch Updating collection state at /collections/collection1/state.json from ZooKeeper...
[junit4] 2> 2190299 T4028 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 0
[junit4] 2> 2190299 T4028 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2190310 T3998 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "node_name":"127.0.0.1:56924_ugpw",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "roles":null,
[junit4] 2> "operation":"state",
[junit4] 2> "shard":null,
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:56924/ugpw"}
[junit4] 2> 2190316 T3998 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 2190319 T3998 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
[junit4] 2> 2190328 T3997 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 2190330 T3998 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/collection1/state.json
[junit4] 2> 2190331 T4027 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating...
[junit4] 2> 2190333 T4027 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 1
[junit4] 2> 2191426 T4028 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 2191426 T4028 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 2191429 T4028 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 2191429 T4028 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 2191431 T4028 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2191431 T4028 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-003\collection1\'
[junit4] 2> 2191434 T4028 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001/tempDir-003/collection1/lib/.svn/' to classloader
[junit4] 2> 2191436 T4028 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001/tempDir-003/collection1/lib/classes/' to classloader
[junit4] 2> 2191437 T4028 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001/tempDir-003/collection1/lib/README' to classloader
[junit4] 2> 2191516 T4028 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
[junit4] 2> 2191602 T4028 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2191605 T4028 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 2191616 T4028 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 2192045 T4028 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2192050 T4028 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2192051 T4028 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2192057 T4028 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2192095 T4028 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 2192096 T4028 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 2192096 T4028 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-003\collection1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-001/jetty1\
[junit4] 2> 2192096 T4028 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@78900845
[junit4] 2> 2192099 T4028 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-001\jetty1
[junit4] 2> 2192100 T4028 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-001/jetty1\index/
[junit4] 2> 2192100 T4028 oasc.SolrCore.initIndex WARN [collection1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-001\jetty1\index' doesn't exist. Creating new index...
[junit4] 2> 2192103 T4028 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-001\jetty1\index
[junit4] 2> 2192103 T4028 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=26, maxMergeAtOnceExplicit=21, maxMergedSegmentMB=74.3994140625, floorSegmentMB=0.2451171875, forceMergeDeletesPctAllowed=21.877032830230924, segmentsPerTier=46.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.70661642771861
[junit4] 2> 2192108 T4028 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-001\jetty1\index,segFN=segments_1,generation=1}
[junit4] 2> 2192108 T4028 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2192114 T4028 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 2192115 T4028 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 2192115 T4028 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2192115 T4028 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 2192116 T4028 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2192116 T4028 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 2192116 T4028 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2192117 T4028 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2192117 T4028 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 2192117 T4028 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2192118 T4028 oasc.RequestHandlers.initHandlersFromConfig created /config: org.apache.solr.handler.SolrConfigHandler
[junit4] 2> 2192119 T4028 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2192119 T4028 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2192120 T4028 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 2192120 T4028 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 2192121 T4028 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 2192121 T4028 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 2192121 T4028 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 2192122 T4028 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 2192122 T4028 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 2192124 T4028 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 2192135 T4028 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2192138 T4028 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2192140 T4028 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2192142 T4028 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2192147 T4028 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 2192147 T4028 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 2192149 T4028 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=33, maxMergeAtOnceExplicit=48, maxMergedSegmentMB=51.18359375, floorSegmentMB=1.099609375, forceMergeDeletesPctAllowed=27.14054831119371, segmentsPerTier=12.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 2192151 T4028 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-001\jetty1\index,segFN=segments_1,generation=1}
[junit4] 2> 2192151 T4028 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2192152 T4028 oass.SolrIndexSearcher.<init> Opening Searcher@6d643724[collection1] main
[junit4] 2> 2192153 T4028 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 2192155 T4028 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2192155 T4028 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 2192157 T4028 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 2192157 T4028 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 2192157 T4028 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2192159 T4028 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json
[junit4] 2> 2192159 T4028 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2192160 T4028 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed
[junit4] 2> 2192160 T4028 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 2192163 T4029 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6d643724[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2192165 T4028 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 2192166 T4032 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:56924/ugpw collection:collection1 shard:shard3
[junit4] 2> 2192168 T3968 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
[junit4] 2> 2192169 T3968 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 2192170 T4032 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election
[junit4] 2> 2192182 T4032 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard3
[junit4] 2> 2192185 T3997 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 2192186 T4032 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 2192186 T4032 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C15983 name=collection1 org.apache.solr.core.SolrCore@2d0b5a78 url=https://127.0.0.1:56924/ugpw/collection1 node=127.0.0.1:56924_ugpw C15983_STATE=coll:collection1 core:collection1 props:{core=collection1, node_name=127.0.0.1:56924_ugpw, state=down, base_url=https://127.0.0.1:56924/ugpw}
[junit4] 2> 2192186 T4032 C15983 P56924 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:56924/ugpw/collection1/
[junit4] 2> 2192186 T4032 C15983 P56924 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 2192186 T4032 C15983 P56924 oasc.SyncStrategy.syncToMe https://127.0.0.1:56924/ugpw/collection1/ has no replicas
[junit4] 2> 2192186 T4032 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:56924/ugpw/collection1/ shard3
[junit4] 2> 2192189 T4032 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard3
[junit4] 2> 2192207 T3998 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/collection1/state.json
[junit4] 2> 2192209 T4027 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating...
[junit4] 2> 2192211 T4027 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 2
[junit4] 2> 2192228 T3997 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 2192229 T3998 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/collection1/state.json
[junit4] 2> 2192230 T4027 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating...
[junit4] 2> 2192233 T4027 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 3
[junit4] 2> 2192261 T4032 oasc.ZkController.register We are https://127.0.0.1:56924/ugpw/collection1/ and leader is https://127.0.0.1:56924/ugpw/collection1/
[junit4] 2> 2192262 T4032 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:56924/ugpw
[junit4] 2> 2192262 T4032 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 2192262 T4032 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 2192262 T4032 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 2192266 T3997 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 2192277 T4032 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 3
[junit4] 2> 2192277 T3998 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "node_name":"127.0.0.1:56924_ugpw",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "roles":null,
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "operation":"state",
[junit4] 2> "shard":"shard3",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:56924/ugpw"}
[junit4] 2> 2192288 T3998 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/collection1/state.json
[junit4] 2> 2192290 T4027 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating...
[junit4] 2> 2192291 T4027 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 4
[junit4] 2> 2193944 T3968 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 2193945 T3968 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2193956 T3968 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 2193959 T3968 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:56933
[junit4] 2> 2193965 T3968 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 2193966 T3968 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2193966 T3968 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-004
[junit4] 2> 2193966 T3968 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-004\'
[junit4] 2> 2194002 T3968 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-004\solr.xml
[junit4] 2> 2194094 T3968 oasc.CoreContainer.<init> New CoreContainer 1720565798
[junit4] 2> 2194094 T3968 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-004\]
[junit4] 2> 2194096 T3968 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 2194096 T3968 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 2194096 T3968 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 2194096 T3968 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 2194096 T3968 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
[junit4] 2> 2194096 T3968 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 2194096 T3968 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 2194096 T3968 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 2194098 T3968 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 2194098 T3968 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 2194101 T3968 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 2194106 T3968 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2194106 T3968 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2194106 T3968 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 2194106 T3968 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:56899/solr
[junit4] 2> 2194106 T3968 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 2194106 T3968 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 2194110 T3968 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2194114 T4044 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@61a26416 name:ZooKeeperConnection Watcher:127.0.0.1:56899 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2194115 T3968 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2194115 T3968 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 2194119 T3968 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2194121 T4047 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@53bee23f name:ZooKeeperConnection Watcher:127.0.0.1:56899/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2194122 T3968 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2194135 T3968 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2195272 T3968 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56933_ugpw
[junit4] 2> 2195273 T3968 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56933_ugpw
[junit4] 2> 2195283 T3968 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 2195300 T4048 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 2195301 T4048 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 2195304 T3997 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 2195305 T4048 oasc.ZkController.preRegister Registering watch for external collection collection1
[junit4] 2> 2195306 T4048 oascc.ZkStateReader.addZkWatch addZkWatch collection1
[junit4] 2> 2195306 T4048 oascc.ZkStateReader.addZkWatch Updating collection state at /collections/collection1/state.json from ZooKeeper...
[junit4] 2> 2195310 T4048 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 4
[junit4] 2> 2195310 T4048 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2195312 T3998 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "node_name":"127.0.0.1:56933_ugpw",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "roles":null,
[junit4] 2> "operation":"state",
[junit4] 2> "shard":null,
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:56933/ugpw"}
[junit4] 2> 2195318 T3998 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 2195321 T3998 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 2195331 T3998 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/collection1/state.json
[junit4] 2> 2195333 T4027 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating...
[junit4] 2> 2195333 T4047 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating...
[junit4] 2> 2195334 T4027 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 5
[junit4] 2> 2195334 T4047 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 5
[junit4] 2> 2196437 T4048 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 2196437 T4048 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 2196438 T4048 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 2196440 T4048 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 2196441 T4048 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2196442 T4048 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-004\collection1\'
[junit4] 2> 2196445 T4048 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001/tempDir-004/collection1/lib/.svn/' to classloader
[junit4] 2> 2196446 T4048 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001/tempDir-004/collection1/lib/classes/' to classloader
[junit4] 2> 2196448 T4048 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001/tempDir-004/collection1/lib/README' to classloader
[junit4] 2> 2196528 T4048 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
[junit4] 2> 2196587 T4048 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2196590 T4048 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 2196615 T4048 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 2197057 T4048 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2197061 T4048 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2197063 T4048 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2197069 T4048 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2197112 T4048 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 2197112 T4048 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 2197112 T4048 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-004\collection1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-001/jetty2\
[junit4] 2> 2197114 T4048 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@78900845
[junit4] 2> 2197116 T4048 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-001\jetty2
[junit4] 2> 2197117 T4048 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-001/jetty2\index/
[junit4] 2> 2197117 T4048 oasc.SolrCore.initIndex WARN [collection1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-001\jetty2\index' doesn't exist. Creating new index...
[junit4] 2> 2197119 T4048 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-001\jetty2\index
[junit4] 2> 2197120 T4048 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=26, maxMergeAtOnceExplicit=21, maxMergedSegmentMB=74.3994140625, floorSegmentMB=0.2451171875, forceMergeDeletesPctAllowed=21.877032830230924, segmentsPerTier=46.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.70661642771861
[junit4] 2> 2197156 T4048 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-001\jetty2\index,segFN=segments_1,generation=1}
[junit4] 2> 2197156 T4048 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2197167 T4048 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 2197169 T4048 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 2197169 T4048 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2197169 T4048 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 2197170 T4048 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2197170 T4048 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 2197171 T4048 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2197171 T4048 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2197172 T4048 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 2197172 T4048 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2197174 T4048 oasc.RequestHandlers.initHandlersFromConfig created /config: org.apache.solr.handler.SolrConfigHandler
[junit4] 2> 2197174 T4048 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2197175 T4048 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 2197175 T4048 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 2197176 T4048 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 2197176 T4048 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 2197176 T4048 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 2197177 T4048 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 2197177 T4048 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 2197179 T4048 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 2197179 T4048 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 2197187 T4048 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2197190 T4048 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2197193 T4048 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2197195 T4048 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2197202 T4048 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 2197202 T4048 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 2197204 T4048 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=33, maxMergeAtOnceExplicit=48, maxMergedSegmentMB=51.18359375, floorSegmentMB=1.099609375, forceMergeDeletesPctAllowed=27.14054831119371, segmentsPerTier=12.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 2197204 T4048 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-001\jetty2\index,segFN=segments_1,generation=1}
[junit4] 2> 2197204 T4048 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2197205 T4048 oass.SolrIndexSearcher.<init> Opening Searcher@67f34e4e[collection1] main
[junit4] 2> 2197205 T4048 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 2197208 T4048 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2197208 T4048 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 2197209 T4048 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 2197209 T4048 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 2197210 T4048 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2197213 T4048 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json
[junit4] 2> 2197213 T4048 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2197213 T4048 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed
[junit4] 2> 2197213 T4048 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 2197216 T4049 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@67f34e4e[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2197217 T4048 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 2197218 T4052 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:56933/ugpw collection:collection1 shard:shard2
[junit4] 2> 2197220 T3968 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
[junit4] 2> 2197220 T3968 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 2197223 T4052 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 2197232 T4052 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 2197236 T3997 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 2197237 T4052 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 2197237 T4052 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C15984 name=collection1 org.apache.solr.core.SolrCore@1736844b url=https://127.0.0.1:56933/ugpw/collection1 node=127.0.0.1:56933_ugpw C15984_STATE=coll:collection1 core:collection1 props:{core=collection1, node_name=127.0.0.1:56933_ugpw, state=down, base_url=https://127.0.0.1:56933/ugpw}
[junit4] 2> 2197237 T4052 C15984 P56933 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:56933/ugpw/collection1/
[junit4] 2> 2197237 T4052 C15984 P56933 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 2197237 T4052 C15984 P56933 oasc.SyncStrategy.syncToMe https://127.0.0.1:56933/ugpw/collection1/ has no replicas
[junit4] 2> 2197238 T4052 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:56933/ugpw/collection1/ shard2
[junit4] 2> 2197238 T4052 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 2197261 T3998 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/collection1/state.json
[junit4] 2> 2197263 T4047 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating...
[junit4] 2> 2197263 T4027 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating...
[junit4] 2> 2197267 T4027 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 6
[junit4] 2> 2197267 T4047 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 6
[junit4] 2> 2197283 T3997 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 2197285 T3998 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/collection1/state.json
[junit4] 2> 2197286 T4047 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating...
[junit4] 2> 2197288 T4027 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating...
[junit4] 2> 2197289 T4047 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 7
[junit4] 2> 2197290 T4027 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 7
[junit4] 2> 2197313 T4052 oasc.ZkController.register We are https://127.0.0.1:56933/ugpw/collection1/ and leader is https://127.0.0.1:56933/ugpw/collection1/
[junit4] 2> 2197313 T4052 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:56933/ugpw
[junit4] 2> 2197313 T4052 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 2197313 T4052 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 2197313 T4052 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 2197316 T3997 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 2197328 T4052 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 7
[junit4] 2> 2197329 T3998 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "node_name":"127.0.0.1:56933_ugpw",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "roles":null,
[junit4] 2> "core_node_name":"core_node2",
[junit4] 2> "operation":"state",
[junit4] 2> "shard":"shard2",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:56933/ugpw"}
[junit4] 2> 2197347 T3998 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/collection1/state.json
[junit4] 2> 2197349 T4047 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating...
[junit4] 2> 2197349 T4027 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating...
[junit4] 2> 2197350 T4047 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 8
[junit4] 2> 2197351 T4027 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 8
[junit4] 2> 2199012 T3968 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 2199012 T3968 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2199020 T3968 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 2199024 T3968 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:56942
[junit4] 2> 2199029 T3968 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 2199030 T3968 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 2199030 T3968 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-005
[junit4] 2> 2199030 T3968 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-005\'
[junit4] 2> 2199067 T3968 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-005\solr.xml
[junit4] 2> 2199137 T3968 oasc.CoreContainer.<init> New CoreContainer 1131504597
[junit4] 2> 2199137 T3968 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-3DCF993F0F4631A6-001\tempDir-005\]
[junit4] 2> 2199140 T3968 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 2199140 T3968 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 2199140 T3968 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 2199140 T3968 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 2199140 T3968 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
[junit4] 2> 2199140 T3968 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 2199140 T3968 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 2199140 T3968 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 2199140 T3968 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 2199140 T3968 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 2199144 T3968 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 2199162 T3968 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2199162 T3968 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2199162 T3968 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 2199162 T3968 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:56899/solr
[junit4] 2> 2199162 T3968 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 2199162 T3968 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 2199165 T3968 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2199168 T4064 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@652fee0e name:ZooKeeperConnection Watcher:127.0.0.1:56899 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2199169 T3968 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[
[...truncated too long message...]
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 34) Thread[id=4050, name=Thread-807, state=WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4] 2> at java.lang.Object.wait(Native Method)
[junit4] 2> at java.lang.Object.wait(Object.java:503)
[junit4] 2> at org.apache.solr.core.CloserThread.run(CoreContainer.java:925)
[junit4] 2> 35) Thread[id=3983, name=HashSessionScavenger-53, state=TERMINATED, group={null group}]
[junit4] 2> at java.lang.Object.wait(Native Method)
[junit4] 2> at java.util.TimerThread.mainLoop(Timer.java:552)
[junit4] 2> at java.util.TimerThread.run(Timer.java:505)
[junit4] 2> 36) Thread[id=4052, name=coreZkRegister-1232-thread-1, state=WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
[junit4] 2> at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 37) Thread[id=4101, name=commitScheduler-1258-thread-1, state=WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
[junit4] 2> at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1079)
[junit4] 2> at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 38) Thread[id=4814, name=zkCallback-1141-thread-115, state=TIMED_WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
[junit4] 2> at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] 2> at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)
[junit4] 2> at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 39) Thread[id=4099, name=commitScheduler-1240-thread-1, state=WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
[junit4] 2> at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1079)
[junit4] 2> at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 40) Thread[id=4092, name=coreZkRegister-1250-thread-1, state=WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
[junit4] 2> at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene50): {_version_=Lucene50(blocksize=128), id=PostingsFormat(name=LuceneFixedGap), a_t=Lucene50(blocksize=128), a_i=PostingsFormat(name=LuceneFixedGap), rnd_b=PostingsFormat(name=LuceneFixedGap)}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=pt, timezone=Atlantic/Canary
[junit4] 2> NOTE: Windows 7 6.1 amd64/Oracle Corporation 1.7.0_67 (64-bit)/cpus=2,threads=78,free=158271320,total=262578176
[junit4] 2> NOTE: All tests run in this JVM: [TestManagedResource, TestModifyConfFiles, TestTolerantSearch, SOLR749Test, AnalysisAfterCoreReloadTest, TestTrie, LoggingHandlerTest, URLClassifyProcessorTest, CursorPagingTest, TestConfigOverlay, SolrXmlInZkTest, HdfsWriteToMultipleCollectionsTest, HighlighterMaxOffsetTest, MergeStrategyTest, TestQueryUtils, DistributedSuggestComponentTest, AliasIntegrationTest, FieldAnalysisRequestHandlerTest, PreAnalyzedUpdateProcessorTest, TestSchemaSimilarityResource, ResponseLogComponentTest, BasicFunctionalityTest, DOMUtilTest, StressHdfsTest, TestStandardQParsers, TestMergePolicyConfig, DocValuesMissingTest, HdfsUnloadDistributedZkTest, ZkSolrClientTest, TestCloudManagedSchemaConcurrent, TestSolr4Spatial, TestCSVLoader, OverseerTest, AddSchemaFieldsUpdateProcessorFactoryTest, FileBasedSpellCheckerTest, TestNonDefinedSimilarityFactory, TestNRTOpen, TestManagedSchemaFieldTypeResource, SoftAutoCommitTest, CurrencyFieldXmlFileTest, TestPhraseSuggestions, TestOrdValues, OutputWriterTest, TestCloudManagedSchema, DistributedFacetPivotWhiteBoxTest, TestOmitPositions, TestCloudInspectUtil, TestCollectionAPI, CurrencyFieldOpenExchangeTest, PreAnalyzedFieldTest, TestUtils, TestExceedMaxTermLength, CoreAdminCreateDiscoverTest, TestFoldingMultitermQuery, IndexSchemaRuntimeFieldTest, TestSchemaVersionResource, FacetPivotSmallTest, ShardSplitTest, TestCollapseQParserPlugin, DocValuesTest, ChaosMonkeySafeLeaderTest]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ChaosMonkeySafeLeaderTest -Dtests.seed=3DCF993F0F4631A6 -Dtests.slow=true -Dtests.locale=pt -Dtests.timezone=Atlantic/Canary -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] ERROR 0.00s | ChaosMonkeySafeLeaderTest (suite) <<<
[junit4] > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
[junit4] > at __randomizedtesting.SeedInfo.seed([3DCF993F0F4631A6]:0)
[junit4] Completed in 7354.46s, 1 test, 2 errors <<< FAILURES!
[...truncated 1167 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:525: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:473: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:61: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\extra-targets.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build.xml:186: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\common-build.xml:508: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:1358: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:965: There were test failures: 448 suites, 1821 tests, 1 suite-level error, 1 error, 1433 ignored (17 assumptions)
Total time: 207 minutes 20 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 64bit/jdk1.7.0_67 -XX:-UseCompressedOops -XX:+UseSerialGC (asserts: true)
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any