You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/02/15 10:12:14 UTC
[JENKINS] Lucene-Solr-4.x-Windows (32bit/jdk1.6.0_45) - Build #
3705 - Still Failing!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Windows/3705/
Java: 32bit/jdk1.6.0_45 -server -XX:+UseConcMarkSweepGC
2 tests failed.
REGRESSION: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.testDistribSearch
Error Message:
Test abandoned because suite timeout was reached.
Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
at __randomizedtesting.SeedInfo.seed([79F9838B3C2FECA5]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
Error Message:
Suite timeout exceeded (>= 7200000 msec).
Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
at __randomizedtesting.SeedInfo.seed([79F9838B3C2FECA5]:0)
Build Log:
[...truncated 9795 lines...]
[junit4] Suite: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
[junit4] 2> 1080400 T3700 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (true)
[junit4] 2> 1080401 T3700 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4] 2> 1080407 T3700 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-ChaosMonkeySafeLeaderTest-1392446878736
[junit4] 2> 1080413 T3700 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 1080414 T3701 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 1080524 T3700 oasc.ZkTestServer.run start zk server on port:64565
[junit4] 2> 1080528 T3700 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1080543 T3707 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6a6cc6 name:ZooKeeperConnection Watcher:127.0.0.1:64565 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1080544 T3700 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1080544 T3700 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 1080563 T3702 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x144344d341c0000, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2>
[junit4] 2> 1080567 T3700 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1080575 T3709 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b0af09 name:ZooKeeperConnection Watcher:127.0.0.1:64565/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1080576 T3700 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1080576 T3700 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 1080595 T3700 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 1080612 T3700 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 1080628 T3700 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 1080645 T3700 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1080645 T3700 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 1080676 T3700 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 1080677 T3700 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 1080696 T3700 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1080696 T3700 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1080714 T3700 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1080715 T3700 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 1080731 T3700 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1080734 T3700 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 1080754 T3700 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1080754 T3700 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 1080774 T3700 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 1080774 T3700 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 1080793 T3700 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1080793 T3700 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 1080812 T3700 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1080812 T3700 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1080830 T3700 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1080831 T3700 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 1080851 T3700 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1080852 T3700 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 1080878 T3700 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1080885 T3711 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1287ee6 name:ZooKeeperConnection Watcher:127.0.0.1:64565/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1080886 T3700 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1081420 T3700 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1081426 T3700 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1] of [SSLv2Hello, SSLv3, TLSv1]
[junit4] 2> 1081429 T3700 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:64575
[junit4] 2> 1081432 T3700 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1081432 T3700 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1081432 T3700 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1392446879220
[junit4] 2> 1081432 T3700 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1392446879220\'
[junit4] 2> 1081470 T3700 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1392446879220\solr.xml
[junit4] 2> 1081566 T3700 oasc.CoreContainer.<init> New CoreContainer 19874081
[junit4] 2> 1081567 T3700 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1392446879220\]
[junit4] 2> 1081569 T3700 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1081569 T3700 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1081569 T3700 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1081570 T3700 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1081570 T3700 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1081570 T3700 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1081570 T3700 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1081571 T3700 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1081571 T3700 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1081582 T3700 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1081582 T3700 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1081582 T3700 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1081583 T3700 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:64565/solr
[junit4] 2> 1081583 T3700 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1081586 T3700 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1081599 T3722 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@11737f3 name:ZooKeeperConnection Watcher:127.0.0.1:64565 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1081599 T3700 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1081603 T3702 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x144344d341c0003, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2>
[junit4] 2> 1081604 T3700 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1081608 T3724 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@15a0518 name:ZooKeeperConnection Watcher:127.0.0.1:64565/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1081608 T3700 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1081612 T3700 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 1081622 T3700 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 1081635 T3700 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 1081639 T3700 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:64575_
[junit4] 2> 1081641 T3700 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:64575_
[junit4] 2> 1081650 T3700 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 1081657 T3700 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 1081667 T3700 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:64575_
[junit4] 2> 1081667 T3700 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 1081674 T3700 oasc.Overseer.start Overseer (id=91255398645628932-127.0.0.1:64575_-n_0000000000) starting
[junit4] 2> 1081683 T3700 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 1081693 T3726 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 1081694 T3700 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 1081697 T3726 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
[junit4] 2> 1081703 T3700 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 1081708 T3700 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1081716 T3725 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 1081722 T3727 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 1081722 T3727 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1081725 T3724 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1081725 T3727 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1081729 T3725 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1081730 T3725 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:64575",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:64575_",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1081730 T3725 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 1081730 T3725 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 1081747 T3724 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1081749 T3724 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1082705 T3727 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1082706 T3727 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: .\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1392446879220\collection1
[junit4] 2> 1082706 T3727 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 1082709 T3727 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1082709 T3727 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 1082715 T3727 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1082715 T3727 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1392446879220\collection1\'
[junit4] 2> 1082719 T3727 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1392446879220/collection1/lib/classes/' to classloader
[junit4] 2> 1082722 T3727 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1392446879220/collection1/lib/README' to classloader
[junit4] 2> 1082809 T3727 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 1082887 T3727 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1082893 T3727 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1082901 T3727 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1083628 T3727 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1083634 T3727 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1083636 T3727 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1083642 T3727 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1083700 T3727 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 1083701 T3727 oasc.SolrCore.<init> [collection1] Opening new SolrCore at .\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1392446879220\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392446878733/control/data\
[junit4] 2> 1083701 T3727 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@c2e2dd
[junit4] 2> 1083703 T3727 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392446878733\control\data
[junit4] 2> 1083704 T3727 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392446878733/control/data\index/
[junit4] 2> 1083705 T3727 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392446878733\control\data\index' doesn't exist. Creating new index...
[junit4] 2> 1083705 T3727 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392446878733\control\data\index
[junit4] 2> 1083706 T3727 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=30, maxMergeAtOnceExplicit=18, maxMergedSegmentMB=56.94921875, floorSegmentMB=0.3388671875, forceMergeDeletesPctAllowed=15.397295318560499, segmentsPerTier=39.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 1083712 T3727 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392446878733\control\data\index,segFN=segments_1,generation=1}
[junit4] 2> 1083712 T3727 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1083715 T3727 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1083716 T3727 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1083716 T3727 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1083716 T3727 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1083717 T3727 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1083717 T3727 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1083718 T3727 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1083718 T3727 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1083718 T3727 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1083719 T3727 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1083719 T3727 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 1083719 T3727 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 1083719 T3727 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 1083721 T3727 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 1083721 T3727 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 1083722 T3727 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 1083728 T3727 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1083734 T3727 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1083734 T3727 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1083734 T3727 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=34, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 1083734 T3727 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392446878733\control\data\index,segFN=segments_1,generation=1}
[junit4] 2> 1083734 T3727 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1083734 T3727 oass.SolrIndexSearcher.<init> Opening Searcher@16aa707[collection1] main
[junit4] 2> 1083740 T3727 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1083741 T3700 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4] 2> 1083741 T3700 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1083748 T3700 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1083748 T3728 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@16aa707[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 1083749 T3731 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:64575 collection:control_collection shard:shard1
[junit4] 2> 1083752 T3731 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 1083762 T3733 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@12b1730 name:ZooKeeperConnection Watcher:127.0.0.1:64565/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1083762 T3700 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1083767 T3700 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1083777 T3700 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 1083780 T3731 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 1083795 T3724 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1083800 T3731 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 1083800 T3731 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C3067 name=collection1 org.apache.solr.core.SolrCore@c38ca8 url=https://127.0.0.1:64575/collection1 node=127.0.0.1:64575_ C3067_STATE=coll:control_collection core:collection1 props:{state=down, base_url=https://127.0.0.1:64575, core=collection1, node_name=127.0.0.1:64575_}
[junit4] 2> 1083800 T3731 C3067 P64575 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:64575/collection1/
[junit4] 2> 1083801 T3731 C3067 P64575 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 1083801 T3731 C3067 P64575 oasc.SyncStrategy.syncToMe https://127.0.0.1:64575/collection1/ has no replicas
[junit4] 2> 1083801 T3731 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:64575/collection1/ shard1
[junit4] 2> 1083801 T3731 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 1083806 T3725 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1083823 T3724 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1083828 T3724 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1083829 T3733 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1083848 T3725 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1083858 T3724 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1083972 T3724 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1083972 T3733 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1083992 T3731 oasc.ZkController.register We are https://127.0.0.1:64575/collection1/ and leader is https://127.0.0.1:64575/collection1/
[junit4] 2> 1083992 T3731 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:64575
[junit4] 2> 1083992 T3731 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 1083992 T3731 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 1083992 T3731 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1083995 T3724 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1083995 T3724 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1083995 T3724 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1083999 T3731 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1084002 T3725 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1084004 T3725 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:64575",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:64575_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 1084012 T3724 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1084116 T3724 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1084117 T3733 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1084293 T3700 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 1084294 T3700 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1084300 T3700 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1] of [SSLv2Hello, SSLv3, TLSv1]
[junit4] 2> 1084303 T3700 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:64587
[junit4] 2> 1084306 T3700 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1084306 T3700 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1084306 T3700 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1392446882102
[junit4] 2> 1084308 T3700 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1392446882102\'
[junit4] 2> 1084336 T3700 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1392446882102\solr.xml
[junit4] 2> 1084425 T3700 oasc.CoreContainer.<init> New CoreContainer 30009212
[junit4] 2> 1084425 T3700 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1392446882102\]
[junit4] 2> 1084428 T3700 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1084428 T3700 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1084428 T3700 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1084428 T3700 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1084428 T3700 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1084428 T3700 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1084428 T3700 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1084428 T3700 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1084428 T3700 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1084439 T3700 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1084439 T3700 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1084439 T3700 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1084439 T3700 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:64565/solr
[junit4] 2> 1084439 T3700 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1084442 T3700 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1084448 T3744 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1df2169 name:ZooKeeperConnection Watcher:127.0.0.1:64565 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1084448 T3700 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1084451 T3702 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x144344d341c0006, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2>
[junit4] 2> 1084452 T3700 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1084456 T3746 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@23fdae name:ZooKeeperConnection Watcher:127.0.0.1:64565/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1084456 T3700 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1084469 T3700 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1085458 T3700 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:64587_
[junit4] 2> 1085465 T3700 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:64587_
[junit4] 2> 1085484 T3724 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 1085486 T3733 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 1085487 T3746 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 1085517 T3747 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 1085518 T3747 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1085522 T3724 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1085523 T3724 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1085524 T3724 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1085522 T3747 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1085533 T3725 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1085536 T3725 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:64587",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:64587_",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1085536 T3725 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3]
[junit4] 2> 1085536 T3725 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 1085551 T3724 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1085661 T3746 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1085662 T3733 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1085662 T3724 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1086505 T3747 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1086505 T3747 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1392446882102\collection1
[junit4] 2> 1086505 T3747 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 1086509 T3747 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1086509 T3747 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1086514 T3747 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1086514 T3747 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1392446882102\collection1\'
[junit4] 2> 1086516 T3747 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1392446882102/collection1/lib/classes/' to classloader
[junit4] 2> 1086516 T3747 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1392446882102/collection1/lib/README' to classloader
[junit4] 2> 1086601 T3747 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 1086692 T3747 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1086696 T3747 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1086705 T3747 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1087433 T3747 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1087437 T3747 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1087439 T3747 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1087446 T3747 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1087525 T3747 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 1087526 T3747 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1392446882102\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392446878733/jetty1\
[junit4] 2> 1087526 T3747 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@c2e2dd
[junit4] 2> 1087526 T3747 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392446878733\jetty1
[junit4] 2> 1087526 T3747 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392446878733/jetty1\index/
[junit4] 2> 1087528 T3747 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392446878733\jetty1\index' doesn't exist. Creating new index...
[junit4] 2> 1087528 T3747 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392446878733\jetty1\index
[junit4] 2> 1087530 T3747 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=30, maxMergeAtOnceExplicit=18, maxMergedSegmentMB=56.94921875, floorSegmentMB=0.3388671875, forceMergeDeletesPctAllowed=15.397295318560499, segmentsPerTier=39.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 1087536 T3747 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392446878733\jetty1\index,segFN=segments_1,generation=1}
[junit4] 2> 1087536 T3747 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1087540 T3747 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1087541 T3747 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1087541 T3747 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1087541 T3747 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1087541 T3747 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1087541 T3747 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1087543 T3747 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1087543 T3747 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1087543 T3747 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1087544 T3747 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1087544 T3747 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 1087544 T3747 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 1087544 T3747 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 1087546 T3747 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 1087546 T3747 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 1087547 T3747 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 1087550 T3747 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1087557 T3747 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1087557 T3747 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1087557 T3747 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=34, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 1087557 T3747 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392446878733\jetty1\index,segFN=segments_1,generation=1}
[junit4] 2> 1087560 T3747 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1087560 T3747 oass.SolrIndexSearcher.<init> Opening Searcher@126eeff[collection1] main
[junit4] 2> 1087564 T3748 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@126eeff[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 1087567 T3747 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1087568 T3700 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4] 2> 1087569 T3700 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1087568 T3751 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:64587 collection:collection1 shard:shard1
[junit4] 2> 1087573 T3751 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 1087597 T3751 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 1087604 T3724 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1087604 T3724 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1087604 T3724 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1087608 T3751 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 1087608 T3751 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C3068 name=collection1 org.apache.solr.core.SolrCore@10c412c url=https://127.0.0.1:64587/collection1 node=127.0.0.1:64587_ C3068_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:64587, core=collection1, node_name=127.0.0.1:64587_}
[junit4] 2> 1087608 T3751 C3068 P64587 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:64587/collection1/
[junit4] 2> 1087608 T3751 C3068 P64587 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 1087608 T3751 C3068 P64587 oasc.SyncStrategy.syncToMe https://127.0.0.1:64587/collection1/ has no replicas
[junit4] 2> 1087608 T3751 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:64587/collection1/ shard1
[junit4] 2> 1087608 T3751 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 1087614 T3725 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1087637 T3724 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1087641 T3724 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1087641 T3733 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1087642 T3746 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1087662 T3725 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1087682 T3724 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1087789 T3724 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1087790 T3733 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1087790 T3746 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1087803 T3751 oasc.ZkController.register We are https://127.0.0.1:64587/collection1/ and leader is https://127.0.0.1:64587/collection1/
[junit4] 2> 1087803 T3751 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:64587
[junit4] 2> 1087803 T3751 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 1087803 T3751 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 1087803 T3751 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1087806 T3724 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1087806 T3724 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1087806 T3724 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1087810 T3751 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1087815 T3725 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1087816 T3725 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:64587",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:64587_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 1087825 T3724 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1087930 T3746 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1087930 T3724 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1087931 T3733 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1088095 T3700 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 1088095 T3700 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1088102 T3700 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1] of [SSLv2Hello, SSLv3, TLSv1]
[junit4] 2> 1088105 T3700 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:64596
[junit4] 2> 1088107 T3700 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1088107 T3700 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1088108 T3700 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1392446885896
[junit4] 2> 1088117 T3700 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1392446885896\'
[junit4] 2> 1088152 T3700 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1392446885896\solr.xml
[junit4] 2> 1088237 T3700 oasc.CoreContainer.<init> New CoreContainer 33302505
[junit4] 2> 1088237 T3700 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1392446885896\]
[junit4] 2> 1088240 T3700 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1088240 T3700 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1088240 T3700 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1088240 T3700 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1088240 T3700 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1088241 T3700 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1088241 T3700 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1088241 T3700 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1088241 T3700 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1088249 T3700 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1088249 T3700 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1088249 T3700 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1088249 T3700 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:64565/solr
[junit4] 2> 1088249 T3700 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1088253 T3700 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1088259 T3762 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@196311 name:ZooKeeperConnection Watcher:127.0.0.1:64565 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1088259 T3700 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1088263 T3702 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x144344d341c0008, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2>
[junit4] 2> 1088263 T3700 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1088266 T3764 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d4511 name:ZooKeeperConnection Watcher:127.0.0.1:64565/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1088267 T3700 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1088280 T3700 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1089267 T3700 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:64596_
[junit4] 2> 1089274 T3700 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:64596_
[junit4] 2> 1089291 T3724 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1089293 T3733 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1089296 T3746 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1089297 T3764 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1089331 T3765 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 1089332 T3765 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1089335 T3724 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1089335 T3724 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1089335 T3724 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1089337 T3765 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1089346 T3725 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1089349 T3725 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:64596",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:64596_",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1089349 T3725 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 1089350 T3725 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 1089365 T3724 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1089476 T3724 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1089477 T3733 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1089478 T3764 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1089478 T3746 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1090317 T3765 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1090318 T3765 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: .\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1392446885896\collection1
[junit4] 2> 1090318 T3765 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 1090322 T3765 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1090322 T3765 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1090328 T3765 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1090328 T3765 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1392446885896\collection1\'
[junit4] 2> 1090332 T3765 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1392446885896/collection1/lib/classes/' to classloader
[junit4] 2> 1090335 T3765 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1392446885896/collection1/lib/README' to classloader
[junit4] 2> 1090432 T3765 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 1090515 T3765 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1090520 T3765 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1090530 T3765 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1091279 T3765 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1091283 T3765 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1091285 T3765 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1091293 T3765 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1091354 T3765 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 1091354 T3765 oasc.SolrCore.<init> [collection1] Opening new SolrCore at .\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1392446885896\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392446878733/jetty2\
[junit4] 2> 1091354 T3765 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@c2e2dd
[junit4] 2> 1091354 T3765 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392446878733\jetty2
[junit4] 2> 1091356 T3765 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392446878733/jetty2\index/
[junit4] 2> 1091357 T3765 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392446878733\jetty2\index' doesn't exist. Creating new index...
[junit4] 2> 1091357 T3765 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392446878733\jetty2\index
[junit4] 2> 1091359 T3765 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=30, maxMergeAtOnceExplicit=18, maxMergedSegmentMB=56.94921875, floorSegmentMB=0.3388671875, forceMergeDeletesPctAllowed=15.397295318560499, segmentsPerTier=39.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 1091365 T3765 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392446878733\jetty2\index,segFN=segments_1,generation=1}
[junit4] 2> 1091365 T3765 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1091368 T3765 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1091371 T3765 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1091372 T3765 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1091372 T3765 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1091372 T3765 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1091372 T3765 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1091373 T3765 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1091373 T3765 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1091373 T3765 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1091374 T3765 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1091374 T3765 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 1091375 T3765 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 1091375 T3765 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 1091376 T3765 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 1091376 T3765 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 1091377 T3765 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 1091387 T3765 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1091395 T3765 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1091395 T3765 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1091396 T3765 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=34, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 1091398 T3765 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392446878733\jetty2\index,segFN=segments_1,generation=1}
[junit4] 2> 1091398 T3765 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1091398 T3765 oass.SolrIndexSearcher.<init> Opening Searcher@f5ae96[collection1] main
[junit4] 2> 1091402 T3766 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@f5ae96[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 1091405 T3765 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1091406 T3700 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4] 2> 1091406 T3700 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1091406 T3769 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:64596 collection:collection1 shard:shard2
[junit4] 2> 1091410 T3769 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 1091439 T3769 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 1091446 T3724 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1091446 T3724 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1091447 T3724 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1091450 T3769 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 1091450 T3769 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C3069 name=collection1 org.apache.solr.core.SolrCore@3806a1 url=https://127.0.0.1:64596/collection1 node=127.0.0.1:64596_ C3069_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:64596, core=collection1, node_name=127.0.0.1:64596_}
[junit4] 2> 1091450 T3769 C3069 P64596 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:64596/collection1/
[junit4] 2> 1091450 T3769 C3069 P64596 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 1091450 T3769 C3069 P64596 oasc.SyncStrategy.syncToMe https://127.0.0.1:64596/collection1/ has no replicas
[junit4] 2> 1091450 T3769 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:64596/collection1/ shard2
[junit4] 2> 1091450 T3769 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 1091457 T3725 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1091482 T3724 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1091494 T3746 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1091494 T3764 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1091495 T3724 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1091495 T3733 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1091515 T3725 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1091525 T3724 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1091631 T3764 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1091632 T3724 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1091632 T3733 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1091633 T3746 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1091657 T3769 oasc.ZkController.register We are https://127.0.0.1:64596/collection1/ and leader is https://127.0.0.1:64596/collection1/
[junit4] 2> 1091657 T3769 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:64596
[junit4] 2> 1091657 T3769 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 1091657 T3769 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 1091657 T3769 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1091664 T3724 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1091664 T3724 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1091664 T3724 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1091668 T3769 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1091673 T3725 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1091674 T3725 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:64596",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:64596_",
[junit4] 2> "shard":"shard2",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":"core_node2"}
[junit4] 2> 1091681 T3724 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1091789 T3764 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1091789 T3724 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1091791 T3746 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1091792 T3733 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1091943 T3700 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 1091944 T3700 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1091949 T3700 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1] of [SSLv2Hello, SSLv3, TLSv1]
[junit4] 2> 1091951 T3700 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:64605
[junit4] 2> 1091954 T3700 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1091954 T3700 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1091954 T3700 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1392446889735
[junit4] 2> 1091954 T3700 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1392446889735\'
[junit4] 2> 1091987 T3700 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1392446889735\solr.xml
[junit4] 2> 1092083 T3700 oasc.CoreContainer.<init> New CoreContainer 13965824
[junit4] 2> 1092084 T3700 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1392446889735\]
[junit4] 2> 1092087 T3700 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1092087 T3700 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1092088 T3700 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1092088 T3700 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1092088 T3700 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1092089 T3700 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1092089 T3700 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1092090 T3700 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1092090 T3700 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1092099 T3700 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1092100 T3700 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1092100 T3700 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1092101 T3700 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:64565/solr
[junit4] 2> 1092101 T3700 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1092103 T3700 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1092111 T3780 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1685f34 name:ZooKeeperConnection Watcher:127.0.0.1:64565 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1092112 T3700 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1092116 T3702 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x144344d341c000a, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2>
[junit4] 2> 1092117 T3700 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1092121 T3782 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e74a0c name:ZooKeeperConnection Watcher:127.0.0.1:64565/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1092121 T3700 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1092136 T3700 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1093146 T3700 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:64605_
[junit4] 2> 1093151 T3700 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:64605_
[junit4] 2> 1093170 T3724 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1093176 T3764 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1093177 T3746 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1093178 T3733 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1093182 T3782 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1093217 T3783 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 1093217 T3783 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1093223 T3724 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1093223 T3724 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1093223 T3783 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1093223 T3724 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1093234 T3725 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1093237 T3725 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:64605",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:64605_",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1093238 T3725 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 1093238 T3725 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
[junit4] 2> 1093253 T3724 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1093365 T3764 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 1093365 T3733 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 1093366 T3724 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 1093367 T3746 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 1093369 T3782 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 1094224 T3783 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1094224 T3783 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1392446889735\collection1
[junit4] 2> 1094224 T3783 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 1094229 T3783 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1094230 T3783 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1094236 T3783 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1094236 T3783 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1392446889735\collection1\'
[junit4] 2> 1094237 T3783 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1392446889735/collection1/lib/classes/' to classloader
[junit4] 2> 1094237 T3783 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1392446889735/collection1/lib/README' to classloader
[junit4] 2> 1094323 T3783 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 1094428 T3783 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1094431 T3783 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1094446 T3783 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1095148 T3783 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1095154 T3783 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1095156 T3783 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1095166 T3783 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2>
[...truncated too long message...]
.run(Thread.java:662)
[junit4] 2> 88) Thread[id=3976, name=commitScheduler-2283-thread-1, state=WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:156)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
[junit4] 2> at java.util.concurrent.DelayQueue.take(DelayQueue.java:160)
[junit4] 2> at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
[junit4] 2> at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:957)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2> 89) Thread[id=3977, name=commitScheduler-2339-thread-1, state=WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:156)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
[junit4] 2> at java.util.concurrent.DelayQueue.take(DelayQueue.java:160)
[junit4] 2> at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
[junit4] 2> at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:957)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2> 90) Thread[id=3767, name=Thread-1836, state=WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4] 2> at java.lang.Object.wait(Native Method)
[junit4] 2> at java.lang.Object.wait(Object.java:485)
[junit4] 2> at org.apache.solr.core.CloserThread.run(CoreContainer.java:1018)
[junit4] 2> 91) Thread[id=3909, name=HashSessionScavenger-140, state=TIMED_WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4] 2> at java.lang.Object.wait(Native Method)
[junit4] 2> at java.util.TimerThread.mainLoop(Timer.java:509)
[junit4] 2> at java.util.TimerThread.run(Timer.java:462)
[junit4] 2> 92) Thread[id=3784, name=searcherExecutor-2280-thread-1, state=WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:156)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
[junit4] 2> at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:957)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2> 93) Thread[id=3904, name=searcherExecutor-2328-thread-1, state=WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:156)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
[junit4] 2> at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:957)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:917)
[junit4] 2> at java.lang.Thread.run(Thread.java:662)
[junit4] 2> NOTE: test params are: codec=Lucene3x, sim=RandomSimilarityProvider(queryNorm=false,coord=no): {}, locale=vi_VN, timezone=America/Argentina/Cordoba
[junit4] 2> NOTE: Windows 7 6.1 x86/Sun Microsystems Inc. 1.6.0_45 (32-bit)/cpus=2,threads=150,free=100640792,total=315064320
[junit4] 2> NOTE: All tests run in this JVM: [SpatialFilterTest, IndexSchemaRuntimeFieldTest, TestSweetSpotSimilarityFactory, SpellCheckCollatorTest, TestValueSourceCache, ChangedSchemaMergeTest, SolrPluginUtilsTest, CoreAdminCreateDiscoverTest, TestRandomDVFaceting, InfoHandlerTest, SliceStateTest, TestConfig, DistributedDebugComponentTest, UUIDFieldTest, BinaryUpdateRequestHandlerTest, TestComponentsName, TestSchemaResource, ClusterStateUpdateTest, TestDFRSimilarityFactory, DOMUtilTest, SuggesterWFSTTest, TestLFUCache, StressHdfsTest, TestBadConfig, TestStandardQParsers, URLClassifyProcessorTest, TestFastWriter, TestRTGBase, ShardRoutingTest, TestClassNameShortening, TestRandomMergePolicy, DistributedSpellCheckComponentTest, DistanceFunctionTest, TestSolrDeletionPolicy2, TestMultiCoreConfBootstrap, CoreContainerCoreInitFailuresTest, TestStressVersions, SimplePostToolTest, TestDefaultSimilarityFactory, PolyFieldTest, DirectSolrSpellCheckerTest, TestSchemaNameResource, TestWriterPerf, DistributedQueryComponentCustomSortTest, TestSuggestSpellingConverter, TestOmitPositions, SuggesterTest, TestMaxScoreQueryParser, TestSolrXMLSerializer, RequestHandlersTest, EchoParamsTest, BasicDistributedZk2Test, SolrIndexConfigTest, TestAnalyzedSuggestions, TestLMDirichletSimilarityFactory, TestInitQParser, TestOverriddenPrefixQueryForCustomFieldType, StatsComponentTest, TestNonNRTOpen, DisMaxRequestHandlerTest, CoreAdminHandlerTest, TestFileDictionaryLookup, NotRequiredUniqueKeyTest, TestUtils, TestSimpleQParserPlugin, TestSolr4Spatial, TestQuerySenderListener, SchemaVersionSpecificBehaviorTest, BlockCacheTest, MoreLikeThisHandlerTest, UpdateParamsTest, OverseerCollectionProcessorTest, DocValuesMultiTest, ClusterStateTest, ZkCLITest, DefaultValueUpdateProcessorTest, LeaderElectionTest, SortByFunctionTest, SpellingQueryConverterTest, TestInfoStreamLogging, TestArbitraryIndexDir, TestReload, TestDocumentBuilder, TestElisionMultitermQuery, HdfsCollectionsAPIDistributedZkTest, TestIBSimilarityFactory, HighlighterTest, TestFiltering, QueryElevationComponentTest, TermVectorComponentDistributedTest, TestUniqueKeyFieldResource, FullSolrCloudDistribCmdsTest, ShowFileRequestHandlerTest, BasicDistributedZkTest, BasicFunctionalityTest, MultiTermTest, TestBM25SimilarityFactory, SOLR749Test, AnalysisErrorHandlingTest, RAMDirectoryFactoryTest, TestReloadAndDeleteDocs, TestSolrCoreProperties, TestCustomSort, ConvertedLegacyTest, UpdateRequestProcessorFactoryTest, TestSerializedLuceneMatchVersion, LoggingHandlerTest, TestManagedSchemaFieldResource, TestRealTimeGet, HardAutoCommitTest, TestReplicationHandler, IndexBasedSpellCheckerTest, TestAtomicUpdateErrorCases, MBeansHandlerTest, PreAnalyzedFieldTest, CursorPagingTest, SoftAutoCommitTest, SolrCoreCheckLockOnStartupTest, TestMergePolicyConfig, TestLuceneMatchVersion, ResourceLoaderTest, TestSolrQueryParserDefaultOperatorResource, AddSchemaFieldsUpdateProcessorFactoryTest, CurrencyFieldOpenExchangeTest, TestLRUCache, SignatureUpdateProcessorFactoryTest, DistributedSuggestComponentTest, OutputWriterTest, TestHashPartitioner, FastVectorHighlighterTest, TestAddFieldRealTimeGet, ChaosMonkeySafeLeaderTest]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ChaosMonkeySafeLeaderTest -Dtests.seed=79F9838B3C2FECA5 -Dtests.slow=true -Dtests.locale=vi_VN -Dtests.timezone=America/Argentina/Cordoba -Dtests.file.encoding=US-ASCII
[junit4] ERROR 0.00s | ChaosMonkeySafeLeaderTest (suite) <<<
[junit4] > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
[junit4] > at __randomizedtesting.SeedInfo.seed([79F9838B3C2FECA5]:0)
[junit4] Completed in 7389.95s, 1 test, 2 errors <<< FAILURES!
[...truncated 679 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:459: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:439: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\extra-targets.xml:37: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build.xml:189: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\common-build.xml:491: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:1308: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:941: There were test failures: 362 suites, 1563 tests, 1 suite-level error, 1 error, 1019 ignored (6 assumptions)
Total time: 191 minutes 1 second
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.6.0_45 -server -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-4.x-Windows (32bit/jdk1.7.0_60-ea-b04) -
Build # 3707 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Windows/3707/
Java: 32bit/jdk1.7.0_60-ea-b04 -server -XX:+UseG1GC
1 tests failed.
REGRESSION: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.testDistribSearch
Error Message:
Captured an uncaught exception in thread: Thread[id=6755, name=RecoveryThread, state=RUNNABLE, group=TGRP-ChaosMonkeySafeLeaderTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=6755, name=RecoveryThread, state=RUNNABLE, group=TGRP-ChaosMonkeySafeLeaderTest]
at __randomizedtesting.SeedInfo.seed([FDE582CE1E149C32:7C030CD6694BFC0E]:0)
Caused by: java.lang.AssertionError: file _0_1.del does not exist
at __randomizedtesting.SeedInfo.seed([FDE582CE1E149C32]:0)
at org.apache.lucene.index.IndexWriter.filesExist(IndexWriter.java:4363)
at org.apache.lucene.index.IndexWriter.startCommit(IndexWriter.java:4429)
at org.apache.lucene.index.IndexWriter.prepareCommitInternal(IndexWriter.java:2926)
at org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:3022)
at org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:2989)
at org.apache.solr.update.DirectUpdateHandler2.commit(DirectUpdateHandler2.java:578)
at org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:396)
at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:247)
Build Log:
[...truncated 10541 lines...]
[junit4] Suite: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
[junit4] 2> 1613693 T6314 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (true)
[junit4] 2> 1613693 T6314 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4] 2> 1613703 T6314 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-ChaosMonkeySafeLeaderTest-1392495447960
[junit4] 2> 1613706 T6314 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 1613707 T6315 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 1613819 T6314 oasc.ZkTestServer.run start zk server on port:52520
[junit4] 2> 1613824 T6314 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1613843 T6321 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@18f6175 name:ZooKeeperConnection Watcher:127.0.0.1:52520 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1613844 T6314 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1613844 T6314 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 1613860 T6316 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14437324fa70000, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 1613865 T6314 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1613872 T6323 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5b941a name:ZooKeeperConnection Watcher:127.0.0.1:52520/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1613872 T6314 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1613872 T6314 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 1613889 T6314 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 1613906 T6314 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 1613916 T6314 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 1613931 T6314 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1613932 T6314 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 1613954 T6314 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 1613955 T6314 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 1613970 T6314 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1613970 T6314 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1613985 T6314 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1613988 T6314 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 1614002 T6314 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1614003 T6314 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 1614017 T6314 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1614018 T6314 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 1614032 T6314 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 1614033 T6314 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 1614046 T6314 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1614048 T6314 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 1614062 T6314 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1614062 T6314 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1614082 T6314 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1614084 T6314 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 1614098 T6314 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1614100 T6314 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 1614112 T6316 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14437324fa70001, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 1614114 T6314 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1614123 T6325 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6e0735 name:ZooKeeperConnection Watcher:127.0.0.1:52520/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1614124 T6314 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1614131 T6316 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14437324fa70002, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 1614768 T6314 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1614780 T6314 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 1614787 T6314 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:52530
[junit4] 2> 1614790 T6314 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1614790 T6314 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1614790 T6314 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1392495448386
[junit4] 2> 1614790 T6314 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1392495448386\'
[junit4] 2> 1614828 T6314 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1392495448386\solr.xml
[junit4] 2> 1614907 T6314 oasc.CoreContainer.<init> New CoreContainer 9618272
[junit4] 2> 1614908 T6314 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1392495448386\]
[junit4] 2> 1614909 T6314 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1614910 T6314 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1614910 T6314 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1614910 T6314 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1614911 T6314 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1614911 T6314 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1614912 T6314 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1614913 T6314 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1614913 T6314 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1614927 T6314 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1614929 T6314 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1614929 T6314 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1614930 T6314 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52520/solr
[junit4] 2> 1614930 T6314 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1614933 T6314 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1614945 T6336 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1d1fc93 name:ZooKeeperConnection Watcher:127.0.0.1:52520 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1614945 T6314 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1614952 T6314 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1614957 T6338 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@122fe0d name:ZooKeeperConnection Watcher:127.0.0.1:52520/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1614958 T6314 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1614960 T6314 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 1614967 T6314 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 1614975 T6314 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 1614980 T6314 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52530_
[junit4] 2> 1614983 T6314 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52530_
[junit4] 2> 1614990 T6314 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 1614994 T6314 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 1615003 T6314 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:52530_
[junit4] 2> 1615003 T6314 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 1615008 T6314 oasc.Overseer.start Overseer (id=91258581678489604-127.0.0.1:52530_-n_0000000000) starting
[junit4] 2> 1615016 T6314 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 1615032 T6340 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 1615034 T6314 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 1615036 T6340 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
[junit4] 2> 1615045 T6314 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 1615051 T6314 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1615058 T6339 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 1615064 T6341 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 1615065 T6341 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1615067 T6341 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1615067 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1615072 T6339 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1615074 T6339 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:52530",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:52530_",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1615075 T6339 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 1615075 T6339 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 1615086 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1615090 T6338 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1616185 T6341 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1616185 T6341 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1392495448386\collection1
[junit4] 2> 1616186 T6341 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 1616187 T6341 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1616188 T6341 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 1616192 T6341 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1616193 T6341 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1392495448386\collection1\'
[junit4] 2> 1616198 T6341 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1392495448386/collection1/lib/classes/' to classloader
[junit4] 2> 1616201 T6341 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1392495448386/collection1/lib/README' to classloader
[junit4] 2> 1616280 T6341 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 1616336 T6341 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1616340 T6341 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1616358 T6341 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1616837 T6341 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1616841 T6341 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1616842 T6341 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1616850 T6341 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1616894 T6341 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 1616894 T6341 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1392495448386\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392495447958/control/data\
[junit4] 2> 1616894 T6341 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@d6b082
[junit4] 2> 1616894 T6341 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392495447958\control\data
[junit4] 2> 1616896 T6341 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392495447958/control/data\index/
[junit4] 2> 1616896 T6341 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392495447958\control\data\index' doesn't exist. Creating new index...
[junit4] 2> 1616899 T6341 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392495447958\control\data\index
[junit4] 2> 1616900 T6341 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=25, maxMergeAtOnceExplicit=38, maxMergedSegmentMB=28.2216796875, floorSegmentMB=2.1982421875, forceMergeDeletesPctAllowed=25.02451102621665, segmentsPerTier=35.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 1616905 T6341 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392495447958\control\data\index,segFN=segments_1,generation=1}
[junit4] 2> 1616905 T6341 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1616910 T6341 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1616910 T6341 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1616911 T6341 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1616911 T6341 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1616911 T6341 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1616911 T6341 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1616912 T6341 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1616912 T6341 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1616912 T6341 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1616913 T6341 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1616913 T6341 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 1616913 T6341 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 1616913 T6341 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 1616915 T6341 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 1616915 T6341 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 1616916 T6341 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 1616925 T6341 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1616929 T6341 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1616929 T6341 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1616931 T6341 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=43, maxMergeAtOnceExplicit=18, maxMergedSegmentMB=49.826171875, floorSegmentMB=2.095703125, forceMergeDeletesPctAllowed=6.7001584543928185, segmentsPerTier=15.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 1616932 T6341 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392495447958\control\data\index,segFN=segments_1,generation=1}
[junit4] 2> 1616932 T6341 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1616932 T6341 oass.SolrIndexSearcher.<init> Opening Searcher@1ce3bd7[collection1] main
[junit4] 2> 1616938 T6341 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1616938 T6342 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1ce3bd7[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 1616939 T6314 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4] 2> 1616939 T6314 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1616950 T6314 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1616951 T6345 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:52530 collection:control_collection shard:shard1
[junit4] 2> 1616954 T6345 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 1616965 T6347 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1bc2492 name:ZooKeeperConnection Watcher:127.0.0.1:52520/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1616966 T6314 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1616971 T6314 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1616977 T6345 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 1616980 T6314 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 1617080 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1617118 T6345 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 1617118 T6345 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C1380 name=collection1 org.apache.solr.core.SolrCore@abf1ea url=https://127.0.0.1:52530/collection1 node=127.0.0.1:52530_ C1380_STATE=coll:control_collection core:collection1 props:{state=down, base_url=https://127.0.0.1:52530, core=collection1, node_name=127.0.0.1:52530_}
[junit4] 2> 1617118 T6345 C1380 P52530 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:52530/collection1/
[junit4] 2> 1617118 T6345 C1380 P52530 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 1617118 T6345 C1380 P52530 oasc.SyncStrategy.syncToMe https://127.0.0.1:52530/collection1/ has no replicas
[junit4] 2> 1617118 T6345 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:52530/collection1/ shard1
[junit4] 2> 1617118 T6345 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 1617146 T6339 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1617254 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1617257 T6338 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1617258 T6347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1617276 T6339 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1617282 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1617405 T6347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1617406 T6338 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1617443 T6345 oasc.ZkController.register We are https://127.0.0.1:52530/collection1/ and leader is https://127.0.0.1:52530/collection1/
[junit4] 2> 1617443 T6345 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:52530
[junit4] 2> 1617443 T6345 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 1617443 T6345 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 1617443 T6345 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1617446 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1617446 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1617446 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1617448 T6345 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1617451 T6339 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1617453 T6339 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:52530",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:52530_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 1617459 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1617576 T6347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1617577 T6338 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1617603 T6314 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 1617605 T6314 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1617618 T6314 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 1617620 T6314 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:52542
[junit4] 2> 1617626 T6314 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1617626 T6314 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1617626 T6314 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1392495451235
[junit4] 2> 1617628 T6314 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1392495451235\'
[junit4] 2> 1617673 T6314 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1392495451235\solr.xml
[junit4] 2> 1617756 T6314 oasc.CoreContainer.<init> New CoreContainer 29346211
[junit4] 2> 1617756 T6314 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1392495451235\]
[junit4] 2> 1617761 T6314 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1617761 T6314 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1617761 T6314 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1617762 T6314 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1617763 T6314 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1617763 T6314 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1617763 T6314 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1617766 T6314 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1617766 T6314 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1617782 T6314 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1617782 T6314 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1617782 T6314 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1617782 T6314 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52520/solr
[junit4] 2> 1617782 T6314 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1617787 T6314 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1617794 T6358 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ad36b7 name:ZooKeeperConnection Watcher:127.0.0.1:52520 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1617796 T6314 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1617802 T6314 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1617806 T6360 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@12db90d name:ZooKeeperConnection Watcher:127.0.0.1:52520/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1617808 T6314 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1617816 T6314 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1619057 T6314 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52542_
[junit4] 2> 1619065 T6314 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52542_
[junit4] 2> 1619080 T6338 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 1619081 T6360 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 1619081 T6347 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 1619114 T6361 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 1619115 T6361 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1619121 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1619121 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1619122 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1619121 T6361 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1619130 T6339 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1619134 T6339 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:52542",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:52542_",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1619135 T6339 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3]
[junit4] 2> 1619135 T6339 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
[junit4] 2> 1619153 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1619158 T6360 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1619159 T6338 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1619159 T6347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1620351 T6361 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1620351 T6361 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1392495451235\collection1
[junit4] 2> 1620351 T6361 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 1620354 T6361 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1620354 T6361 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1620356 T6361 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1620356 T6361 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1392495451235\collection1\'
[junit4] 2> 1620359 T6361 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1392495451235/collection1/lib/classes/' to classloader
[junit4] 2> 1620359 T6361 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1392495451235/collection1/lib/README' to classloader
[junit4] 2> 1620443 T6361 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 1620500 T6361 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1620504 T6361 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1620516 T6361 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1621030 T6361 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1621033 T6361 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1621036 T6361 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1621044 T6361 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1621105 T6361 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 1621107 T6361 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1392495451235\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392495447958/jetty1\
[junit4] 2> 1621107 T6361 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@d6b082
[junit4] 2> 1621107 T6361 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392495447958\jetty1
[junit4] 2> 1621107 T6361 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392495447958/jetty1\index/
[junit4] 2> 1621110 T6361 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392495447958\jetty1\index' doesn't exist. Creating new index...
[junit4] 2> 1621110 T6361 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392495447958\jetty1\index
[junit4] 2> 1621111 T6361 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=25, maxMergeAtOnceExplicit=38, maxMergedSegmentMB=28.2216796875, floorSegmentMB=2.1982421875, forceMergeDeletesPctAllowed=25.02451102621665, segmentsPerTier=35.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 1621119 T6361 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392495447958\jetty1\index,segFN=segments_1,generation=1}
[junit4] 2> 1621119 T6361 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1621124 T6361 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1621124 T6361 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1621125 T6361 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1621125 T6361 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1621125 T6361 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1621126 T6361 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1621126 T6361 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1621126 T6361 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1621126 T6361 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1621129 T6361 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1621129 T6361 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 1621129 T6361 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 1621129 T6361 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 1621130 T6361 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 1621131 T6361 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 1621131 T6361 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 1621142 T6361 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1621148 T6361 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1621148 T6361 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1621149 T6361 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=43, maxMergeAtOnceExplicit=18, maxMergedSegmentMB=49.826171875, floorSegmentMB=2.095703125, forceMergeDeletesPctAllowed=6.7001584543928185, segmentsPerTier=15.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 1621149 T6361 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392495447958\jetty1\index,segFN=segments_1,generation=1}
[junit4] 2> 1621149 T6361 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1621149 T6361 oass.SolrIndexSearcher.<init> Opening Searcher@1f5fab6[collection1] main
[junit4] 2> 1621159 T6362 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1f5fab6[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 1621161 T6361 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1621163 T6314 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4] 2> 1621163 T6314 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1621163 T6365 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:52542 collection:collection1 shard:shard3
[junit4] 2> 1621168 T6365 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election
[junit4] 2> 1621196 T6365 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard3
[junit4] 2> 1621204 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1621208 T6365 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 1621208 T6365 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C1381 name=collection1 org.apache.solr.core.SolrCore@38a8ae url=https://127.0.0.1:52542/collection1 node=127.0.0.1:52542_ C1381_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:52542, core=collection1, node_name=127.0.0.1:52542_}
[junit4] 2> 1621208 T6365 C1381 P52542 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:52542/collection1/
[junit4] 2> 1621208 T6365 C1381 P52542 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 1621208 T6365 C1381 P52542 oasc.SyncStrategy.syncToMe https://127.0.0.1:52542/collection1/ has no replicas
[junit4] 2> 1621210 T6365 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:52542/collection1/ shard3
[junit4] 2> 1621210 T6365 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard3
[junit4] 2> 1621215 T6339 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1621240 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1621244 T6347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1621244 T6338 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1621245 T6360 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1621261 T6339 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1621269 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1621397 T6338 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1621399 T6347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1621399 T6360 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1621441 T6365 oasc.ZkController.register We are https://127.0.0.1:52542/collection1/ and leader is https://127.0.0.1:52542/collection1/
[junit4] 2> 1621441 T6365 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:52542
[junit4] 2> 1621441 T6365 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 1621442 T6365 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 1621442 T6365 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1621445 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1621445 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1621445 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1621448 T6365 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1621450 T6339 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1621453 T6339 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:52542",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:52542_",
[junit4] 2> "shard":"shard3",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 1621459 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1621587 T6338 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1621587 T6347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1621588 T6360 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1621852 T6314 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 1621854 T6314 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1621865 T6314 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 1621870 T6314 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:52551
[junit4] 2> 1621875 T6314 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1621875 T6314 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1621875 T6314 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1392495455426
[junit4] 2> 1621875 T6314 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1392495455426\'
[junit4] 2> 1621914 T6314 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1392495455426\solr.xml
[junit4] 2> 1621986 T6314 oasc.CoreContainer.<init> New CoreContainer 18175100
[junit4] 2> 1621986 T6314 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1392495455426\]
[junit4] 2> 1621989 T6314 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1621989 T6314 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1621989 T6314 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1621989 T6314 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1621989 T6314 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1621989 T6314 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1621991 T6314 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1621991 T6314 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1621991 T6314 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1622008 T6314 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1622008 T6314 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1622008 T6314 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1622011 T6314 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52520/solr
[junit4] 2> 1622011 T6314 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1622014 T6314 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1622022 T6376 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1240545 name:ZooKeeperConnection Watcher:127.0.0.1:52520 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1622022 T6314 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1622031 T6316 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14437324fa70008, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 1622032 T6314 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1622037 T6378 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f55b5f name:ZooKeeperConnection Watcher:127.0.0.1:52520/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1622037 T6314 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1622061 T6314 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1623302 T6314 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52551_
[junit4] 2> 1623308 T6314 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52551_
[junit4] 2> 1623327 T6360 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1623328 T6347 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1623330 T6338 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1623331 T6378 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1623362 T6379 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 1623363 T6379 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1623369 T6379 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1623369 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1623369 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1623370 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1623379 T6339 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1623382 T6339 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:52551",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:52551_",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1623384 T6339 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 1623384 T6339 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 1623402 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1623406 T6360 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1623409 T6378 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1623409 T6338 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1623410 T6347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1624597 T6379 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1624597 T6379 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1392495455426\collection1
[junit4] 2> 1624597 T6379 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 1624600 T6379 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1624600 T6379 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1624603 T6379 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1624603 T6379 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1392495455426\collection1\'
[junit4] 2> 1624606 T6379 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1392495455426/collection1/lib/classes/' to classloader
[junit4] 2> 1624607 T6379 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1392495455426/collection1/lib/README' to classloader
[junit4] 2> 1624684 T6379 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 1624748 T6379 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1624752 T6379 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1624766 T6379 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1625341 T6379 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1625345 T6379 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1625346 T6379 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1625353 T6379 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1625405 T6379 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 1625406 T6379 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1392495455426\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392495447958/jetty2\
[junit4] 2> 1625406 T6379 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@d6b082
[junit4] 2> 1625408 T6379 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392495447958\jetty2
[junit4] 2> 1625409 T6379 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392495447958/jetty2\index/
[junit4] 2> 1625411 T6379 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392495447958\jetty2\index' doesn't exist. Creating new index...
[junit4] 2> 1625411 T6379 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392495447958\jetty2\index
[junit4] 2> 1625412 T6379 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=25, maxMergeAtOnceExplicit=38, maxMergedSegmentMB=28.2216796875, floorSegmentMB=2.1982421875, forceMergeDeletesPctAllowed=25.02451102621665, segmentsPerTier=35.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 1625418 T6379 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392495447958\jetty2\index,segFN=segments_1,generation=1}
[junit4] 2> 1625418 T6379 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1625423 T6379 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1625423 T6379 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1625424 T6379 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1625424 T6379 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1625424 T6379 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1625424 T6379 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1625425 T6379 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1625425 T6379 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1625425 T6379 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1625427 T6379 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1625429 T6379 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 1625429 T6379 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 1625429 T6379 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 1625430 T6379 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 1625430 T6379 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 1625431 T6379 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 1625439 T6379 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1625447 T6379 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1625447 T6379 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1625448 T6379 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=43, maxMergeAtOnceExplicit=18, maxMergedSegmentMB=49.826171875, floorSegmentMB=2.095703125, forceMergeDeletesPctAllowed=6.7001584543928185, segmentsPerTier=15.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 1625449 T6379 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392495447958\jetty2\index,segFN=segments_1,generation=1}
[junit4] 2> 1625449 T6379 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1625450 T6379 oass.SolrIndexSearcher.<init> Opening Searcher@150f686[collection1] main
[junit4] 2> 1625454 T6380 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@150f686[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 1625457 T6379 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1625460 T6314 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4] 2> 1625461 T6314 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1625460 T6383 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:52551 collection:collection1 shard:shard2
[junit4] 2> 1625463 T6383 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 1625480 T6383 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 1625495 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1625499 T6383 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 1625499 T6383 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C1382 name=collection1 org.apache.solr.core.SolrCore@a78fa4 url=https://127.0.0.1:52551/collection1 node=127.0.0.1:52551_ C1382_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:52551, core=collection1, node_name=127.0.0.1:52551_}
[junit4] 2> 1625499 T6383 C1382 P52551 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:52551/collection1/
[junit4] 2> 1625501 T6383 C1382 P52551 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 1625501 T6383 C1382 P52551 oasc.SyncStrategy.syncToMe https://127.0.0.1:52551/collection1/ has no replicas
[junit4] 2> 1625501 T6383 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:52551/collection1/ shard2
[junit4] 2> 1625501 T6383 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 1625505 T6339 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1625521 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1625526 T6360 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1625526 T6347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1625527 T6338 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1625527 T6378 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1625542 T6339 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1625550 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1625679 T6360 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1625680 T6338 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1625680 T6378 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1625682 T6347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1625727 T6383 oasc.ZkController.register We are https://127.0.0.1:52551/collection1/ and leader is https://127.0.0.1:52551/collection1/
[junit4] 2> 1625728 T6383 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:52551
[junit4] 2> 1625728 T6383 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 1625728 T6383 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 1625728 T6383 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1625732 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1625732 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1625732 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1625734 T6383 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1625738 T6339 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1625739 T6339 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:52551",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:52551_",
[junit4] 2> "shard":"shard2",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":"core_node2"}
[junit4] 2> 1625745 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1625876 T6360 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1625876 T6338 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1625877 T6347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1625877 T6378 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1626107 T6314 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 1626107 T6314 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1626124 T6314 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 1626129 T6314 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:52560
[junit4] 2> 1626134 T6314 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1626134 T6314 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1626134 T6314 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1392495459722
[junit4] 2> 1626134 T6314 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1392495459722\'
[junit4] 2> 1626176 T6314 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1392495459722\solr.xml
[junit4] 2> 1626253 T6314 oasc.CoreContainer.<init> New CoreContainer 18672263
[junit4] 2> 1626253 T6314 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1392495459722\]
[junit4] 2> 1626255 T6314 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1626255 T6314 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1626255 T6314 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1626255 T6314 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1626255 T6314 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1626255 T6314 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1626257 T6314 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1626257 T6314 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1626257 T6314 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1626272 T6314 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1626272 T6314 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1626272 T6314 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1626273 T6314 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52520/solr
[junit4] 2> 1626275 T6314 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1626278 T6314 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1626290 T6394 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1a239fc name:ZooKeeperConnection Watcher:127.0.0.1:52520 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1626292 T6314 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1626299 T6316 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14437324fa7000a, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 1626302 T6314 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1626313 T6396 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@534e51 name:ZooKeeperConnection Watcher:127.0.0.1:52520/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1626314 T6314 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1626332 T6314 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1627569 T6314 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52560_
[junit4] 2> 1627572 T6314 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52560_
[junit4] 2> 1627580 T6360 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1627581 T6396 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1627581 T6347 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1627583 T6378 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1627583 T6338 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1627599 T6397 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 1627601 T6397 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1627603 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1627603 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1627603 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1627603 T6397 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1627608 T6339 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1627609 T6339 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:52560",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:52560_",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1627609 T6339 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 1627609 T6339 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 1627616 T6338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1627617 T6396 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 1627617 T6360 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 1627617 T6347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 1627617 T6378 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 1627617 T6338 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 1628832 T6397 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1628832 T6397 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1392495459722\collection1
[junit4] 2> 1628832 T6397 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 1628836 T6397 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1628836 T6397 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1628838 T6397 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[...truncated too long message...]
] 2> at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:174)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:171)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:171)
[junit4] 2> at org.apache.solr.cloud.ElectionContext.cancelElection(ElectionContext.java:67)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:293)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:164)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:108)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 1821972 T6573 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 1821972 T6573 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:254)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:254)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 1821971 T6433 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:254)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:254)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> NOTE: test params are: codec=Lucene3x, sim=RandomSimilarityProvider(queryNorm=false,coord=crazy): {}, locale=ar_EG, timezone=Asia/Baghdad
[junit4] 2> NOTE: Windows 7 6.1 x86/Oracle Corporation 1.7.0_60-ea (32-bit)/cpus=2,threads=1,free=165091048,total=536870912
[junit4] 2> NOTE: All tests run in this JVM: [TermsComponentTest, ConvertedLegacyTest, TestDistributedMissingSort, QueryEqualityTest, TestSolrIndexConfig, ClusterStateUpdateTest, TestZkChroot, TestCopyFieldCollectionResource, FileBasedSpellCheckerTest, SignatureUpdateProcessorFactoryTest, TestConfig, TestSolrQueryParserResource, DistributedQueryElevationComponentTest, RequiredFieldsTest, TestBM25SimilarityFactory, RegexBoostProcessorTest, TestCollapseQParserPlugin, SyncSliceTest, CursorMarkTest, TestIndexingPerformance, DirectSolrSpellCheckerTest, AutoCommitTest, TestLFUCache, HdfsLockFactoryTest, TestManagedSchemaFieldResource, TestSchemaSimilarityResource, LeaderElectionTest, CircularListTest, TestSort, TestFiltering, PrimUtilsTest, ChangedSchemaMergeTest, HdfsDirectoryTest, TestSurroundQueryParser, HdfsUnloadDistributedZkTest, TestDistributedGrouping, ReturnFieldsTest, TestLMJelinekMercerSimilarityFactory, TestRTGBase, TestCloudManagedSchemaAddField, RecoveryZkTest, DistributedTermsComponentTest, TestDFRSimilarityFactory, PolyFieldTest, TestSuggestSpellingConverter, TestLRUCache, TestManagedSchema, DefaultValueUpdateProcessorTest, TestUniqueKeyFieldResource, BinaryUpdateRequestHandlerTest, LukeRequestHandlerTest, TestJoin, ZkSolrClientTest, StatsComponentTest, DocValuesTest, SolrCoreCheckLockOnStartupTest, TestWordDelimiterFilterFactory, TestInfoStreamLogging, TestDocBasedVersionConstraints, CacheHeaderTest, CurrencyFieldXmlFileTest, TestHighFrequencyDictionaryFactory, TestReplicationHandler, TestNonDefinedSimilarityFactory, TestPostingsSolrHighlighter, SolrCoreTest, FileUtilsTest, TestBadConfig, TestAddFieldRealTimeGet, SpellingQueryConverterTest, JSONWriterTest, CoreContainerCoreInitFailuresTest, CachingDirectoryFactoryTest, TestLuceneMatchVersion, PingRequestHandlerTest, TestFieldResource, TestUtils, NotRequiredUniqueKeyTest, FastVectorHighlighterTest, AnalysisAfterCoreReloadTest, TestDistribDocBasedVersion, TestStressReorder, OpenCloseCoreStressTest, DistributedDebugComponentTest, TestCodecSupport, ResponseLogComponentTest, TestFastLRUCache, TestFuzzyAnalyzedSuggestions, SampleTest, UpdateRequestProcessorFactoryTest, TestPseudoReturnFields, TestReload, TestGroupingSearch, OverseerCollectionProcessorTest, TestMergePolicyConfig, TestFieldTypeCollectionResource, TestLazyCores, SoftAutoCommitTest, TestAnalyzeInfixSuggestions, DirectUpdateHandlerOptimizeTest, PreAnalyzedFieldTest, DisMaxRequestHandlerTest, DOMUtilTest, PeerSyncTest, TestExtendedDismaxParser, TestHighlightDedupGrouping, TestFastOutputStream, CollectionsAPIDistributedZkTest, NoCacheHeaderTest, URLClassifyProcessorTest, TestRandomDVFaceting, TestFastWriter, BadComponentTest, SolrTestCaseJ4Test, SynonymTokenizerTest, TestSolrJ, ZkNodePropsTest, MBeansHandlerTest, SolrIndexConfigTest, DistributedSpellCheckComponentTest, SchemaVersionSpecificBehaviorTest, BJQParserTest, IndexBasedSpellCheckerTest, TestFaceting, BasicDistributedZk2Test, TestDefaultSimilarityFactory, TestSolrXml, TestSearchPerf, TestWriterPerf, TestFunctionQuery, IndexSchemaRuntimeFieldTest, SimpleFacetsTest, CoreMergeIndexesAdminHandlerTest, TestOverriddenPrefixQueryForCustomFieldType, TestCoreDiscovery, CurrencyFieldOpenExchangeTest, DateMathParserTest, TestFieldCollectionResource, XsltUpdateRequestHandlerTest, SuggesterTSTTest, DebugComponentTest, AnalysisErrorHandlingTest, HdfsRecoveryZkTest, SOLR749Test, FieldMutatingUpdateProcessorTest, TriLevelCompositeIdRoutingTest, MultiTermTest, OutputWriterTest, TestSolrXmlPersistence, TestClassNameShortening, CopyFieldTest, BasicDistributedZkTest, SolrIndexSplitterTest, SpellCheckCollatorTest, StandardRequestHandlerTest, SpellPossibilityIteratorTest, ShardRoutingTest, ResourceLoaderTest, HighlighterConfigTest, EnumFieldTest, TestSolrXMLSerializer, TestIBSimilarityFactory, TestCoreContainer, DocumentBuilderTest, SuggesterFSTTest, TestJmxMonitoredMap, FullSolrCloudDistribCmdsTest, TestRandomFaceting, XmlUpdateRequestHandlerTest, BasicFunctionalityTest, LeaderElectionIntegrationTest, DistanceFunctionTest, UpdateParamsTest, TestSolrCoreProperties, MinimalSchemaTest, ChaosMonkeySafeLeaderTest]
[junit4] Completed in 209.41s, 1 test, 1 error <<< FAILURES!
[...truncated 565 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:459: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:439: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\extra-targets.xml:37: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build.xml:189: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\common-build.xml:491: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:1308: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:941: There were test failures: 362 suites, 1563 tests, 1 error, 40 ignored (12 assumptions)
Total time: 81 minutes 26 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.7.0_60-ea-b04 -server -XX:+UseG1GC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-4.x-Windows (32bit/jdk1.8.0-fcs-b129) - Build
# 3706 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Windows/3706/
Java: 32bit/jdk1.8.0-fcs-b129 -client -XX:+UseG1GC
2 tests failed.
REGRESSION: org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.testDistribSearch
Error Message:
Timeout occured while waiting response from server at: https://127.0.0.1:51981/collection1
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: https://127.0.0.1:51981/collection1
at __randomizedtesting.SeedInfo.seed([36602D8709F109B4:B786A39F7EAE6988]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:505)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:199)
at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.index_specific(AbstractFullDistribZkTestBase.java:698)
at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.testIndexingWithSuss(FullSolrCloudDistribCmdsTest.java:443)
at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.doTest(FullSolrCloudDistribCmdsTest.java:134)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:870)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:744)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:150)
at java.net.SocketInputStream.read(SocketInputStream.java:121)
at sun.security.ssl.InputRecord.readFully(InputRecord.java:465)
at sun.security.ssl.InputRecord.read(InputRecord.java:503)
at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:954)
at sun.security.ssl.SSLSocketImpl.readDataRecord(SSLSocketImpl.java:911)
at sun.security.ssl.AppInputStream.read(AppInputStream.java:105)
at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:260)
at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:271)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:123)
at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:682)
at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:486)
at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:863)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:106)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:57)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:395)
... 48 more
FAILED: org.apache.solr.TestDistributedSearch.testDistribSearch
Error Message:
Expected the partialResults header to be null
Stack Trace:
java.lang.AssertionError: Expected the partialResults header to be null
at __randomizedtesting.SeedInfo.seed([36602D8709F109B4:B786A39F7EAE6988]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNull(Assert.java:551)
at org.apache.solr.TestDistributedSearch.validateControlData(TestDistributedSearch.java:525)
at org.apache.solr.TestDistributedSearch.queryPartialResults(TestDistributedSearch.java:445)
at org.apache.solr.TestDistributedSearch.doTest(TestDistributedSearch.java:379)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:876)
at sun.reflect.GeneratedMethodAccessor70.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:744)
Build Log:
[...truncated 10513 lines...]
[junit4] Suite: org.apache.solr.cloud.FullSolrCloudDistribCmdsTest
[junit4] 2> 1366383 T6226 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (false)
[junit4] 2> 1366385 T6226 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4] 2> 1366392 T6226 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-FullSolrCloudDistribCmdsTest-1392472316421
[junit4] 2> 1366397 T6226 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 1366400 T6227 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 1366518 T6226 oasc.ZkTestServer.run start zk server on port:51971
[junit4] 2> 1366521 T6226 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1366529 T6233 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@700335 name:ZooKeeperConnection Watcher:127.0.0.1:51971 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1366531 T6226 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1366531 T6226 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 1366537 T6228 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14435d15a150000, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 1366540 T6226 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1366544 T6235 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14e12af name:ZooKeeperConnection Watcher:127.0.0.1:51971/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1366544 T6226 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1366544 T6226 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 1366550 T6226 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 1366557 T6226 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 1366562 T6226 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 1366566 T6226 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1366566 T6226 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 1366577 T6226 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 1366578 T6226 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 1366583 T6226 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1366583 T6226 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1366588 T6226 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1366590 T6226 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 1366597 T6226 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1366598 T6226 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 1366602 T6226 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1366602 T6226 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 1366610 T6226 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 1366610 T6226 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 1366616 T6226 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1366616 T6226 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 1366623 T6226 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1366623 T6226 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1366629 T6226 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1366629 T6226 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 1366636 T6226 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1366637 T6226 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 1366644 T6228 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14435d15a150001, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 1366645 T6226 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1366649 T6237 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ee976e name:ZooKeeperConnection Watcher:127.0.0.1:51971/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1366650 T6226 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1366652 T6228 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14435d15a150002, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 1367382 T6226 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1367396 T6226 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 1367403 T6226 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:51981
[junit4] 2> 1367410 T6226 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1367410 T6226 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1367410 T6226 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-controljetty-1392472316678
[junit4] 2> 1367410 T6226 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-controljetty-1392472316678\'
[junit4] 2> 1367460 T6226 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-controljetty-1392472316678\solr.xml
[junit4] 2> 1367476 T6226 oasc.CoreContainer.<init> New CoreContainer 19524686
[junit4] 2> 1367476 T6226 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-controljetty-1392472316678\]
[junit4] 2> 1367478 T6226 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1367478 T6226 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1367478 T6226 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1367478 T6226 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1367478 T6226 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1367481 T6226 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1367481 T6226 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1367481 T6226 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1367481 T6226 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1367494 T6226 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1367494 T6226 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1367494 T6226 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1367496 T6226 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:51971/solr
[junit4] 2> 1367496 T6226 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1367500 T6226 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1367509 T6248 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b4cc30 name:ZooKeeperConnection Watcher:127.0.0.1:51971 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1367510 T6226 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1367516 T6226 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1367521 T6250 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d379e0 name:ZooKeeperConnection Watcher:127.0.0.1:51971/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1367522 T6226 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1367524 T6226 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 1367533 T6226 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 1367544 T6226 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 1367548 T6226 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51981_
[junit4] 2> 1367551 T6226 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51981_
[junit4] 2> 1367557 T6226 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 1367562 T6226 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 1367571 T6226 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:51981_
[junit4] 2> 1367571 T6226 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 1367575 T6226 oasc.Overseer.start Overseer (id=91257065730015236-127.0.0.1:51981_-n_0000000000) starting
[junit4] 2> 1367582 T6226 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 1367590 T6226 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 1367590 T6252 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 1367594 T6252 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
[junit4] 2> 1367597 T6226 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 1367602 T6226 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1367606 T6251 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 1367612 T6253 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 1367612 T6253 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1367615 T6253 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1367615 T6250 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1367618 T6251 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1367620 T6251 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:51981",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:51981_",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1367620 T6251 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 1367620 T6251 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 1367625 T6250 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1367627 T6250 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1368800 T6253 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1368802 T6253 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: .\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-controljetty-1392472316678\collection1
[junit4] 2> 1368802 T6253 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 1368803 T6253 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1368803 T6253 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 1368806 T6253 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1368806 T6253 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-controljetty-1392472316678\collection1\'
[junit4] 2> 1368809 T6253 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-controljetty-1392472316678/collection1/lib/classes/' to classloader
[junit4] 2> 1368810 T6253 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-controljetty-1392472316678/collection1/lib/README' to classloader
[junit4] 2> 1368872 T6253 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 1368883 T6253 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1368890 T6253 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1368898 T6253 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1369060 T6253 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1369063 T6253 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1369063 T6253 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1369070 T6253 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1369111 T6253 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1369112 T6253 oasc.SolrCore.<init> [collection1] Opening new SolrCore at .\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-controljetty-1392472316678\collection1\, dataDir=.\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1392472316418/control/data\
[junit4] 2> 1369112 T6253 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@c579fd
[junit4] 2> 1369114 T6253 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1392472316418/control/data\
[junit4] 2> 1369114 T6253 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1392472316418/control/data\index/
[junit4] 2> 1369114 T6253 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1392472316418\control\data\index' doesn't exist. Creating new index...
[junit4] 2> 1369115 T6253 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1392472316418/control/data\index
[junit4] 2> 1369115 T6253 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=44, maxMergeAtOnceExplicit=25, maxMergedSegmentMB=54.4482421875, floorSegmentMB=1.1669921875, forceMergeDeletesPctAllowed=7.703524883683148, segmentsPerTier=30.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 1369117 T6253 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1a97c7e lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@17d7cc2),segFN=segments_1,generation=1}
[junit4] 2> 1369117 T6253 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1369121 T6253 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1369121 T6253 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1369122 T6253 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1369122 T6253 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1369122 T6253 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1369122 T6253 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1369124 T6253 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1369125 T6253 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1369125 T6253 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1369126 T6253 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1369126 T6253 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 1369126 T6253 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 1369126 T6253 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 1369128 T6253 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 1369128 T6253 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 1369129 T6253 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 1369134 T6253 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1369143 T6253 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1369143 T6253 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1369144 T6253 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=41, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.11520609910372254]
[junit4] 2> 1369205 T6253 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1a97c7e lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@17d7cc2),segFN=segments_1,generation=1}
[junit4] 2> 1369205 T6253 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1369205 T6253 oass.SolrIndexSearcher.<init> Opening Searcher@1107873[collection1] main
[junit4] 2> 1369210 T6254 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1107873[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 1369210 T6253 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1369213 T6226 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4] 2> 1369214 T6226 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1369214 T6257 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:51981 collection:control_collection shard:shard1
[junit4] 2> 1369217 T6257 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 1369225 T6226 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1369229 T6259 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@164b466 name:ZooKeeperConnection Watcher:127.0.0.1:51971/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1369229 T6226 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1369232 T6226 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1369234 T6257 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 1369238 T6250 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1369239 T6226 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 1369239 T6257 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 1369239 T6257 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C2067 name=collection1 org.apache.solr.core.SolrCore@19fb3be url=https://127.0.0.1:51981/collection1 node=127.0.0.1:51981_ C2067_STATE=coll:control_collection core:collection1 props:{state=down, base_url=https://127.0.0.1:51981, core=collection1, node_name=127.0.0.1:51981_}
[junit4] 2> 1369239 T6257 C2067 P51981 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:51981/collection1/
[junit4] 2> 1369239 T6257 C2067 P51981 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 1369239 T6257 C2067 P51981 oasc.SyncStrategy.syncToMe https://127.0.0.1:51981/collection1/ has no replicas
[junit4] 2> 1369239 T6257 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:51981/collection1/ shard1
[junit4] 2> 1369243 T6257 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 1369245 T6251 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1369256 T6250 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1369260 T6250 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1369261 T6259 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1369278 T6251 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1369284 T6250 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1369408 T6259 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1369410 T6250 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1369454 T6257 oasc.ZkController.register We are https://127.0.0.1:51981/collection1/ and leader is https://127.0.0.1:51981/collection1/
[junit4] 2> 1369454 T6257 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:51981
[junit4] 2> 1369454 T6257 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 1369454 T6257 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 1369455 T6257 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1369465 T6250 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1369465 T6250 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1369465 T6250 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1369467 T6257 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1369470 T6251 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1369471 T6251 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:51981",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:51981_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 1369479 T6250 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1369604 T6259 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1369605 T6250 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1370053 T6226 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 1370055 T6226 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1370069 T6226 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 1370071 T6226 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:51993
[junit4] 2> 1370079 T6226 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1370079 T6226 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1370079 T6226 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty1-1392472319265
[junit4] 2> 1370079 T6226 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty1-1392472319265\'
[junit4] 2> 1370144 T6226 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty1-1392472319265\solr.xml
[junit4] 2> 1370159 T6226 oasc.CoreContainer.<init> New CoreContainer 537644
[junit4] 2> 1370162 T6226 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty1-1392472319265\]
[junit4] 2> 1370163 T6226 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1370163 T6226 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1370163 T6226 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1370163 T6226 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1370163 T6226 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1370166 T6226 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1370166 T6226 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1370166 T6226 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1370166 T6226 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1370180 T6226 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1370180 T6226 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1370182 T6226 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1370182 T6226 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:51971/solr
[junit4] 2> 1370182 T6226 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1370185 T6226 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1370192 T6270 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1cb8b6 name:ZooKeeperConnection Watcher:127.0.0.1:51971 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1370194 T6226 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1370199 T6228 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14435d15a150006, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 1370202 T6226 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1370205 T6272 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4af63b name:ZooKeeperConnection Watcher:127.0.0.1:51971/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1370206 T6226 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1370217 T6226 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1371410 T6226 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51993_
[junit4] 2> 1371412 T6226 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51993_
[junit4] 2> 1371419 T6259 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 1371419 T6272 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 1371420 T6250 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 1371430 T6273 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 1371430 T6273 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1371434 T6250 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1371434 T6250 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1371434 T6250 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1371434 T6273 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1371437 T6251 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1371439 T6251 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:51993",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:51993_",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1371439 T6251 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3]
[junit4] 2> 1371439 T6251 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 1371446 T6250 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1371447 T6272 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1371447 T6259 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1371448 T6250 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1372621 T6273 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1372621 T6273 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: .\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty1-1392472319265\collection1
[junit4] 2> 1372621 T6273 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 1372623 T6273 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1372623 T6273 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1372626 T6273 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1372626 T6273 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty1-1392472319265\collection1\'
[junit4] 2> 1372629 T6273 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty1-1392472319265/collection1/lib/classes/' to classloader
[junit4] 2> 1372629 T6273 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty1-1392472319265/collection1/lib/README' to classloader
[junit4] 2> 1372675 T6273 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 1372688 T6273 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1372693 T6273 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1372701 T6273 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1372864 T6273 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1372868 T6273 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1372870 T6273 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1372876 T6273 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1372923 T6273 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1372924 T6273 oasc.SolrCore.<init> [collection1] Opening new SolrCore at .\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty1-1392472319265\collection1\, dataDir=.\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1392472316418/jetty1\
[junit4] 2> 1372924 T6273 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@c579fd
[junit4] 2> 1372926 T6273 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1392472316418/jetty1\
[junit4] 2> 1372927 T6273 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1392472316418/jetty1\index/
[junit4] 2> 1372927 T6273 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1392472316418\jetty1\index' doesn't exist. Creating new index...
[junit4] 2> 1372928 T6273 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1392472316418/jetty1\index
[junit4] 2> 1372928 T6273 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=44, maxMergeAtOnceExplicit=25, maxMergedSegmentMB=54.4482421875, floorSegmentMB=1.1669921875, forceMergeDeletesPctAllowed=7.703524883683148, segmentsPerTier=30.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 1372929 T6273 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@a63259 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@c49773),segFN=segments_1,generation=1}
[junit4] 2> 1372929 T6273 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1372934 T6273 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1372934 T6273 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1372935 T6273 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1372935 T6273 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1372936 T6273 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1372936 T6273 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1372936 T6273 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1372937 T6273 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1372937 T6273 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1372938 T6273 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1372939 T6273 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 1372941 T6273 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 1372941 T6273 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 1372942 T6273 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 1372942 T6273 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 1372943 T6273 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 1372950 T6273 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1372956 T6273 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1372957 T6273 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1372958 T6273 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=41, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.11520609910372254]
[junit4] 2> 1373018 T6273 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@a63259 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@c49773),segFN=segments_1,generation=1}
[junit4] 2> 1373018 T6273 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1373019 T6273 oass.SolrIndexSearcher.<init> Opening Searcher@d3ee1b[collection1] main
[junit4] 2> 1373031 T6274 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@d3ee1b[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 1373031 T6273 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1373032 T6226 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4] 2> 1373032 T6226 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1373034 T6277 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:51993 collection:collection1 shard:shard2
[junit4] 2> 1373037 T6277 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 1373055 T6277 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 1373060 T6250 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1373062 T6277 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 1373062 T6277 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C2068 name=collection1 org.apache.solr.core.SolrCore@4aa6c url=https://127.0.0.1:51993/collection1 node=127.0.0.1:51993_ C2068_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:51993, core=collection1, node_name=127.0.0.1:51993_}
[junit4] 2> 1373062 T6277 C2068 P51993 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:51993/collection1/
[junit4] 2> 1373063 T6277 C2068 P51993 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 1373063 T6277 C2068 P51993 oasc.SyncStrategy.syncToMe https://127.0.0.1:51993/collection1/ has no replicas
[junit4] 2> 1373063 T6277 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:51993/collection1/ shard2
[junit4] 2> 1373063 T6277 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 1373068 T6251 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1373078 T6250 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1373081 T6259 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1373082 T6250 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1373083 T6272 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1373096 T6251 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1373104 T6250 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1373228 T6272 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1373228 T6259 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1373229 T6250 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1373272 T6277 oasc.ZkController.register We are https://127.0.0.1:51993/collection1/ and leader is https://127.0.0.1:51993/collection1/
[junit4] 2> 1373272 T6277 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:51993
[junit4] 2> 1373272 T6277 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 1373272 T6277 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 1373272 T6277 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1373276 T6250 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1373276 T6250 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1373276 T6250 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1373279 T6277 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1373281 T6251 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1373282 T6251 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:51993",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:51993_",
[junit4] 2> "shard":"shard2",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 1373289 T6250 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1373413 T6272 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1373413 T6250 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1373413 T6259 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1373764 T6226 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 1373765 T6226 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1373778 T6226 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 1373782 T6226 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:52002
[junit4] 2> 1373785 T6226 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1373785 T6226 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1373785 T6226 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty2-1392472323064
[junit4] 2> 1373788 T6226 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty2-1392472323064\'
[junit4] 2> 1373824 T6226 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty2-1392472323064\solr.xml
[junit4] 2> 1373838 T6226 oasc.CoreContainer.<init> New CoreContainer 26412399
[junit4] 2> 1373838 T6226 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty2-1392472323064\]
[junit4] 2> 1373841 T6226 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1373841 T6226 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1373841 T6226 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1373841 T6226 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1373841 T6226 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1373841 T6226 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1373841 T6226 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1373841 T6226 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1373845 T6226 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1373855 T6226 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1373855 T6226 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1373855 T6226 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1373858 T6226 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:51971/solr
[junit4] 2> 1373858 T6226 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1373860 T6226 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1373868 T6288 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e51d9 name:ZooKeeperConnection Watcher:127.0.0.1:51971 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1373868 T6226 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1373877 T6228 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14435d15a150008, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 1373879 T6226 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1373883 T6290 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@111626f name:ZooKeeperConnection Watcher:127.0.0.1:51971/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1373883 T6226 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1373896 T6226 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1374969 T6226 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52002_
[junit4] 2> 1374971 T6226 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52002_
[junit4] 2> 1374979 T6272 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1374980 T6259 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1374980 T6250 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1374981 T6290 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1374990 T6291 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 1374990 T6291 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1374993 T6291 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1374993 T6250 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1374994 T6250 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1374994 T6250 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1374997 T6251 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1374998 T6251 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:52002",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:52002_",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1374998 T6251 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 1374998 T6251 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
[junit4] 2> 1375004 T6250 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1375005 T6272 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1375006 T6250 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1375006 T6259 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1375006 T6290 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1376060 T6291 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1376060 T6291 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty2-1392472323064\collection1
[junit4] 2> 1376060 T6291 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 1376064 T6291 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1376064 T6291 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1376066 T6291 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1376066 T6291 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty2-1392472323064\collection1\'
[junit4] 2> 1376068 T6291 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty2-1392472323064/collection1/lib/classes/' to classloader
[junit4] 2> 1376070 T6291 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty2-1392472323064/collection1/lib/README' to classloader
[junit4] 2> 1376128 T6291 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 1376164 T6291 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1376170 T6291 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1376178 T6291 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1376321 T6291 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1376324 T6291 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1376324 T6291 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1376330 T6291 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1376394 T6291 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1376395 T6291 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty2-1392472323064\collection1\, dataDir=.\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1392472316418/jetty2\
[junit4] 2> 1376395 T6291 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@c579fd
[junit4] 2> 1376396 T6291 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1392472316418/jetty2\
[junit4] 2> 1376396 T6291 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1392472316418/jetty2\index/
[junit4] 2> 1376396 T6291 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1392472316418\jetty2\index' doesn't exist. Creating new index...
[junit4] 2> 1376398 T6291 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1392472316418/jetty2\index
[junit4] 2> 1376398 T6291 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=44, maxMergeAtOnceExplicit=25, maxMergedSegmentMB=54.4482421875, floorSegmentMB=1.1669921875, forceMergeDeletesPctAllowed=7.703524883683148, segmentsPerTier=30.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 1376399 T6291 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@593174 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1af45a6),segFN=segments_1,generation=1}
[junit4] 2> 1376399 T6291 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1376403 T6291 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1376404 T6291 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1376404 T6291 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1376404 T6291 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1376405 T6291 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1376405 T6291 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1376405 T6291 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1376406 T6291 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1376406 T6291 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1376408 T6291 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1376408 T6291 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 1376408 T6291 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 1376408 T6291 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 1376411 T6291 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 1376411 T6291 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 1376412 T6291 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 1376418 T6291 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1376423 T6291 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1376423 T6291 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1376424 T6291 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=41, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.11520609910372254]
[junit4] 2> 1376479 T6291 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@593174 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1af45a6),segFN=segments_1,generation=1}
[junit4] 2> 1376479 T6291 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1376480 T6291 oass.SolrIndexSearcher.<init> Opening Searcher@1b21494[collection1] main
[junit4] 2> 1376496 T6292 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1b21494[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 1376501 T6291 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1376503 T6226 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4] 2> 1376504 T6226 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1376503 T6295 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:52002 collection:collection1 shard:shard3
[junit4] 2> 1376508 T6295 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election
[junit4] 2> 1376527 T6295 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard3
[junit4] 2> 1376536 T6250 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1376540 T6295 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 1376540 T6295 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C2069 name=collection1 org.apache.solr.core.SolrCore@1fec269 url=https://127.0.0.1:52002/collection1 node=127.0.0.1:52002_ C2069_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:52002, core=collection1, node_name=127.0.0.1:52002_}
[junit4] 2> 1376540 T6295 C2069 P52002 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:52002/collection1/
[junit4] 2> 1376541 T6295 C2069 P52002 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 1376541 T6295 C2069 P52002 oasc.SyncStrategy.syncToMe https://127.0.0.1:52002/collection1/ has no replicas
[junit4] 2> 1376541 T6295 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:52002/collection1/ shard3
[junit4] 2> 1376541 T6295 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard3
[junit4] 2> 1376547 T6251 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1376573 T6250 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1376577 T6272 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1376580 T6259 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1376581 T6250 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1376582 T6290 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1376602 T6251 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1376613 T6250 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1376728 T6272 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1376728 T6259 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1376729 T6250 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1376730 T6290 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1376758 T6295 oasc.ZkController.register We are https://127.0.0.1:52002/collection1/ and leader is https://127.0.0.1:52002/collection1/
[junit4] 2> 1376759 T6295 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:52002
[junit4] 2> 1376759 T6295 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 1376759 T6295 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 1376759 T6295 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1376763 T6250 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1376763 T6250 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1376763 T6250 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1376767 T6295 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1376770 T6251 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1376771 T6251 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:52002",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:52002_",
[junit4] 2> "shard":"shard3",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":"core_node2"}
[junit4] 2> 1376785 T6250 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1376898 T6272 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1376901 T6259 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1376902 T6250 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1376903 T6290 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1377154 T6226 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 1377155 T6226 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1377168 T6226 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 1377170 T6226 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:5201
[...truncated too long message...]
lr.TestDistributedSearch-1392473031943/shard0/data\
[junit4] 2> 2091358 T8093 oasc.CachingDirectoryFactory.closeCacheValue looking to close .\org.apache.solr.TestDistributedSearch-1392473031943/shard0/data\index [CachedDir<<refCount=0;path=.\org.apache.solr.TestDistributedSearch-1392473031943/shard0/data\index;done=false>>]
[junit4] 2> 2091358 T8093 oasc.CachingDirectoryFactory.close Closing directory: .\org.apache.solr.TestDistributedSearch-1392473031943/shard0/data\index
[junit4] 2> 2091362 T8093 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
[junit4] 2> 2091428 T8093 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=13197353
[junit4] 2> 2091431 T8093 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@7c48fd
[junit4] 2> 2091463 T8093 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=3,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=36,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0,transaction_logs_total_size=8874,transaction_logs_total_number=3}
[junit4] 2> 2091463 T8093 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 2091463 T8093 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 2091463 T8093 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 2091466 T8093 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 2091466 T8093 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 2091466 T8093 oasc.CachingDirectoryFactory.closeCacheValue looking to close .\org.apache.solr.TestDistributedSearch-1392473031943/shard1/data\ [CachedDir<<refCount=0;path=.\org.apache.solr.TestDistributedSearch-1392473031943/shard1/data\;done=false>>]
[junit4] 2> 2091466 T8093 oasc.CachingDirectoryFactory.close Closing directory: .\org.apache.solr.TestDistributedSearch-1392473031943/shard1/data\
[junit4] 2> 2091466 T8093 oasc.CachingDirectoryFactory.closeCacheValue looking to close .\org.apache.solr.TestDistributedSearch-1392473031943/shard1/data\index [CachedDir<<refCount=0;path=.\org.apache.solr.TestDistributedSearch-1392473031943/shard1/data\index;done=false>>]
[junit4] 2> 2091466 T8093 oasc.CachingDirectoryFactory.close Closing directory: .\org.apache.solr.TestDistributedSearch-1392473031943/shard1/data\index
[junit4] 2> 2091470 T8093 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
[junit4] 2> 2091671 T8093 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestDistributedSearch -Dtests.method=testDistribSearch -Dtests.seed=36602D8709F109B4 -Dtests.slow=true -Dtests.locale=uk_UA -Dtests.timezone=America/Godthab -Dtests.file.encoding=ISO-8859-1
[junit4] FAILURE 9.77s | TestDistributedSearch.testDistribSearch <<<
[junit4] > Throwable #1: java.lang.AssertionError: Expected the partialResults header to be null
[junit4] > at __randomizedtesting.SeedInfo.seed([36602D8709F109B4:B786A39F7EAE6988]:0)
[junit4] > at org.apache.solr.TestDistributedSearch.validateControlData(TestDistributedSearch.java:525)
[junit4] > at org.apache.solr.TestDistributedSearch.queryPartialResults(TestDistributedSearch.java:445)
[junit4] > at org.apache.solr.TestDistributedSearch.doTest(TestDistributedSearch.java:379)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:876)
[junit4] > at java.lang.Thread.run(Thread.java:744)
[junit4] 2> 2091690 T8093 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> NOTE: test params are: codec=Asserting, sim=DefaultSimilarity, locale=uk_UA, timezone=America/Godthab
[junit4] 2> NOTE: Windows 7 6.1 x86/Oracle Corporation 1.8.0 (32-bit)/cpus=2,threads=2,free=63933104,total=216006656
[junit4] 2> NOTE: All tests run in this JVM: [FieldAnalysisRequestHandlerTest, TestMaxScoreQueryParser, TestRealTimeGet, TestCloudManagedSchemaAddField, TestArbitraryIndexDir, CachingDirectoryFactoryTest, TestSolrIndexConfig, BadCopyFieldTest, TestAtomicUpdateErrorCases, TestReloadAndDeleteDocs, TestDefaultSearchFieldResource, TestBinaryResponseWriter, QueryElevationComponentTest, TestRandomFaceting, TestWordDelimiterFilterFactory, TestSolrCoreProperties, SolrTestCaseJ4Test, DeleteShardTest, TestIndexSearcher, TestCursorMarkWithoutUniqueKey, ChaosMonkeyNothingIsSafeTest, TestStressLucene, UniqFieldsUpdateProcessorFactoryTest, NotRequiredUniqueKeyTest, LeaderElectionIntegrationTest, CSVRequestHandlerTest, TestSolrXmlPersistor, TestLMDirichletSimilarityFactory, TestJmxMonitoredMap, AliasIntegrationTest, TestSimpleQParserPlugin, TestRangeQuery, SynonymTokenizerTest, BlockCacheTest, OpenCloseCoreStressTest, IndexSchemaRuntimeFieldTest, TestFiltering, DistanceFunctionTest, TestSchemaNameResource, SuggesterTSTTest, OverseerCollectionProcessorTest, TestUpdate, DirectUpdateHandlerOptimizeTest, SampleTest, BadComponentTest, ZkNodePropsTest, TestQuerySenderListener, SpatialFilterTest, TestAddFieldRealTimeGet, JsonLoaderTest, TestPhraseSuggestions, ScriptEngineTest, TestTrie, ChangedSchemaMergeTest, StatsComponentTest, TestMultiCoreConfBootstrap, LegacyHTMLStripCharFilterTest, TestSuggestSpellingConverter, LukeRequestHandlerTest, UUIDFieldTest, XsltUpdateRequestHandlerTest, TestCollationField, TestFunctionQuery, TestFastLRUCache, LeaderElectionTest, StandardRequestHandlerTest, SliceStateUpdateTest, MoreLikeThisHandlerTest, TestDistribDocBasedVersion, BasicDistributedZkTest, HardAutoCommitTest, TestNonNRTOpen, TestPostingsSolrHighlighter, TestReplicationHandler, FileUtilsTest, RemoteQueryErrorTest, ShardRoutingCustomTest, OpenExchangeRatesOrgProviderTest, StressHdfsTest, TestLazyCores, HdfsRecoveryZkTest, ChaosMonkeySafeLeaderTest, TestPerFieldSimilarity, TestSolrDeletionPolicy2, CurrencyFieldOpenExchangeTest, TestClassNameShortening, DirectSolrSpellCheckerTest, TestOmitPositions, CustomCollectionTest, PolyFieldTest, TestMergePolicyConfig, DateMathParserTest, TestShardHandlerFactory, TestHighlightDedupGrouping, TestRandomMergePolicy, TestImplicitCoreProperties, HdfsUnloadDistributedZkTest, TestCSVLoader, DirectSolrConnectionTest, TestFileDictionaryLookup, TestWriterPerf, TimeZoneUtilsTest, TestSolrQueryParserResource, CollectionsAPIDistributedZkTest, SuggesterTest, CurrencyFieldXmlFileTest, CoreMergeIndexesAdminHandlerTest, DocValuesMultiTest, TestCopyFieldCollectionResource, SchemaVersionSpecificBehaviorTest, MinimalSchemaTest, AlternateDirectoryTest, TestAnalyzedSuggestions, TestDynamicFieldResource, CopyFieldTest, TestSearchPerf, SearchHandlerTest, DocValuesTest, PreAnalyzedFieldTest, ShowFileRequestHandlerTest, RAMDirectoryFactoryTest, TestCoreDiscovery, StatelessScriptUpdateProcessorFactoryTest, TestSchemaSimilarityResource, TestSystemIdResolver, TestBM25SimilarityFactory, TestPHPSerializedResponseWriter, TestComponentsName, FastVectorHighlighterTest, CoreAdminHandlerTest, SolrRequestParserTest, DocValuesMissingTest, ResponseLogComponentTest, ReturnFieldsTest, TestDynamicFieldCollectionResource, TestFoldingMultitermQuery, SliceStateTest, CursorPagingTest, HdfsBasicDistributedZkTest, TestCollationFieldDocValues, CoreContainerCoreInitFailuresTest, MigrateRouteKeyTest, TestZkChroot, DistributedSpellCheckComponentTest, BasicZkTest, BadIndexSchemaTest, AnalysisAfterCoreReloadTest, SoftAutoCommitTest, TestSolrQueryParserDefaultOperatorResource, SpellPossibilityIteratorTest, TestFieldTypeResource, TestDocSet, InfoHandlerTest, SuggesterWFSTTest, DistributedTermsComponentTest, TriLevelCompositeIdRoutingTest, TestRemoteStreaming, RecoveryZkTest, SimplePostToolTest, WordBreakSolrSpellCheckerTest, TestExtendedDismaxParser, ConvertedLegacyTest, TestCustomSort, SortByFunctionTest, TestRecoveryHdfs, FieldMutatingUpdateProcessorTest, TestJoin, PrimUtilsTest, FullSolrCloudDistribCmdsTest, DocumentAnalysisRequestHandlerTest, ShardSplitTest, BasicDistributedZk2Test, UnloadDistributedZkTest, SyncSliceTest, OverseerTest, ShardRoutingTest, ClusterStateUpdateTest, ZkSolrClientTest, TestRandomDVFaceting, ZkCLITest, TestDistributedSearch]
[junit4] Completed in 9.81s, 1 test, 1 failure <<< FAILURES!
[...truncated 533 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:459: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:439: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\extra-targets.xml:37: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build.xml:189: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\common-build.xml:491: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:1308: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:941: There were test failures: 362 suites, 1563 tests, 1 error, 1 failure, 41 ignored (13 assumptions)
Total time: 72 minutes 50 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.8.0-fcs-b129 -client -XX:+UseG1GC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure