You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2015/01/08 02:35:42 UTC
[JENKINS] Lucene-Solr-4.10-Linux (32bit/jdk1.8.0_40-ea-b09) - Build
# 218 - Failure!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.10-Linux/218/
Java: 32bit/jdk1.8.0_40-ea-b09 -server -XX:+UseSerialGC (asserts: true)
1 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.MultiThreadedOCPTest
Error Message:
1 thread leaked from SUITE scope at org.apache.solr.cloud.MultiThreadedOCPTest: 1) Thread[id=2104, name=OverseerThreadFactory-950-thread-5, state=TIMED_WAITING, group=Overseer collection creation process.] at java.lang.Thread.sleep(Native Method) at org.apache.solr.cloud.OverseerCollectionProcessor.waitForCoreNodeName(OverseerCollectionProcessor.java:1627) at org.apache.solr.cloud.OverseerCollectionProcessor.splitShard(OverseerCollectionProcessor.java:1509) at org.apache.solr.cloud.OverseerCollectionProcessor.processMessage(OverseerCollectionProcessor.java:563) at org.apache.solr.cloud.OverseerCollectionProcessor$Runner.run(OverseerCollectionProcessor.java:2629) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.MultiThreadedOCPTest:
1) Thread[id=2104, name=OverseerThreadFactory-950-thread-5, state=TIMED_WAITING, group=Overseer collection creation process.]
at java.lang.Thread.sleep(Native Method)
at org.apache.solr.cloud.OverseerCollectionProcessor.waitForCoreNodeName(OverseerCollectionProcessor.java:1627)
at org.apache.solr.cloud.OverseerCollectionProcessor.splitShard(OverseerCollectionProcessor.java:1509)
at org.apache.solr.cloud.OverseerCollectionProcessor.processMessage(OverseerCollectionProcessor.java:563)
at org.apache.solr.cloud.OverseerCollectionProcessor$Runner.run(OverseerCollectionProcessor.java:2629)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
at __randomizedtesting.SeedInfo.seed([EDDB1E78339685A8]:0)
Build Log:
[...truncated 11384 lines...]
[junit4] Suite: org.apache.solr.cloud.MultiThreadedOCPTest
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.10-Linux/solr/build/solr-core/test/J0/./solr.cloud.MultiThreadedOCPTest-EDDB1E78339685A8-001/init-core-data-001
[junit4] 2> 609223 T1917 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (false)
[junit4] 2> 609223 T1917 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /cvm/ss
[junit4] 2> 609225 T1917 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> 609225 T1917 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 609226 T1918 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 609326 T1917 oasc.ZkTestServer.run start zk server on port:59055
[junit4] 2> 609327 T1917 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 609328 T1924 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1dab5b5 name:ZooKeeperConnection Watcher:127.0.0.1:59055 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 609329 T1917 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 609329 T1917 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 609331 T1917 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 609332 T1926 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7daca4 name:ZooKeeperConnection Watcher:127.0.0.1:59055/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 609332 T1917 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 609332 T1917 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 609334 T1917 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 609335 T1917 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 609336 T1917 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 609337 T1917 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.10-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 609337 T1917 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 609338 T1917 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.10-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 609339 T1917 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 609340 T1917 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.10-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 609340 T1917 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 609341 T1917 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.10-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 609342 T1917 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 609343 T1917 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.10-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 609343 T1917 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 609344 T1917 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.10-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 609345 T1917 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 609346 T1917 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.10-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 609346 T1917 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 609347 T1917 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.10-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 609348 T1917 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 609349 T1917 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.10-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 609349 T1917 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 609350 T1917 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.10-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 609351 T1917 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 609352 T1917 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.10-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 609352 T1917 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 609353 T1917 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 609354 T1928 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@86d3d2 name:ZooKeeperConnection Watcher:127.0.0.1:59055/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 609354 T1917 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 609609 T1917 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 609612 T1917 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 609615 T1917 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:41218
[junit4] 2> 609616 T1917 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 609616 T1917 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 609617 T1917 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.MultiThreadedOCPTest-EDDB1E78339685A8-001/tempDir-002
[junit4] 2> 609617 T1917 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.MultiThreadedOCPTest-EDDB1E78339685A8-001/tempDir-002/'
[junit4] 2> 609627 T1917 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.10-Linux/solr/build/solr-core/test/J0/./solr.cloud.MultiThreadedOCPTest-EDDB1E78339685A8-001/tempDir-002/solr.xml
[junit4] 2> 609634 T1917 oasc.CoreContainer.<init> New CoreContainer 28656642
[junit4] 2> 609635 T1917 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.MultiThreadedOCPTest-EDDB1E78339685A8-001/tempDir-002/]
[junit4] 2> 609635 T1917 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 609635 T1917 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 609636 T1917 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 609636 T1917 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 609636 T1917 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 609637 T1917 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 609637 T1917 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 609637 T1917 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 609637 T1917 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 609638 T1917 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 609639 T1917 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 609640 T1917 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 609640 T1917 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 609640 T1917 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:59055/solr
[junit4] 2> 609640 T1917 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 609641 T1917 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 609642 T1939 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@cdee5a name:ZooKeeperConnection Watcher:127.0.0.1:59055 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 609643 T1917 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 609644 T1917 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 609644 T1941 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@19dc300 name:ZooKeeperConnection Watcher:127.0.0.1:59055/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 609644 T1917 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 609646 T1917 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 609647 T1917 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 609649 T1917 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 609650 T1917 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 609651 T1917 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 609653 T1917 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 609654 T1917 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41218_cvm%2Fss
[junit4] 2> 609655 T1917 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:41218_cvm%2Fss
[junit4] 2> 609656 T1917 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 609657 T1917 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 609658 T1917 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 609659 T1917 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:41218_cvm%2Fss
[junit4] 2> 609659 T1917 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 609660 T1917 oasc.Overseer.start Overseer (id=93105575502807044-127.0.0.1:41218_cvm%2Fss-n_0000000000) starting
[junit4] 2> 609661 T1917 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 609665 T1917 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 609666 T1943 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 609666 T1942 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 609669 T1917 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 609671 T1917 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 609672 T1917 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 609676 T1945 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
[junit4] 2> 609677 T1945 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 609677 T1945 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 609677 T1946 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 609679 T1942 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:41218/cvm/ss",
[junit4] 2> "node_name":"127.0.0.1:41218_cvm%2Fss",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 609680 T1942 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 609680 T1942 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 609681 T1946 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 610678 T1945 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 610678 T1945 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 610678 T1945 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 610679 T1945 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 610680 T1945 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 610680 T1945 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.MultiThreadedOCPTest-EDDB1E78339685A8-001/tempDir-002/collection1/'
[junit4] 2> 610680 T1945 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.10-Linux/solr/build/solr-core/test/J0/solr.cloud.MultiThreadedOCPTest-EDDB1E78339685A8-001/tempDir-002/collection1/lib/.svn/' to classloader
[junit4] 2> 610681 T1945 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.10-Linux/solr/build/solr-core/test/J0/solr.cloud.MultiThreadedOCPTest-EDDB1E78339685A8-001/tempDir-002/collection1/lib/classes/' to classloader
[junit4] 2> 610681 T1945 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.10-Linux/solr/build/solr-core/test/J0/solr.cloud.MultiThreadedOCPTest-EDDB1E78339685A8-001/tempDir-002/collection1/lib/README' to classloader
[junit4] 2> 610706 T1945 oasc.SolrConfig.<init> Using Lucene MatchVersion: 4.10.3
[junit4] 2> 610732 T1945 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 610734 T1945 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 610740 T1945 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 610871 T1945 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 610871 T1945 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 610872 T1945 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 610878 T1945 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 610879 T1945 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 610886 T1945 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 610887 T1945 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 610888 T1945 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 610889 T1945 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 610889 T1945 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 610889 T1945 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 610890 T1945 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 610890 T1945 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 610890 T1945 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 610890 T1945 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 610890 T1945 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./solr.cloud.MultiThreadedOCPTest-EDDB1E78339685A8-001/tempDir-002/collection1/, dataDir=./solr.cloud.MultiThreadedOCPTest-EDDB1E78339685A8-001/tempDir-002/collection1/data/
[junit4] 2> 610890 T1945 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@13bd122
[junit4] 2> 610891 T1945 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.MultiThreadedOCPTest-EDDB1E78339685A8-001/tempDir-002/collection1/data
[junit4] 2> 610891 T1945 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solr.cloud.MultiThreadedOCPTest-EDDB1E78339685A8-001/tempDir-002/collection1/data/index/
[junit4] 2> 610891 T1945 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solr.cloud.MultiThreadedOCPTest-EDDB1E78339685A8-001/tempDir-002/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 610891 T1945 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.MultiThreadedOCPTest-EDDB1E78339685A8-001/tempDir-002/collection1/data/index
[junit4] 2> 610892 T1945 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=13, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.44166218927450007]
[junit4] 2> 610892 T1945 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@cfe8eb lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5c98b2),segFN=segments_1,generation=1}
[junit4] 2> 610892 T1945 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 610894 T1945 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 610894 T1945 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 610894 T1945 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 610894 T1945 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 610894 T1945 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 610895 T1945 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 610895 T1945 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 610895 T1945 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 610895 T1945 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 610895 T1945 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 610896 T1945 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 610896 T1945 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 610896 T1945 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 610896 T1945 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 610896 T1945 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 610897 T1945 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 610897 T1945 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 610897 T1945 oasc.RequestHandlers.initHandlersFromConfig WARN Multiple requestHandler registered to the same name: /update ignoring: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 610897 T1945 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 610897 T1945 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 610898 T1945 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 610899 T1945 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 610899 T1945 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 610900 T1945 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 610900 T1945 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 610901 T1945 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 610902 T1945 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 610902 T1945 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 610903 T1945 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=27, maxMergeAtOnceExplicit=41, maxMergedSegmentMB=47.892578125, floorSegmentMB=0.3046875, forceMergeDeletesPctAllowed=8.268164189756623, segmentsPerTier=35.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 610953 T1945 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@cfe8eb lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5c98b2),segFN=segments_1,generation=1}
[junit4] 2> 610954 T1945 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 610954 T1945 oass.SolrIndexSearcher.<init> Opening Searcher@b4b643[collection1] main
[junit4] 2> 610954 T1945 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 610956 T1945 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 610956 T1945 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 610957 T1945 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 610957 T1945 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 610957 T1945 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 610958 T1945 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 610958 T1945 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 610959 T1945 oascc.SolrZkClient.makePath makePath: /configs/conf1/_rest_managed.json
[junit4] 2> 610961 T1945 oasr.ManagedResourceStorage$ZooKeeperStorageIO$1.close Wrote 38 bytes to new znode /configs/conf1/_rest_managed.json
[junit4] 2> 610961 T1945 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 610961 T1945 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 610962 T1947 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@b4b643[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 610963 T1945 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 610963 T1950 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:41218/cvm/ss collection:control_collection shard:shard1
[junit4] 2> 610964 T1917 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.10-Linux/solr/build/solr-core/test/J0
[junit4] 2> 610964 T1950 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 610964 T1917 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 610966 T1917 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 610967 T1950 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 610967 T1952 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1d82fa6 name:ZooKeeperConnection Watcher:127.0.0.1:59055/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 610967 T1917 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 610968 T1946 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 610968 T1950 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 610968 T1950 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 610968 T1917 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> ASYNC NEW_CORE C680 name=collection1 org.apache.solr.core.SolrCore@f99068 url=https://127.0.0.1:41218/cvm/ss/collection1 node=127.0.0.1:41218_cvm%2Fss C680_STATE=coll:control_collection core:collection1 props:{core=collection1, base_url=https://127.0.0.1:41218/cvm/ss, node_name=127.0.0.1:41218_cvm%2Fss, state=down}
[junit4] 2> 610968 T1950 C680 P41218 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:41218/cvm/ss/collection1/
[junit4] 2> 610969 T1950 C680 P41218 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 610969 T1950 C680 P41218 oasc.SyncStrategy.syncToMe https://127.0.0.1:41218/cvm/ss/collection1/ has no replicas
[junit4] 2> 610969 T1950 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:41218/cvm/ss/collection1/ shard1
[junit4] 2> 610969 T1950 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 610970 T1917 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 610971 T1946 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 611073 T1946 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 611073 T1953 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 611122 T1950 oasc.ZkController.register We are https://127.0.0.1:41218/cvm/ss/collection1/ and leader is https://127.0.0.1:41218/cvm/ss/collection1/
[junit4] 2> 611122 T1950 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:41218/cvm/ss
[junit4] 2> 611122 T1950 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 611122 T1950 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
[junit4] 2> 611123 T1950 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 611123 T1946 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 611124 T1942 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:41218/cvm/ss",
[junit4] 2> "node_name":"127.0.0.1:41218_cvm%2Fss",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 611206 T1917 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 611206 T1917 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 611209 T1917 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 611209 T1917 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:48005
[junit4] 2> 611211 T1917 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 611211 T1917 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 611211 T1917 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.MultiThreadedOCPTest-EDDB1E78339685A8-001/tempDir-003
[junit4] 2> 611212 T1917 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.MultiThreadedOCPTest-EDDB1E78339685A8-001/tempDir-003/'
[junit4] 2> 611221 T1917 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.10-Linux/solr/build/solr-core/test/J0/./solr.cloud.MultiThreadedOCPTest-EDDB1E78339685A8-001/tempDir-003/solr.xml
[junit4] 2> 611241 T1946 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 611241 T1953 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 611244 T1917 oasc.CoreContainer.<init> New CoreContainer 811084
[junit4] 2> 611244 T1917 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.MultiThreadedOCPTest-EDDB1E78339685A8-001/tempDir-003/]
[junit4] 2> 611245 T1917 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 611246 T1917 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 611246 T1917 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 611247 T1917 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 611248 T1917 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 611248 T1917 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 611249 T1917 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 611250 T1917 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 611250 T1917 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 611253 T1917 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 611255 T1917 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 611256 T1917 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 611257 T1917 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 611257 T1917 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:59055/solr
[junit4] 2> 611258 T1917 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 611259 T1917 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 611260 T1964 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f60660 name:ZooKeeperConnection Watcher:127.0.0.1:59055 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 611261 T1917 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 611263 T1917 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 611264 T1966 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1139bb9 name:ZooKeeperConnection Watcher:127.0.0.1:59055/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 611265 T1917 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 611270 T1917 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 612272 T1917 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48005_cvm%2Fss
[junit4] 2> 612274 T1917 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:48005_cvm%2Fss
[junit4] 2> 612278 T1917 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 612283 T1968 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 612283 T1968 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 612284 T1968 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 612284 T1946 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 612286 T1942 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:48005/cvm/ss",
[junit4] 2> "node_name":"127.0.0.1:48005_cvm%2Fss",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"}
[junit4] 2> 612287 T1942 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
[junit4] 2> 612287 T1942 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 612390 T1946 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 612390 T1967 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 612390 T1953 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 613284 T1968 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 613285 T1968 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 613286 T1968 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 613286 T1968 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 613287 T1968 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 613288 T1968 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.MultiThreadedOCPTest-EDDB1E78339685A8-001/tempDir-003/collection1/'
[junit4] 2> 613289 T1968 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.10-Linux/solr/build/solr-core/test/J0/solr.cloud.MultiThreadedOCPTest-EDDB1E78339685A8-001/tempDir-003/collection1/lib/.svn/' to classloader
[junit4] 2> 613289 T1968 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.10-Linux/solr/build/solr-core/test/J0/solr.cloud.MultiThreadedOCPTest-EDDB1E78339685A8-001/tempDir-003/collection1/lib/classes/' to classloader
[junit4] 2> 613290 T1968 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.10-Linux/solr/build/solr-core/test/J0/solr.cloud.MultiThreadedOCPTest-EDDB1E78339685A8-001/tempDir-003/collection1/lib/README' to classloader
[junit4] 2> 613313 T1968 oasc.SolrConfig.<init> Using Lucene MatchVersion: 4.10.3
[junit4] 2> 613322 T1968 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 613323 T1968 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 613327 T1968 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 613437 T1968 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 613438 T1968 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 613439 T1968 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 613442 T1968 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 613443 T1968 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 613449 T1968 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 613451 T1968 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 613452 T1968 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 613453 T1968 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 613453 T1968 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 613453 T1968 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 613454 T1968 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 613454 T1968 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 613454 T1968 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 613454 T1968 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 613454 T1968 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./solr.cloud.MultiThreadedOCPTest-EDDB1E78339685A8-001/tempDir-003/collection1/, dataDir=./solr.cloud.MultiThreadedOCPTest-EDDB1E78339685A8-001/tempDir-003/collection1/data/
[junit4] 2> 613455 T1968 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@13bd122
[junit4] 2> 613455 T1968 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.MultiThreadedOCPTest-EDDB1E78339685A8-001/tempDir-003/collection1/data
[junit4] 2> 613455 T1968 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solr.cloud.MultiThreadedOCPTest-EDDB1E78339685A8-001/tempDir-003/collection1/data/index/
[junit4] 2> 613455 T1968 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solr.cloud.MultiThreadedOCPTest-EDDB1E78339685A8-001/tempDir-003/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 613456 T1968 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.MultiThreadedOCPTest-EDDB1E78339685A8-001/tempDir-003/collection1/data/index
[junit4] 2> 613456 T1968 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=13, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.44166218927450007]
[junit4] 2> 613456 T1968 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@5d74d6 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@14f4bca),segFN=segments_1,generation=1}
[junit4] 2> 613457 T1968 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 613458 T1968 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 613458 T1968 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 613459 T1968 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 613459 T1968 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 613459 T1968 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 613459 T1968 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 613459 T1968 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 613459 T1968 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 613460 T1968 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 613468 T1968 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 613468 T1968 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 613468 T1968 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 613469 T1968 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 613469 T1968 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 613469 T1968 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 613469 T1968 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 613469 T1968 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 613470 T1968 oasc.RequestHandlers.initHandlersFromConfig WARN Multiple requestHandler registered to the same name: /update ignoring: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 613470 T1968 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 613470 T1968 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 613470 T1968 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 613472 T1968 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 613472 T1968 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 613473 T1968 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 613473 T1968 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 613474 T1968 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 613475 T1968 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 613475 T1968 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 613475 T1968 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=27, maxMergeAtOnceExplicit=41, maxMergedSegmentMB=47.892578125, floorSegmentMB=0.3046875, forceMergeDeletesPctAllowed=8.268164189756623, segmentsPerTier=35.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 613526 T1968 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@5d74d6 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@14f4bca),segFN=segments_1,generation=1}
[junit4] 2> 613526 T1968 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 613526 T1968 oass.SolrIndexSearcher.<init> Opening Searcher@17f0616[collection1] main
[junit4] 2> 613527 T1968 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 613527 T1968 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 613528 T1968 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 613528 T1968 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 613528 T1968 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 613528 T1968 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 613529 T1968 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json
[junit4] 2> 613529 T1968 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 613529 T1968 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed
[junit4] 2> 613529 T1968 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 613531 T1969 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@17f0616[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 613532 T1968 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 613533 T1972 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:48005/cvm/ss collection:collection1 shard:shard2
[junit4] 2> 613533 T1917 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.10-Linux/solr/build/solr-core/test/J0
[junit4] 2> 613533 T1972 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 613533 T1917 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 613536 T1972 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 613537 T1946 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 613537 T1972 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 613537 T1972 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C681 name=collection1 org.apache.solr.core.SolrCore@89e512 url=https://127.0.0.1:48005/cvm/ss/collection1 node=127.0.0.1:48005_cvm%2Fss C681_STATE=coll:collection1 core:collection1 props:{core=collection1, base_url=https://127.0.0.1:48005/cvm/ss, node_name=127.0.0.1:48005_cvm%2Fss, state=down}
[junit4] 2> 613537 T1972 C681 P48005 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:48005/cvm/ss/collection1/
[junit4] 2> 613537 T1972 C681 P48005 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 613538 T1972 C681 P48005 oasc.SyncStrategy.syncToMe https://127.0.0.1:48005/cvm/ss/collection1/ has no replicas
[junit4] 2> 613538 T1972 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:48005/cvm/ss/collection1/ shard2
[junit4] 2> 613538 T1972 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 613540 T1946 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 613642 T1953 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 613642 T1946 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 613642 T1967 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 613691 T1972 oasc.ZkController.register We are https://127.0.0.1:48005/cvm/ss/collection1/ and leader is https://127.0.0.1:48005/cvm/ss/collection1/
[junit4] 2> 613691 T1972 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:48005/cvm/ss
[junit4] 2> 613691 T1972 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 613691 T1972 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 613691 T1972 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 613692 T1946 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 613694 T1942 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:48005/cvm/ss",
[junit4] 2> "node_name":"127.0.0.1:48005_cvm%2Fss",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"}
[junit4] 2> 613771 T1917 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 613772 T1917 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 613775 T1917 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 613776 T1917 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:47315
[junit4] 2> 613777 T1917 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 613777 T1917 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 613778 T1917 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.MultiThreadedOCPTest-EDDB1E78339685A8-001/tempDir-004
[junit4] 2> 613778 T1917 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.MultiThreadedOCPTest-EDDB1E78339685A8-001/tempDir-004/'
[junit4] 2> 613788 T1917 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.10-Linux/solr/build/solr-core/test/J0/./solr.cloud.MultiThreadedOCPTest-EDDB1E78339685A8-001/tempDir-004/solr.xml
[junit4] 2> 613794 T1917 oasc.CoreContainer.<init> New CoreContainer 7161342
[junit4] 2> 613794 T1917 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.MultiThreadedOCPTest-EDDB1E78339685A8-001/tempDir-004/]
[junit4] 2> 613795 T1917 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 613795 T1917 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 613796 T1917 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 613796 T1917 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 613796 T1917 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 613795 T1953 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 613795 T1967 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 613795 T1946 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 613796 T1917 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 613797 T1917 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 613798 T1917 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 613798 T1917 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 613799 T1917 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 613800 T1917 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 613800 T1917 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 613801 T1917 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 613801 T1917 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:59055/solr
[junit4] 2> 613801 T1917 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 613802 T1917 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 613802 T1983 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c8a553 name:ZooKeeperConnection Watcher:127.0.0.1:59055 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 613803 T1917 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 613804 T1917 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 613805 T1985 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1882fba name:ZooKeeperConnection Watcher:127.0.0.1:59055/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 613805 T1917 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 613808 T1917 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 614810 T1917 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47315_cvm%2Fss
[junit4] 2> 614812 T1917 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:47315_cvm%2Fss
[junit4] 2> 614818 T1917 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 614824 T1987 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 614825 T1987 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 614826 T1946 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 614826 T1987 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 614828 T1942 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:47315/cvm/ss",
[junit4] 2> "node_name":"127.0.0.1:47315_cvm%2Fss",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"}
[junit4] 2> 614828 T1942 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 614829 T1942 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 614932 T1986 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 614932 T1953 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 614932 T1967 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 614932 T1946 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 615827 T1987 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 615827 T1987 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 615828 T1987 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 615828 T1987 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 615830 T1987 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 615830 T1987 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.MultiThreadedOCPTest-EDDB1E78339685A8-001/tempDir-004/collection1/'
[junit4] 2> 615831 T1987 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.10-Linux/solr/build/solr-core/test/J0/solr.cloud.MultiThreadedOCPTest-EDDB1E78339685A8-001/tempDir-004/collection1/lib/.svn/' to classloader
[junit4] 2> 615832 T1987 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.10-Linux/solr/build/solr-core/test/J0/solr.cloud.MultiThreadedOCPTest-EDDB1E78339685A8-001/tempDir-004/collection1/lib/classes/' to classloader
[junit4] 2> 615832 T1987 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.10-Linux/solr/build/solr-core/test/J0/solr.cloud.MultiThreadedOCPTest-EDDB1E78339685A8-001/tempDir-004/collection1/lib/README' to classloader
[junit4] 2> 615879 T1987 oasc.SolrConfig.<init> Using Lucene MatchVersion: 4.10.3
[junit4] 2> 615888 T1987 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 615890 T1987 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 615895 T1987 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 616032 T1987 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 616033 T1987 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 616033 T1987 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 616037 T1987 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 616038 T1987 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 616048 T1987 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 616050 T1987 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 616052 T1987 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 616053 T1987 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 616053 T1987 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 616053 T1987 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 616055 T1987 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 616055 T1987 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 616055 T1987 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 616056 T1987 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 616056 T1987 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./solr.cloud.MultiThreadedOCPTest-EDDB1E78339685A8-001/tempDir-004/collection1/, dataDir=./solr.cloud.MultiThreadedOCPTest-EDDB1E78339685A8-001/tempDir-004/collection1/data/
[junit4] 2> 616056 T1987 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@13bd122
[junit4] 2> 616058 T1987 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.MultiThreadedOCPTest-EDDB1E78339685A8-001/tempDir-004/collection1/data
[junit4] 2> 616058 T1987 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solr.cloud.MultiThreadedOCPTest-EDDB1E78339685A8-001/tempDir-004/collection1/data/index/
[junit4] 2> 616058 T1987 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solr.cloud.MultiThreadedOCPTest-EDDB1E78339685A8-001/tempDir-004/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 616059 T1987 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.MultiThreadedOCPTest-EDDB1E78339685A8-001/tempDir-004/collection1/data/index
[junit4] 2> 616059 T1987 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=13, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.44166218927450007]
[junit4] 2> 616060 T1987 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@125e7c0 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1fdaffa),segFN=segments_1,generation=1}
[junit4] 2> 616060 T1987 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 616064 T1987 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 616064 T1987 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 616065 T1987 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 616065 T1987 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 616065 T1987 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 616066 T1987 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 616066 T1987 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 616066 T1987 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 616067 T1987 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 616067 T1987 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 616068 T1987 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 616068 T1987 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 616069 T1987 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 616069 T1987 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 616070 T1987 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 616070 T1987 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 616071 T1987 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 616071 T1987 oasc.RequestHandlers.initHandlersFromConfig WARN Multiple requestHandler registered to the same name: /update ignoring: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 616071 T1987 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 616072 T1987 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 616072 T1987 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 616075 T1987 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 616076 T1987 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 616077 T1987 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 616077 T1987 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 616078 T1987 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 616079 T1987 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 616079 T1987 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 616080 T1987 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=27, maxMergeAtOnceExplicit=41, maxMergedSegmentMB=47.892578125, floorSegmentMB=0.3046875, forceMergeDeletesPctAllowed=8.268164189756623, segmentsPerTier=35.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 616130 T1987 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@125e7c0 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1fdaffa),segFN=segments_1,generation=1}
[junit4] 2> 616131 T1987 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 616131 T1987 oass.SolrIndexSearcher.<init> Opening Searcher@2b4b94[collection1] main
[junit4] 2> 616131 T1987 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 616133 T1987 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 616133 T1987 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 616134 T1987 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 616134 T1987 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 616134 T1987 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 616136 T1987 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json
[junit4] 2> 616136 T1987 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 616136 T1987 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed
[junit4] 2> 616137 T1987 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 616140 T1988 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2b4b94[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 616142 T1987 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 616143 T1991 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:47315/cvm/ss collection:collection1 shard:shard1
[junit4] 2> 616144 T1917 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.10-Linux/solr/build/solr-core/test/J0
[junit4] 2> 616145 T1917 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 616144 T1991 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 616151 T1991 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 616154 T1946 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 616154 T1991 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 616154 T1991 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C682 name=collection1 org.apache.solr.core.SolrCore@ab37ca url=https://127.0.0.1:47315/cvm/ss/collection1 node=127.0.0.1:47315_cvm%2Fss C682_STATE=coll:collection1 core:collection1 props:{core=collection1, base_url=https://127.0.0.1:47315/cvm/ss, node_name=127.0.0.1:47315_cvm%2Fss, state=down}
[junit4] 2> 616154 T1991 C682 P47315 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:47315/cvm/ss/collection1/
[junit4] 2> 616155 T1991 C682 P47315 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 616155 T1991 C682 P47315 oasc.SyncStrategy.syncToMe https://127.0.0.1:47315/cvm/ss/collection1/ has no replicas
[junit4] 2> 616155 T1991 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:47315/cvm/ss/collection1/ shard1
[junit4] 2> 616156 T1991 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 616158 T1946 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 616260 T1986 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 616260 T1967 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 616260 T1953 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 616260 T1946 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 616311 T1991 oasc.ZkController.register We are https://127.0.0.1:47315/cvm/ss/collection1/ and leader is https://127.0.0.1:47315/cvm/ss/collection1/
[junit4] 2> 616312 T1991 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:47315/cvm/ss
[junit4] 2> 616312 T1991 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 616312 T1991 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 616312 T1991 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 616313 T1946 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 616314 T1942 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node2",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:47315/cvm/ss",
[junit4] 2> "node_name":"127.0.0.1:47315_cvm%2Fss",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"}
[junit4] 2> 616412 T1917 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 616412 T1917 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 616416 T1917 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 616416 T1917 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:44190
[junit4] 2> 616417 T1967 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 616417 T1953 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 616417 T1986 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 616417 T1946 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 616418 T1917 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 616418 T1917 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 616419 T1917 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.MultiThreadedOCPTest-EDDB1E78339685A8-001/tempDir-005
[junit4] 2> 616419 T1917 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.MultiThreadedOCPTest-EDDB1E78339685A8-001/tempDir-005/'
[junit4] 2> 616428 T1917 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.10-Linux/solr/build/solr-core/test/J0/./solr.cloud.MultiThreadedOCPTest-EDDB1E78339685A8-001/tempDir-005/solr.xml
[junit4] 2> 616435 T1917 oasc.CoreContainer.<init> New CoreContainer 6426711
[junit4] 2> 616435 T1917 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.MultiThreadedOCPTest-EDDB1E78339685A8-001/tempDir-005/]
[junit4] 2> 616435 T1917 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 616436 T1917 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 616436 T1917 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 616436 T1917 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 616437 T1917 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 616437 T1917 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 616437 T1917 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 616437 T1917 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 616438 T1917 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 616439 T1917 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
[junit4] 2> 616439 T1917 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 616440 T1917 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 616440 T1917 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 616440 T1917 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:59055/solr
[junit4] 2> 616441 T1917 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 616441 T1917 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 616442 T2002 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b1d628 name:ZooKeeperConnection Watcher:127.0.0.1:59055 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 616444 T1917 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 616446 T1917 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 616447 T2004 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@88786c name:ZooKeeperConnection Watcher:127.0.0.1:59055/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 616447 T1917 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 616453 T1917 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 617457 T1917 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44190_cvm%2Fss
[junit4] 2> 617459 T1917 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:44190_cvm%2Fss
[junit4] 2> 617465 T1917 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 617470 T2006 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 617471 T2006 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 617472 T1946 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 617472 T2006 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 617475 T1942 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:44190/cvm/ss",
[junit4] 2> "node_name":"127.0.0.1:44190_cvm%2Fss",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"}
[junit4] 2> 617475 T1942 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 617475 T1942 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 617578 T1986 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 617579 T1967 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 617579 T1953 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 617579 T2005 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 617578 T1946 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 618472 T2006 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 618473 T2006 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 618474 T2006 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 618474 T2006 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 618475 T2006 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 618476 T2006 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.MultiThreadedOCPTest-EDDB1E78339685A8-001/tempDir-005/collection1/'
[junit4] 2> 618477 T2006 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.10-Linux/solr/build/solr-core/test/J0/solr.cloud.MultiThreadedOCPTest-EDDB1E78339685A8-001/tempDir-005/collection1/lib/.svn/' to classloader
[junit4] 2> 618477 T2006 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.10-Linux/solr/build/solr-core/test/J0/solr.cloud.MultiThreadedOCPTest-EDDB1E78339685A8-001/tempDir-005/collection1/lib/classes/' to classloader
[junit4] 2> 618477 T2006 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.10-Linux/solr/build/solr-core/test/J0/solr.cloud.MultiThreadedOCPTest-EDDB1E78339685A8-001/tempDir-005/collection1/lib/README' to classloader
[junit4] 2> 618505 T2006 oasc.SolrConfig.<init> Using Lucene MatchVersion: 4.10.3
[junit4] 2> 618536 T2006 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 618538 T2006 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 618542 T2006 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 618691 T2006 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 618693 T2006 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 618693 T2006 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 618698 T2006 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 618700 T2006 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 618706 T2006 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 618708 T2006 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 618709 T2006 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 618710 T2006 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 618710 T2006 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 618710 T2006 oass.OpenExchangeRatesOrgProvider.reload Reloadin
[...truncated too long message...]
rocessor.splitShard(OverseerCollectionProcessor.java:1509)
[junit4] 2> at org.apache.solr.cloud.OverseerCollectionProcessor.processMessage(OverseerCollectionProcessor.java:563)
[junit4] 2> at org.apache.solr.cloud.OverseerCollectionProcessor$Runner.run(OverseerCollectionProcessor.java:2629)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 175582 T1916 ccr.ThreadLeakControl.tryToInterruptAll Starting to interrupt leaked threads:
[junit4] 2> 1) Thread[id=2104, name=OverseerThreadFactory-950-thread-5, state=TIMED_WAITING, group=Overseer collection creation process.]
[junit4] 2> 784816 T2104 oasc.SolrException.log ERROR Collection: collection1 operation: splitshard failed:org.apache.solr.common.SolrException: Could not find coreNodeName
[junit4] 2> at org.apache.solr.cloud.OverseerCollectionProcessor.waitForCoreNodeName(OverseerCollectionProcessor.java:1632)
[junit4] 2> at org.apache.solr.cloud.OverseerCollectionProcessor.splitShard(OverseerCollectionProcessor.java:1509)
[junit4] 2> at org.apache.solr.cloud.OverseerCollectionProcessor.processMessage(OverseerCollectionProcessor.java:563)
[junit4] 2> at org.apache.solr.cloud.OverseerCollectionProcessor$Runner.run(OverseerCollectionProcessor.java:2629)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 784817 T2104 oasc.SolrException.log ERROR :org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/collection-map-failure/mn-2000
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:273)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:270)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:74)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:270)
[junit4] 2> at org.apache.solr.cloud.DistributedMap.createData(DistributedMap.java:116)
[junit4] 2> at org.apache.solr.cloud.DistributedMap.put(DistributedMap.java:129)
[junit4] 2> at org.apache.solr.cloud.OverseerCollectionProcessor$Runner.run(OverseerCollectionProcessor.java:2637)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 784817 T2104 oasc.OverseerCollectionProcessor$Runner.resetTaskWithException WARN Resetting task: /overseer/collection-queue-work/qn-0000000010, requestid: 2000, collectionName: collection1
[junit4] 2> 784817 T2104 oasc.SolrException.log ERROR :org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/collection-map-running/mn-2000
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:189)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:186)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:74)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:186)
[junit4] 2> at org.apache.solr.cloud.DistributedMap.remove(DistributedMap.java:171)
[junit4] 2> at org.apache.solr.cloud.OverseerCollectionProcessor$Runner.resetTaskWithException(OverseerCollectionProcessor.java:2697)
[junit4] 2> at org.apache.solr.cloud.OverseerCollectionProcessor$Runner.run(OverseerCollectionProcessor.java:2665)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 175595 T1916 ccr.ThreadLeakControl.tryToInterruptAll All leaked threads terminated.
[junit4] 2> NOTE: test params are: codec=Lucene3x, sim=RandomSimilarityProvider(queryNorm=true,coord=yes): {}, locale=ms, timezone=America/Montevideo
[junit4] 2> NOTE: Linux 3.13.0-43-generic i386/Oracle Corporation 1.8.0_40-ea (32-bit)/cpus=8,threads=1,free=53003944,total=173219840
[junit4] 2> NOTE: All tests run in this JVM: [TestStandardQParsers, TestSuggestSpellingConverter, BadCopyFieldTest, TestRestManager, TestDefaultSearchFieldResource, ShardRoutingTest, HighlighterTest, DeleteLastCustomShardedReplicaTest, NotRequiredUniqueKeyTest, ZkNodePropsTest, TestDFRSimilarityFactory, PreAnalyzedFieldTest, MoreLikeThisHandlerTest, TestFieldResource, DistributedExpandComponentTest, ZkCLITest, TestDocBasedVersionConstraints, HdfsCollectionsAPIDistributedZkTest, TestDynamicFieldCollectionResource, ShowFileRequestHandlerTest, TestStressRecovery, HighlighterConfigTest, FileUtilsTest, SharedFSAutoReplicaFailoverTest, OverseerStatusTest, TestBlendedInfixSuggestions, ReturnFieldsTest, NoCacheHeaderTest, DirectUpdateHandlerTest, RequiredFieldsTest, TestFieldCollectionResource, SuggesterWFSTTest, CoreAdminRequestStatusTest, TestFuzzyAnalyzedSuggestions, TestMiniSolrCloudCluster, TestSolrJ, TestHashPartitioner, ClusterStateUpdateTest, RollingRestartTest, TestManagedSchemaFieldResource, TermsComponentTest, OpenExchangeRatesOrgProviderTest, BadComponentTest, JSONWriterTest, XsltUpdateRequestHandlerTest, JsonLoaderTest, DateMathParserTest, TestCollationKeyRangeQueries, SuggesterTSTTest, TestAddFieldRealTimeGet, DistributedFacetPivotSmallTest, TestManagedResourceStorage, TestCollapseQParserPlugin, TestExceedMaxTermLength, SimpleFacetsTest, AtomicUpdatesTest, DocValuesMissingTest, IndexBasedSpellCheckerTest, AddBlockUpdateTest, CursorPagingTest, UpdateParamsTest, PeerSyncTest, TestRandomMergePolicy, SolrXmlInZkTest, CoreAdminHandlerTest, MultiThreadedOCPTest]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=MultiThreadedOCPTest -Dtests.seed=EDDB1E78339685A8 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ms -Dtests.timezone=America/Montevideo -Dtests.file.encoding=UTF-8
[junit4] ERROR 0.00s J0 | MultiThreadedOCPTest (suite) <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.MultiThreadedOCPTest:
[junit4] > 1) Thread[id=2104, name=OverseerThreadFactory-950-thread-5, state=TIMED_WAITING, group=Overseer collection creation process.]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at org.apache.solr.cloud.OverseerCollectionProcessor.waitForCoreNodeName(OverseerCollectionProcessor.java:1627)
[junit4] > at org.apache.solr.cloud.OverseerCollectionProcessor.splitShard(OverseerCollectionProcessor.java:1509)
[junit4] > at org.apache.solr.cloud.OverseerCollectionProcessor.processMessage(OverseerCollectionProcessor.java:563)
[junit4] > at org.apache.solr.cloud.OverseerCollectionProcessor$Runner.run(OverseerCollectionProcessor.java:2629)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > at __randomizedtesting.SeedInfo.seed([EDDB1E78339685A8]:0)
[junit4] Completed on J0 in 175.63s, 1 test, 1 error <<< FAILURES!
[...truncated 1043 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.10-Linux/build.xml:474: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.10-Linux/build.xml:454: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.10-Linux/build.xml:45: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.10-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.10-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.10-Linux/solr/common-build.xml:494: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.10-Linux/lucene/common-build.xml:1351: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.10-Linux/lucene/common-build.xml:966: There were test failures: 421 suites, 1757 tests, 1 suite-level error, 25 ignored (18 assumptions)
Total time: 103 minutes 46 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 32bit/jdk1.8.0_40-ea-b09 -server -XX:+UseSerialGC (asserts: true)
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any