You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/05/27 21:22:48 UTC

[JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.8.0_20-ea-b15) - Build # 10399 - Still Failing!

Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/10399/
Java: 32bit/jdk1.8.0_20-ea-b15 -client -XX:+UseConcMarkSweepGC

3 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeySafeLeaderTest

Error Message:
Suite timeout exceeded (>= 7200000 msec).

Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
	at __randomizedtesting.SeedInfo.seed([149163C6A3B631CF]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeySafeLeaderTest

Error Message:
Captured an uncaught exception in thread: Thread[id=4024, name=RecoveryThread, state=RUNNABLE, group=TGRP-ChaosMonkeySafeLeaderTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=4024, name=RecoveryThread, state=RUNNABLE, group=TGRP-ChaosMonkeySafeLeaderTest]
Caused by: java.lang.AssertionError: liveDocs.count()=10 info.docCount=16 info.getDelCount()=8
	at __randomizedtesting.SeedInfo.seed([149163C6A3B631CF]:0)
	at org.apache.lucene.codecs.lucene40.Lucene40LiveDocsFormat.readLiveDocs(Lucene40LiveDocsFormat.java:92)
	at org.apache.lucene.index.SegmentReader.<init>(SegmentReader.java:109)
	at org.apache.lucene.index.ReadersAndUpdates.getReader(ReadersAndUpdates.java:133)
	at org.apache.lucene.index.ReadersAndUpdates.getReadOnlyClone(ReadersAndUpdates.java:185)
	at org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:95)
	at org.apache.lucene.index.IndexWriter.getReader(IndexWriter.java:388)
	at org.apache.lucene.index.StandardDirectoryReader.doOpenIfChanged(StandardDirectoryReader.java:269)
	at org.apache.lucene.index.DirectoryReader.openIfChanged(DirectoryReader.java:204)
	at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:1489)
	at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1690)
	at org.apache.solr.handler.SnapPuller.openNewSearcherAndUpdateCommitPoint(SnapPuller.java:673)
	at org.apache.solr.handler.SnapPuller.fetchLatestIndex(SnapPuller.java:493)
	at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:337)
	at org.apache.solr.cloud.RecoveryStrategy.replicate(RecoveryStrategy.java:163)
	at org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:447)
	at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:235)


REGRESSION:  org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.testDistribSearch

Error Message:
Test abandoned because suite timeout was reached.

Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
	at __randomizedtesting.SeedInfo.seed([149163C6A3B631CF]:0)




Build Log:
[...truncated 11894 lines...]
   [junit4] Suite: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
   [junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-149163C6A3B631CF-001/init-core-data-001
   [junit4]   2> 872614 T3610 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (true)
   [junit4]   2> 872614 T3610 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /br_dy/k
   [junit4]   2> 872619 T3610 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> 872619 T3610 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 872620 T3611 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 872720 T3610 oasc.ZkTestServer.run start zk server on port:56193
   [junit4]   2> 872721 T3610 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 872815 T3617 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@90131c name:ZooKeeperConnection Watcher:127.0.0.1:56193 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 872815 T3610 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 872816 T3610 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 872823 T3610 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 872825 T3619 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@24a912 name:ZooKeeperConnection Watcher:127.0.0.1:56193/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 872825 T3610 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 872826 T3610 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 872832 T3610 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 872837 T3610 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 872842 T3610 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 872847 T3610 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 872848 T3610 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 872856 T3610 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
   [junit4]   2> 872857 T3610 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 872863 T3610 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 872864 T3610 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 872870 T3610 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 872871 T3610 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 872875 T3610 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 872876 T3610 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 872881 T3610 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 872882 T3610 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 872887 T3610 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 872888 T3610 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 872893 T3610 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 872894 T3610 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 872899 T3610 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 872900 T3610 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 872905 T3610 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 872906 T3610 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 872911 T3610 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 872912 T3610 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 873232 T3610 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 873237 T3610 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:60738
   [junit4]   2> 873239 T3610 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 873239 T3610 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 873240 T3610 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-149163C6A3B631CF-001/tempDir-002
   [junit4]   2> 873241 T3610 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-149163C6A3B631CF-001/tempDir-002/'
   [junit4]   2> 873273 T3610 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-149163C6A3B631CF-001/tempDir-002/solr.xml
   [junit4]   2> 873288 T3610 oasc.CoreContainer.<init> New CoreContainer 26338688
   [junit4]   2> 873288 T3610 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-149163C6A3B631CF-001/tempDir-002/]
   [junit4]   2> 873289 T3610 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 873290 T3610 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 873290 T3610 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 873290 T3610 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 873291 T3610 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 873291 T3610 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 873291 T3610 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 873292 T3610 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 873292 T3610 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 873293 T3610 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 873293 T3610 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 873293 T3610 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 873294 T3610 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:56193/solr
   [junit4]   2> 873294 T3610 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 873295 T3610 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 873298 T3630 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d7724d name:ZooKeeperConnection Watcher:127.0.0.1:56193 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 873299 T3610 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 873302 T3610 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 873304 T3632 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ca69d7 name:ZooKeeperConnection Watcher:127.0.0.1:56193/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 873305 T3610 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 873307 T3610 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 873312 T3610 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 873317 T3610 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
   [junit4]   2> 873322 T3610 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
   [junit4]   2> 873328 T3610 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
   [junit4]   2> 873335 T3610 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 873338 T3610 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60738_br_dy%2Fk
   [junit4]   2> 873340 T3610 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:60738_br_dy%2Fk
   [junit4]   2> 873346 T3610 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 873350 T3610 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 873359 T3610 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:60738_br_dy%2Fk
   [junit4]   2> 873360 T3610 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 873364 T3610 oasc.Overseer.start Overseer (id=91829784499191811-127.0.0.1:60738_br_dy%2Fk-n_0000000000) starting
   [junit4]   2> 873369 T3610 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 873387 T3634 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 873389 T3610 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 873393 T3610 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 873397 T3610 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 873403 T3633 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 873407 T3635 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
   [junit4]   2> 873407 T3635 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 873413 T3632 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 873413 T3635 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 873416 T3633 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 873418 T3633 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:60738/br_dy/k",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:60738_br_dy%2Fk",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 873418 T3633 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
   [junit4]   2> 873419 T3633 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 873425 T3632 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 873431 T3632 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 874414 T3635 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 874415 T3635 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
   [junit4]   2> 874416 T3635 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 874416 T3635 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 874418 T3635 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 874419 T3635 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-149163C6A3B631CF-001/tempDir-002/collection1/'
   [junit4]   2> 874420 T3635 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-149163C6A3B631CF-001/tempDir-002/collection1/lib/.svn/' to classloader
   [junit4]   2> 874421 T3635 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-149163C6A3B631CF-001/tempDir-002/collection1/lib/classes/' to classloader
   [junit4]   2> 874421 T3635 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-149163C6A3B631CF-001/tempDir-002/collection1/lib/README' to classloader
   [junit4]   2> 874479 T3635 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
   [junit4]   2> 874503 T3635 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 874505 T3635 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 874519 T3635 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 874637 T3635 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 874638 T3635 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 874640 T3635 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 874643 T3635 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 874666 T3635 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 874666 T3635 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
   [junit4]   2> 874680 T3635 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-149163C6A3B631CF-001/tempDir-002/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-149163C6A3B631CF-001/tempDir-001/control/data/
   [junit4]   2> 874680 T3635 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e37ddb
   [junit4]   2> 874681 T3635 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-149163C6A3B631CF-001/tempDir-001/control/data
   [junit4]   2> 874682 T3635 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-149163C6A3B631CF-001/tempDir-001/control/data/index/
   [junit4]   2> 874682 T3635 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-149163C6A3B631CF-001/tempDir-001/control/data/index' doesn't exist. Creating new index...
   [junit4]   2> 874683 T3635 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-149163C6A3B631CF-001/tempDir-001/control/data/index
   [junit4]   2> 874684 T3635 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=27, maxMergeAtOnceExplicit=13, maxMergedSegmentMB=97.58984375, floorSegmentMB=1.125, forceMergeDeletesPctAllowed=23.55808309455297, segmentsPerTier=10.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.18894746327439693
   [junit4]   2> 874689 T3635 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-149163C6A3B631CF-001/tempDir-001/control/data/index,segFN=segments_1,generation=1}
   [junit4]   2> 874690 T3635 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 874698 T3635 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 874699 T3635 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 874700 T3635 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 874701 T3635 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 874703 T3635 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 874703 T3635 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 874704 T3635 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 874704 T3635 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 874704 T3635 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 874705 T3635 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 874706 T3635 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 874706 T3635 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 874706 T3635 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 874707 T3635 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 874707 T3635 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 874708 T3635 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 874709 T3635 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 874711 T3635 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 874715 T3635 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 874716 T3635 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 874717 T3635 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=46, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.24623299217090633]
   [junit4]   2> 874719 T3635 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-149163C6A3B631CF-001/tempDir-001/control/data/index,segFN=segments_1,generation=1}
   [junit4]   2> 874720 T3635 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 874720 T3635 oass.SolrIndexSearcher.<init> Opening Searcher@15c2bd7[collection1] main
   [junit4]   2> 874721 T3635 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 874723 T3635 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 874723 T3635 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 874724 T3635 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 874725 T3635 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 874725 T3635 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 874727 T3635 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 874727 T3635 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 874728 T3635 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
   [junit4]   2> 874728 T3635 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 874738 T3636 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@15c2bd7[collection1] main{UninvertingDirectoryReader()}
   [junit4]   2> 874744 T3635 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 874745 T3639 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:60738/br_dy/k collection:control_collection shard:shard1
   [junit4]   2> 874746 T3610 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 874747 T3610 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 874747 T3639 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 874749 T3610 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 874750 T3641 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@cd2c86 name:ZooKeeperConnection Watcher:127.0.0.1:56193/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 874751 T3610 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 874752 T3610 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 874758 T3610 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 874760 T3639 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 874763 T3632 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 874764 T3639 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 874764 T3639 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C3164 name=collection1 org.apache.solr.core.SolrCore@2f42af url=http://127.0.0.1:60738/br_dy/k/collection1 node=127.0.0.1:60738_br_dy%2Fk C3164_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:60738/br_dy/k, core=collection1, node_name=127.0.0.1:60738_br_dy%2Fk}
   [junit4]   2> 874764 T3639 C3164 P60738 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:60738/br_dy/k/collection1/
   [junit4]   2> 874765 T3633 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 874765 T3639 C3164 P60738 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 874766 T3639 C3164 P60738 oasc.SyncStrategy.syncToMe http://127.0.0.1:60738/br_dy/k/collection1/ has no replicas
   [junit4]   2> 874766 T3639 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:60738/br_dy/k/collection1/ shard1
   [junit4]   2> 874767 T3639 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 874767 T3632 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 874771 T3632 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 874775 T3632 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 874878 T3632 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 874878 T3641 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 874923 T3639 oasc.ZkController.register We are http://127.0.0.1:60738/br_dy/k/collection1/ and leader is http://127.0.0.1:60738/br_dy/k/collection1/
   [junit4]   2> 874923 T3639 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:60738/br_dy/k
   [junit4]   2> 874923 T3639 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 874923 T3639 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
   [junit4]   2> 874924 T3639 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 874925 T3632 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 874925 T3632 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 874926 T3632 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 874926 T3639 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 874927 T3633 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 874928 T3633 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:60738/br_dy/k",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:60738_br_dy%2Fk",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 874931 T3632 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 875034 T3641 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 875034 T3632 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 875065 T3610 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
   [junit4]   2> 875065 T3610 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 875069 T3610 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:54558
   [junit4]   2> 875070 T3610 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 875070 T3610 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 875071 T3610 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-149163C6A3B631CF-001/tempDir-003
   [junit4]   2> 875072 T3610 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-149163C6A3B631CF-001/tempDir-003/'
   [junit4]   2> 875095 T3610 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-149163C6A3B631CF-001/tempDir-003/solr.xml
   [junit4]   2> 875118 T3610 oasc.CoreContainer.<init> New CoreContainer 9831617
   [junit4]   2> 875118 T3610 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-149163C6A3B631CF-001/tempDir-003/]
   [junit4]   2> 875120 T3610 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 875120 T3610 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 875120 T3610 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 875121 T3610 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 875121 T3610 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 875121 T3610 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 875122 T3610 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 875122 T3610 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 875122 T3610 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 875123 T3610 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 875123 T3610 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 875124 T3610 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 875124 T3610 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:56193/solr
   [junit4]   2> 875125 T3610 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 875126 T3610 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 875128 T3652 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@302eab name:ZooKeeperConnection Watcher:127.0.0.1:56193 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 875129 T3610 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 875132 T3610 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 875134 T3654 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d14f8a name:ZooKeeperConnection Watcher:127.0.0.1:56193/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 875134 T3610 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 875145 T3610 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 876151 T3610 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54558_br_dy%2Fk
   [junit4]   2> 876154 T3610 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:54558_br_dy%2Fk
   [junit4]   2> 876170 T3655 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 876171 T3655 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 876174 T3632 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 876174 T3655 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 876174 T3632 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 876175 T3632 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 876178 T3633 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 876179 T3633 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:54558/br_dy/k",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:54558_br_dy%2Fk",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 876180 T3633 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3]
   [junit4]   2> 876180 T3633 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
   [junit4]   2> 876185 T3632 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 876288 T3641 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 876288 T3632 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 876288 T3654 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 877175 T3655 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 877176 T3655 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 877177 T3655 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 877177 T3655 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 877179 T3655 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 877180 T3655 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-149163C6A3B631CF-001/tempDir-003/collection1/'
   [junit4]   2> 877181 T3655 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-149163C6A3B631CF-001/tempDir-003/collection1/lib/.svn/' to classloader
   [junit4]   2> 877182 T3655 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-149163C6A3B631CF-001/tempDir-003/collection1/lib/classes/' to classloader
   [junit4]   2> 877183 T3655 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-149163C6A3B631CF-001/tempDir-003/collection1/lib/README' to classloader
   [junit4]   2> 877241 T3655 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
   [junit4]   2> 877257 T3655 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 877259 T3655 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 877274 T3655 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 877403 T3655 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 877405 T3655 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 877407 T3655 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 877411 T3655 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 877446 T3655 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 877447 T3655 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
   [junit4]   2> 877447 T3655 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-149163C6A3B631CF-001/tempDir-003/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-149163C6A3B631CF-001/tempDir-001/jetty1/
   [junit4]   2> 877448 T3655 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e37ddb
   [junit4]   2> 877450 T3655 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-149163C6A3B631CF-001/tempDir-001/jetty1
   [junit4]   2> 877451 T3655 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-149163C6A3B631CF-001/tempDir-001/jetty1/index/
   [junit4]   2> 877452 T3655 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-149163C6A3B631CF-001/tempDir-001/jetty1/index' doesn't exist. Creating new index...
   [junit4]   2> 877453 T3655 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-149163C6A3B631CF-001/tempDir-001/jetty1/index
   [junit4]   2> 877455 T3655 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=27, maxMergeAtOnceExplicit=13, maxMergedSegmentMB=97.58984375, floorSegmentMB=1.125, forceMergeDeletesPctAllowed=23.55808309455297, segmentsPerTier=10.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.18894746327439693
   [junit4]   2> 877465 T3655 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-149163C6A3B631CF-001/tempDir-001/jetty1/index,segFN=segments_1,generation=1}
   [junit4]   2> 877465 T3655 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 877478 T3655 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 877479 T3655 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 877480 T3655 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 877481 T3655 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 877481 T3655 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 877482 T3655 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 877483 T3655 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 877483 T3655 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 877483 T3655 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 877485 T3655 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 877486 T3655 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 877486 T3655 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 877486 T3655 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 877487 T3655 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 877488 T3655 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 877489 T3655 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 877490 T3655 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 877492 T3655 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 877493 T3655 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 877493 T3655 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 877495 T3655 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=46, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.24623299217090633]
   [junit4]   2> 877496 T3655 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-149163C6A3B631CF-001/tempDir-001/jetty1/index,segFN=segments_1,generation=1}
   [junit4]   2> 877496 T3655 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 877496 T3655 oass.SolrIndexSearcher.<init> Opening Searcher@4ae130[collection1] main
   [junit4]   2> 877496 T3655 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 877498 T3655 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 877498 T3655 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 877499 T3655 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 877500 T3655 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 877500 T3655 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 877501 T3655 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 877501 T3655 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 877501 T3655 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
   [junit4]   2> 877501 T3655 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 877507 T3656 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4ae130[collection1] main{UninvertingDirectoryReader()}
   [junit4]   2> 877512 T3655 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 877512 T3659 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:54558/br_dy/k collection:collection1 shard:shard2
   [junit4]   2> 877513 T3610 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 877513 T3610 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 877514 T3659 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
   [junit4]   2> 877522 T3659 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
   [junit4]   2> 877525 T3632 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 877525 T3632 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 877525 T3659 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 877525 T3632 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 877525 T3659 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C3165 name=collection1 org.apache.solr.core.SolrCore@12e5ac9 url=http://127.0.0.1:54558/br_dy/k/collection1 node=127.0.0.1:54558_br_dy%2Fk C3165_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:54558/br_dy/k, core=collection1, node_name=127.0.0.1:54558_br_dy%2Fk}
   [junit4]   2> 877526 T3659 C3165 P54558 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:54558/br_dy/k/collection1/
   [junit4]   2> 877526 T3659 C3165 P54558 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 877526 T3659 C3165 P54558 oasc.SyncStrategy.syncToMe http://127.0.0.1:54558/br_dy/k/collection1/ has no replicas
   [junit4]   2> 877527 T3633 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 877527 T3659 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:54558/br_dy/k/collection1/ shard2
   [junit4]   2> 877527 T3659 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
   [junit4]   2> 877529 T3632 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 877531 T3632 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 877535 T3632 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 877638 T3654 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 877638 T3632 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 877638 T3641 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 877682 T3659 oasc.ZkController.register We are http://127.0.0.1:54558/br_dy/k/collection1/ and leader is http://127.0.0.1:54558/br_dy/k/collection1/
   [junit4]   2> 877682 T3659 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:54558/br_dy/k
   [junit4]   2> 877683 T3659 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 877683 T3659 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
   [junit4]   2> 877683 T3659 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 877685 T3632 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 877685 T3632 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 877685 T3632 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 877685 T3659 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 877687 T3633 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 877688 T3633 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:54558/br_dy/k",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:54558_br_dy%2Fk",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 877690 T3632 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 877796 T3641 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 877796 T3632 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 877796 T3654 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 877803 T3610 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
   [junit4]   2> 877804 T3610 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 877806 T3610 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:36407
   [junit4]   2> 877807 T3610 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 877807 T3610 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 877810 T3610 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-149163C6A3B631CF-001/tempDir-004
   [junit4]   2> 877810 T3610 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-149163C6A3B631CF-001/tempDir-004/'
   [junit4]   2> 877845 T3610 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-149163C6A3B631CF-001/tempDir-004/solr.xml
   [junit4]   2> 877856 T3610 oasc.CoreContainer.<init> New CoreContainer 26229235
   [junit4]   2> 877856 T3610 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-149163C6A3B631CF-001/tempDir-004/]
   [junit4]   2> 877857 T3610 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 877858 T3610 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 877858 T3610 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 877858 T3610 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 877859 T3610 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 877859 T3610 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 877859 T3610 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 877860 T3610 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 877860 T3610 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 877861 T3610 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 877861 T3610 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 877861 T3610 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 877862 T3610 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:56193/solr
   [junit4]   2> 877862 T3610 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 877863 T3610 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 877865 T3670 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ea076e name:ZooKeeperConnection Watcher:127.0.0.1:56193 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 877867 T3610 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 877870 T3610 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 877873 T3672 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1dedbcd name:ZooKeeperConnection Watcher:127.0.0.1:56193/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 877873 T3610 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 877884 T3610 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 878889 T3610 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36407_br_dy%2Fk
   [junit4]   2> 878891 T3610 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:36407_br_dy%2Fk
   [junit4]   2> 878908 T3673 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 878909 T3673 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 878911 T3632 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 878911 T3673 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 878911 T3632 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 878912 T3632 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 878914 T3633 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 878915 T3633 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:36407/br_dy/k",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:36407_br_dy%2Fk",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 878916 T3633 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
   [junit4]   2> 878916 T3633 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
   [junit4]   2> 878920 T3632 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 879025 T3641 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 879025 T3672 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 879025 T3654 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 879025 T3632 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 879912 T3673 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 879913 T3673 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 879914 T3673 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 879914 T3673 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 879917 T3673 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 879917 T3673 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-149163C6A3B631CF-001/tempDir-004/collection1/'
   [junit4]   2> 879919 T3673 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-149163C6A3B631CF-001/tempDir-004/collection1/lib/.svn/' to classloader
   [junit4]   2> 879919 T3673 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-149163C6A3B631CF-001/tempDir-004/collection1/lib/classes/' to classloader
   [junit4]   2> 879920 T3673 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-149163C6A3B631CF-001/tempDir-004/collection1/lib/README' to classloader
   [junit4]   2> 879985 T3673 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
   [junit4]   2> 880005 T3673 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 880006 T3673 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 880020 T3673 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 880144 T3673 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 880145 T3673 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 880147 T3673 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 880152 T3673 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 880195 T3673 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 880196 T3673 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
   [junit4]   2> 880196 T3673 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-149163C6A3B631CF-001/tempDir-004/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-149163C6A3B631CF-001/tempDir-001/jetty2/
   [junit4]   2> 880197 T3673 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e37ddb
   [junit4]   2> 880198 T3673 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-149163C6A3B631CF-001/tempDir-001/jetty2
   [junit4]   2> 880199 T3673 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-149163C6A3B631CF-001/tempDir-001/jetty2/index/
   [junit4]   2> 880200 T3673 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-149163C6A3B631CF-001/tempDir-001/jetty2/index' doesn't exist. Creating new index...
   [junit4]   2> 880202 T3673 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-149163C6A3B631CF-001/tempDir-001/jetty2/index
   [junit4]   2> 880203 T3673 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=27, maxMergeAtOnceExplicit=13, maxMergedSegmentMB=97.58984375, floorSegmentMB=1.125, forceMergeDeletesPctAllowed=23.55808309455297, segmentsPerTier=10.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.18894746327439693
   [junit4]   2> 880209 T3673 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-149163C6A3B631CF-001/tempDir-001/jetty2/index,segFN=segments_1,generation=1}
   [junit4]   2> 880210 T3673 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 880225 T3673 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 880226 T3673 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 880227 T3673 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 880228 T3673 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 880228 T3673 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 880229 T3673 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 880232 T3673 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 880233 T3673 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 880233 T3673 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 880235 T3673 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 880236 T3673 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 880237 T3673 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 880238 T3673 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 880239 T3673 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 880240 T3673 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 880242 T3673 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 880243 T3673 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 880247 T3673 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 880249 T3673 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 880250 T3673 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 880252 T3673 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=46, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.24623299217090633]
   [junit4]   2> 880254 T3673 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-149163C6A3B631CF-001/tempDir-001/jetty2/index,segFN=segments_1,generation=1}
   [junit4]   2> 880255 T3673 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 880256 T3673 oass.SolrIndexSearcher.<init> Opening Searcher@4a9462[collection1] main
   [junit4]   2> 880256 T3673 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 880258 T3673 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 880259 T3673 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 880260 T3673 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 880260 T3673 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 880261 T3673 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 880262 T3673 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 880263 T3673 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 880264 T3673 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
   [junit4]   2> 880264 T3673 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 880274 T3674 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4a9462[collection1] main{UninvertingDirectoryReader()}
   [junit4]   2> 880283 T3673 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 880284 T3677 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:36407/br_dy/k collection:collection1 shard:shard3
   [junit4]   2> 880285 T3610 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 880286 T3610 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 880286 T3677 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election
   [junit4]   2> 880298 T3677 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard3
   [junit4]   2> 880302 T3632 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 880302 T3632 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 880303 T3677 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 880303 T3632 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 880303 T3677 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C3166 name=collection1 org.apache.solr.core.SolrCore@4d8e01 url=http://127.0.0.1:36407/br_dy/k/collection1 node=127.0.0.1:36407_br_dy%2Fk C3166_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:36407/br_dy/k, core=collection1, node_name=127.0.0.1:36407_br_dy%2Fk}
   [junit4]   2> 880304 T3677 C3166 P36407 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:36407/br_dy/k/collection1/
   [junit4]   2> 880304 T3677 C3166 P36407 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 880305 T3677 C3166 P36407 oasc.SyncStrategy.syncToMe http://127.0.0.1:36407/br_dy/k/collection1/ has no replicas
   [junit4]   2> 880305 T3633 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 880305 T3677 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:36407/br_dy/k/collection1/ shard3
   [junit4]   2> 880305 T3677 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard3
   [junit4]   2> 880307 T3632 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 880310 T3632 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 880313 T3632 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 880415 T3654 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 880415 T3672 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 880415 T3632 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 880415 T3641 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 880461 T3677 oasc.ZkController.register We are http://127.0.0.1:36407/br_dy/k/collection1/ and leader is http://127.0.0.1:36407/br_dy/k/collection1/
   [junit4]   2> 880462 T3677 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:36407/br_dy/k
   [junit4]   2> 880462 T3677 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 880462 T3677 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
   [junit4]   2> 880462 T3677 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 880468 T3632 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 880468 T3632 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 880468 T3632 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 880468 T3677 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 880470 T3633 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 880470 T3633 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:36407/br_dy/k",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:36407_br_dy%2Fk",
   [junit4]   2> 	  "shard":"shard3",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":"core_node2"}
   [junit4]   2> 880474 T3632 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 880565 T3610 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
   [junit4]   2> 880566 T3610 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 880569 T3610 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50744
   [junit4]   2> 880570 T3610 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 880570 T3610 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 880570 T3610 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-149163C6A3B631CF-001/tempDir-005
   [junit4]   2> 880571 T3610 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-149163C6A3B631CF-001/tempDir-005/'
   [junit4]   2> 880576 T3654 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 880576 T3632 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 880576 T3641 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 880576 T3672 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 880596 T3610 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-149163C6A3B631CF-001/tempDir-005/solr.xml
   [junit4]   2> 880615 T3610 oasc.CoreContainer.<init> New CoreContainer 12472881
   [junit4]   2> 880616 T3610 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-149163C6A3B631CF-001/tempDir-005/]
   [junit4]   2> 880618 T3610 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 880619 T3610 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 880620 T3610 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 880621 T3610 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 880622 T3610 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 880623 T3610 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 880623 T3610 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 880624 T3610 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 880624 T3610 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 880625 T3610 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 880625 T3610 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 880625 T3610 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 880626 T3610 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:56193/solr
   [junit4]   2> 880626 T3610 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 880627 T3610 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 880629 T3688 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@8085d8 name:ZooKeeperConnection Watcher:127.0.0.1:56193 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 880630 T3610 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 880632 T3610 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 880634 T3690 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@13c7ca1 name:ZooKeeperConnection Watcher:127.0.0.1:56193/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 880634 T3610 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 880642 T3610 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 881647 T3610 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50744_br_dy%2Fk
   [junit4]   2> 881650 T3610 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50744_br_dy%2Fk
   [junit4]   2> 881664 T3691 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 881665 T3691 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 881667 T3632 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 881667 T3632 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 881667 T3691 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 881668 T3632 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 881670 T3633 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 881671 T3633 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:50744/br_dy/k",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:50744_br_dy%2Fk",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 881672 T3633 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
   [junit4]   2> 881673 T3633 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 881677 T3632 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 881785 T3641 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 881785 T3632 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 881785 T3690 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 881785 T3654 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 881785 T3672 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 882669 T3691 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 882669 T3691 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 882671 T3691 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 882671 T3691 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 882673 T3691 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 882674 T3691 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-149163C6A3B631CF-001/tempDir-005/collection1/'
   [junit4]   2> 882675 T3691 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-149163C6A3B631CF-001/tempDir-005/collection1/lib/.svn/' to classloader
   [junit4]   2> 882676 T3691 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-149163C6A3B631CF-001/tempDir-005/collection1/lib/classes/' to classloader
   [junit4]   2> 882677 T3691 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-149163C6A3B63

[...truncated too long message...]

    at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 	  97) Thread[id=4474, name=qtp22570308-4474 Acceptor0 SelectChannelConnector@127.0.0.1:56511, state=BLOCKED, group=TGRP-ChaosMonkeySafeLeaderTest]
   [junit4]   2> 	        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:102)
   [junit4]   2> 	        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
   [junit4]   2> 	        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
   [junit4]   2> 	        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
   [junit4]   2> 	        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 8098215 T4740 oaz.ClientCnxn$SendThread.run WARN Session 0x1463eb3d4e0005e for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:716)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)
   [junit4]   2> 
   [junit4]   2> 8098228 T4679 oaz.ClientCnxn$SendThread.run WARN Session 0x1463eb3d4e0005a for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:716)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)
   [junit4]   2> 
   [junit4]   2> 8098359 T3610 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/br_dy/k,null}
   [junit4]   2> 8098381 T3689 oaz.ClientCnxn$SendThread.run WARN Session 0x1463eb3d4e0000a for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:716)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)
   [junit4]   2> 
   [junit4]   2> 8098411 T3610 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 50744
   [junit4]   2> 8098411 T3610 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=12472881
   [junit4]   2> 8098412 T3610 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 8098412 T3610 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> NOTE: test params are: codec=Lucene46: {rnd_b=PostingsFormat(name=Lucene41VarGapFixedInterval), _version_=PostingsFormat(name=Memory doPackFST= true), a_t=PostingsFormat(name=NestedPulsing), a_i=PostingsFormat(name=Lucene41VarGapFixedInterval), id=PostingsFormat(name=Lucene41VarGapFixedInterval)}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=false,coord=crazy): {}, locale=es_CR, timezone=Pacific/Yap
   [junit4]   2> NOTE: Linux 3.8.0-39-generic i386/Oracle Corporation 1.8.0_20-ea (32-bit)/cpus=8,threads=107,free=322599064,total=518979584
   [junit4]   2> NOTE: All tests run in this JVM: [TestOverriddenPrefixQueryForCustomFieldType, TestComponentsName, StandardRequestHandlerTest, TestNoOpRegenerator, TestAtomicUpdateErrorCases, TestUpdate, DocExpirationUpdateProcessorFactoryTest, ShardRoutingCustomTest, BasicDistributedZk2Test, TestStressRecovery, FieldFacetTest, TestPhraseSuggestions, CurrencyFieldOpenExchangeTest, DefaultValueUpdateProcessorTest, TestSchemaNameResource, PrimUtilsTest, PathHierarchyTokenizerFactoryTest, TestHashPartitioner, TestLRUCache, TestDistributedGrouping, TestOrdValues, TestCollationField, TestRandomFaceting, FieldFacetExtrasTest, TestDynamicFieldCollectionResource, CoreAdminCreateDiscoverTest, DeleteInactiveReplicaTest, TestRecoveryHdfs, TestCloudManagedSchemaAddField, TestBinaryResponseWriter, TestDynamicFieldResource, SystemInfoHandlerTest, TestSolrCoreProperties, TestCloudManagedSchema, DistanceFunctionTest, HighlighterConfigTest, TestJmxIntegration, TestFuzzyAnalyzedSuggestions, TestQueryTypes, HdfsUnloadDistributedZkTest, SolrCoreCheckLockOnStartupTest, RequiredFieldsTest, TestReload, TestIBSimilarityFactory, CollectionsAPIDistributedZkTest, BadIndexSchemaTest, SignatureUpdateProcessorFactoryTest, DateMathParserTest, TestHighFrequencyDictionaryFactory, XsltUpdateRequestHandlerTest, UniqFieldsUpdateProcessorFactoryTest, ChangedSchemaMergeTest, TestManagedResource, SpellCheckComponentTest, DeleteReplicaTest, TestFastOutputStream, AbstractAnalyticsStatsTest, TestFiltering, FullSolrCloudDistribCmdsTest, TestImplicitCoreProperties, TestDistribDocBasedVersion, DistribCursorPagingTest, StatsComponentTest, ConnectionManagerTest, TestFastWriter, OutputWriterTest, DocumentAnalysisRequestHandlerTest, TestXIncludeConfig, TestMiniSolrCloudCluster, TestFieldResource, TestFoldingMultitermQuery, TestClassNameShortening, DeleteShardTest, TestQuerySenderListener, TestSolrDeletionPolicy2, TestPartialUpdateDeduplication, OpenExchangeRatesOrgProviderTest, FileUtilsTest, ZkNodePropsTest, IndexBasedSpellCheckerTest, DisMaxRequestHandlerTest, MultiTermTest, CurrencyFieldXmlFileTest, SuggestComponentTest, SSLMigrationTest, TestCoreDiscovery, TestManagedSynonymFilterFactory, TestUniqueKeyFieldResource, TestSweetSpotSimilarityFactory, HighlighterTest, ReplicationFactorTest, TestSolrXMLSerializer, TestRestManager, TestManagedResourceStorage, AddBlockUpdateTest, ChaosMonkeySafeLeaderTest]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=ChaosMonkeySafeLeaderTest -Dtests.seed=149163C6A3B631CF -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=es_CR -Dtests.timezone=Pacific/Yap -Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.00s J1 | ChaosMonkeySafeLeaderTest (suite) <<<
   [junit4]    > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([149163C6A3B631CF]:0)Throwable #2: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=4024, name=RecoveryThread, state=RUNNABLE, group=TGRP-ChaosMonkeySafeLeaderTest]
   [junit4]    > Caused by: java.lang.AssertionError: liveDocs.count()=10 info.docCount=16 info.getDelCount()=8
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([149163C6A3B631CF]:0)
   [junit4]    > 	at org.apache.lucene.codecs.lucene40.Lucene40LiveDocsFormat.readLiveDocs(Lucene40LiveDocsFormat.java:92)
   [junit4]    > 	at org.apache.lucene.index.SegmentReader.<init>(SegmentReader.java:109)
   [junit4]    > 	at org.apache.lucene.index.ReadersAndUpdates.getReader(ReadersAndUpdates.java:133)
   [junit4]    > 	at org.apache.lucene.index.ReadersAndUpdates.getReadOnlyClone(ReadersAndUpdates.java:185)
   [junit4]    > 	at org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:95)
   [junit4]    > 	at org.apache.lucene.index.IndexWriter.getReader(IndexWriter.java:388)
   [junit4]    > 	at org.apache.lucene.index.StandardDirectoryReader.doOpenIfChanged(StandardDirectoryReader.java:269)
   [junit4]    > 	at org.apache.lucene.index.DirectoryReader.openIfChanged(DirectoryReader.java:204)
   [junit4]    > 	at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:1489)
   [junit4]    > 	at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1690)
   [junit4]    > 	at org.apache.solr.handler.SnapPuller.openNewSearcherAndUpdateCommitPoint(SnapPuller.java:673)
   [junit4]    > 	at org.apache.solr.handler.SnapPuller.fetchLatestIndex(SnapPuller.java:493)
   [junit4]    > 	at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:337)
   [junit4]    > 	at org.apache.solr.cloud.RecoveryStrategy.replicate(RecoveryStrategy.java:163)
   [junit4]    > 	at org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:447)
   [junit4]    > 	at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:235)
   [junit4] Completed on J1 in 7225.87s, 1 test, 3 errors <<< FAILURES!

[...truncated 25 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:467: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:447: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:45: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:496: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1296: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:920: There were test failures: 406 suites, 1688 tests, 2 suite-level errors, 1 error, 39 ignored (15 assumptions)

Total time: 171 minutes 50 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.8.0_20-ea-b15 -client -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.7.0_60-ea-b15) - Build # 10401 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/10401/
Java: 32bit/jdk1.7.0_60-ea-b15 -client -XX:+UseParallelGC

1 tests failed.
FAILED:  org.apache.solr.morphlines.cell.SolrCellMorphlineTest.testSolrCellDocumentTypes

Error Message:
key:ignored__attachment_mimetype expected:<[message/rfc822]> but was:<[text/plain]>

Stack Trace:
java.lang.AssertionError: key:ignored__attachment_mimetype expected:<[message/rfc822]> but was:<[text/plain]>
	at __randomizedtesting.SeedInfo.seed([8A8C4DD978E5F3CF:104FEE471D3EAD1A]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.apache.solr.morphlines.solr.AbstractSolrMorphlineTestBase.testDocumentTypesInternal(AbstractSolrMorphlineTestBase.java:170)
	at org.apache.solr.morphlines.cell.SolrCellMorphlineTest.testSolrCellDocumentTypes(SolrCellMorphlineTest.java:193)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:793)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:453)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 18899 lines...]
   [junit4] Suite: org.apache.solr.morphlines.cell.SolrCellMorphlineTest
   [junit4]   2> log4j:WARN No such property [conversionPattern] in org.apache.solr.util.SolrLogLayout.
   [junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/contrib/solr-morphlines-cell/test/J0/./temp/solr.morphlines.cell.SolrCellMorphlineTest-8A8C4DD978E5F3CF-001/init-core-data-001
   [junit4]   2> 506 T9 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (false)
   [junit4]   2> 531 T9 oas.SolrTestCaseJ4.initCore ####initCore
   [junit4]   2> 558 T9 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/'
   [junit4]   2> 1072 T9 oasc.SolrConfig.initLibs Adding specified lib dirs to ClassLoader
   [junit4]   2> 1073 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../contrib/extraction/lib (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../contrib/extraction/lib).
   [junit4]   2> 1074 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../dist).
   [junit4]   2> 1075 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../contrib/clustering/lib/ (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../contrib/clustering/lib).
   [junit4]   2> 1075 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../dist).
   [junit4]   2> 1076 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../contrib/langid/lib/ (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../contrib/langid/lib).
   [junit4]   2> 1077 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../dist).
   [junit4]   2> 1077 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../contrib/velocity/lib (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../contrib/velocity/lib).
   [junit4]   2> 1078 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../dist).
   [junit4]   2> 1079 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: /non/existent/dir/yields/warning (resolved as: /non/existent/dir/yields/warning).
   [junit4]   2> 1137 T9 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
   [junit4]   2> 1333 T9 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1339 T9 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1378 T9 oass.IndexSchema.readSchema [null] Schema name=example
   [junit4]   2> 2001 T9 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.ThaiWordFilterFactory]. Please consult documentation how to replace it accordingly.
   [junit4]   2> 2035 T9 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 2176 T9 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 2184 T9 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 2262 T9 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 2262 T9 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr
   [junit4]   2> 2263 T9 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/'
   [junit4]   2> 2349 T9 oasc.CoreContainer.<init> New CoreContainer 9251057
   [junit4]   2> 2349 T9 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/]
   [junit4]   2> 2366 T9 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
   [junit4]   2> 2366 T9 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
   [junit4]   2> 2372 T9 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
   [junit4]   2> 2372 T9 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 2372 T9 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 2373 T9 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 2373 T9 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 2373 T9 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 2374 T9 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 2561 T9 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 2563 T9 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 2565 T9 oasc.CoreContainer.load Host Name: 
   [junit4]   2> 2653 T10 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/'
   [junit4]   2> 2715 T10 oasc.SolrConfig.initLibs Adding specified lib dirs to ClassLoader
   [junit4]   2> 2716 T10 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../contrib/extraction/lib (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../contrib/extraction/lib).
   [junit4]   2> 2716 T10 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../dist).
   [junit4]   2> 2717 T10 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../contrib/clustering/lib/ (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../contrib/clustering/lib).
   [junit4]   2> 2717 T10 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../dist).
   [junit4]   2> 2717 T10 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../contrib/langid/lib/ (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../contrib/langid/lib).
   [junit4]   2> 2718 T10 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../dist).
   [junit4]   2> 2718 T10 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../contrib/velocity/lib (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../contrib/velocity/lib).
   [junit4]   2> 2718 T10 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../dist).
   [junit4]   2> 2719 T10 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: /non/existent/dir/yields/warning (resolved as: /non/existent/dir/yields/warning).
   [junit4]   2> 2833 T10 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
   [junit4]   2> 2895 T10 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 2896 T10 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 2912 T10 oass.IndexSchema.readSchema [collection1] Schema name=example
   [junit4]   2> 3290 T10 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 3309 T10 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 3313 T10 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 3333 T10 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from instancedir /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/
   [junit4]   2> 3355 T10 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 3363 T10 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/contrib/solr-morphlines-cell/test/J0/./temp/solr.morphlines.cell.SolrCellMorphlineTest-8A8C4DD978E5F3CF-001/init-core-data-001/
   [junit4]   2> 3365 T10 oasc.JmxMonitoredMap.<init> No JMX servers found, not exposing Solr information with JMX.
   [junit4]   2> 3375 T10 oasc.SolrCore.initListeners [collection1] Added SolrEventListener for newSearcher: org.apache.solr.core.QuerySenderListener{queries=[]}
   [junit4]   2> 3375 T10 oasc.SolrCore.initListeners [collection1] Added SolrEventListener for firstSearcher: org.apache.solr.core.QuerySenderListener{queries=[{q=static firstSearcher warming in solrconfig.xml}]}
   [junit4]   2> 3404 T10 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/contrib/solr-morphlines-cell/test/J0/./temp/solr.morphlines.cell.SolrCellMorphlineTest-8A8C4DD978E5F3CF-001/init-core-data-001
   [junit4]   2> 3404 T10 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/contrib/solr-morphlines-cell/test/J0/./temp/solr.morphlines.cell.SolrCellMorphlineTest-8A8C4DD978E5F3CF-001/init-core-data-001/index/
   [junit4]   2> 3404 T10 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/contrib/solr-morphlines-cell/test/J0/./temp/solr.morphlines.cell.SolrCellMorphlineTest-8A8C4DD978E5F3CF-001/init-core-data-001/index' doesn't exist. Creating new index...
   [junit4]   2> 3413 T10 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/contrib/solr-morphlines-cell/test/J0/./temp/solr.morphlines.cell.SolrCellMorphlineTest-8A8C4DD978E5F3CF-001/init-core-data-001/index
   [junit4]   2> 3457 T10 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@d2eead lockFactory=NativeFSLockFactory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/contrib/solr-morphlines-cell/test/J0/./temp/solr.morphlines.cell.SolrCellMorphlineTest-8A8C4DD978E5F3CF-001/init-core-data-001/index),segFN=segments_1,generation=1}
   [junit4]   2> 3459 T10 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 3470 T10 oasc.SolrCore.initWriters created json: solr.JSONResponseWriter
   [junit4]   2> 3471 T10 oasc.SolrCore.initWriters adding lazy queryResponseWriter: solr.VelocityResponseWriter
   [junit4]   2> 3472 T10 oasc.SolrCore.initWriters created velocity: solr.VelocityResponseWriter
   [junit4]   2> 3488 T10 oasc.SolrCore.initWriters created xslt: solr.XSLTResponseWriter
   [junit4]   2> 3489 T10 oasr.XSLTResponseWriter.init xsltCacheLifetimeSeconds=5
   [junit4]   2> 3732 T10 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 3755 T10 oasc.RequestHandlers.initHandlersFromConfig created /select: solr.SearchHandler
   [junit4]   2> 3755 T10 oasc.RequestHandlers.initHandlersFromConfig created /query: solr.SearchHandler
   [junit4]   2> 3760 T10 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 3760 T10 oasc.RequestHandlers.initHandlersFromConfig created /browse: solr.SearchHandler
   [junit4]   2> 3767 T10 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 3772 T10 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.JsonUpdateRequestHandler]. Please consult documentation how to replace it accordingly.
   [junit4]   2> 3772 T10 oasc.RequestHandlers.initHandlersFromConfig created /update/json: solr.JsonUpdateRequestHandler
   [junit4]   2> 3777 T10 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.CSVRequestHandler]. Please consult documentation how to replace it accordingly.
   [junit4]   2> 3778 T10 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: solr.CSVRequestHandler
   [junit4]   2> 3778 T10 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.FieldAnalysisRequestHandler
   [junit4]   2> 3779 T10 oasc.RequestHandlers.initHandlersFromConfig created /analysis/field: solr.FieldAnalysisRequestHandler
   [junit4]   2> 3779 T10 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.DocumentAnalysisRequestHandler
   [junit4]   2> 3779 T10 oasc.RequestHandlers.initHandlersFromConfig created /analysis/document: solr.DocumentAnalysisRequestHandler
   [junit4]   2> 3785 T10 oasc.RequestHandlers.initHandlersFromConfig created /admin/: solr.admin.AdminHandlers
   [junit4]   2> 3790 T10 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: solr.PingRequestHandler
   [junit4]   2> 3795 T10 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
   [junit4]   2> 3810 T10 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 3810 T10 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.SearchHandler
   [junit4]   2> 3810 T10 oasc.RequestHandlers.initHandlersFromConfig created /spell: solr.SearchHandler
   [junit4]   2> 3811 T10 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.SearchHandler
   [junit4]   2> 3811 T10 oasc.RequestHandlers.initHandlersFromConfig created /tvrh: solr.SearchHandler
   [junit4]   2> 3811 T10 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.SearchHandler
   [junit4]   2> 3811 T10 oasc.RequestHandlers.initHandlersFromConfig created /terms: solr.SearchHandler
   [junit4]   2> 3812 T10 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.SearchHandler
   [junit4]   2> 3812 T10 oasc.RequestHandlers.initHandlersFromConfig created /elevate: solr.SearchHandler
   [junit4]   2> 3844 T10 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 3848 T10 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 3849 T10 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 3874 T10 oasu.CommitTracker.<init> Hard AutoCommit: if uncommited for 60000ms; 
   [junit4]   2> 3875 T10 oasu.CommitTracker.<init> Soft AutoCommit: if uncommited for 1000ms; 
   [junit4]   2> 3877 T10 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@d2eead lockFactory=NativeFSLockFactory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/contrib/solr-morphlines-cell/test/J0/./temp/solr.morphlines.cell.SolrCellMorphlineTest-8A8C4DD978E5F3CF-001/init-core-data-001/index),segFN=segments_1,generation=1}
   [junit4]   2> 3878 T10 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 3897 T10 oass.SolrIndexSearcher.<init> Opening Searcher@e2fbd3[collection1] main
   [junit4]   2> 3907 T10 oasr.ManagedResourceStorage$FileStorageIO.configure File-based storage initialized to use dir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/conf
   [junit4]   2> 3907 T10 oasr.RestManager.init Initializing RestManager with initArgs: {storageDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/conf/}
   [junit4]   2> 3927 T10 oasr.ManagedResourceStorage.load Reading _rest_managed.json using file:dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/conf
   [junit4]   2> 3927 T10 oasr.ManagedResource.reloadFromStorage WARN No stored data found for /rest/managed
   [junit4]   2> 3927 T10 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
   [junit4]   2> 3928 T10 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 3928 T10 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 3947 T10 oass.DirectSolrSpellChecker.init init: {name=default,field=name,classname=solr.DirectSolrSpellChecker,distanceMeasure=internal,accuracy=0.5,maxEdits=2,minPrefix=1,maxInspections=5,minQueryLength=4,maxQueryFrequency=0.01}
   [junit4]   2> 3964 T10 oashc.SpellCheckComponent.inform No queryConverter defined, using default converter
   [junit4]   2> 3968 T10 oashc.QueryElevationComponent.inform Loading QueryElevation from: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/conf/elevate.xml
   [junit4]   2> 4025 T10 oash.ReplicationHandler.inform Commits will be reserved for  10000
   [junit4]   2> 4027 T10 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 4027 T11 oasc.QuerySenderListener.newSearcher QuerySenderListener sending requests to Searcher@e2fbd3[collection1] main{UninvertingDirectoryReader()}
   [junit4]   2> 4033 T9 oas.SolrTestCaseJ4.initCore ####initCore end
   [junit4]   2> 4047 T9 oas.SolrTestCaseJ4.setUp ###Starting testSolrCellDocumentTypes2
   [junit4]   2> ASYNC  NEW_CORE C0 name=collection1 org.apache.solr.core.SolrCore@f8a54
   [junit4]   2> 4111 T11 C0 oasc.SolrCore.execute [collection1] webapp=null path=null params={distrib=false&q=static+firstSearcher+warming+in+solrconfig.xml&event=firstSearcher} hits=0 status=0 QTime=80 
   [junit4]   2> 4112 T11 oasc.QuerySenderListener.newSearcher QuerySenderListener done.
   [junit4]   2> 4113 T11 oashc.SpellCheckComponent$SpellCheckerListener.newSearcher Loading spell index for spellchecker: default
   [junit4]   2> 4113 T11 oashc.SpellCheckComponent$SpellCheckerListener.newSearcher Loading spell index for spellchecker: wordbreak
   [junit4]   2> 4114 T11 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@e2fbd3[collection1] main{UninvertingDirectoryReader()}
   [junit4]   2> 4175 T9 C0 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=/update params={} {deleteByQuery=*:* (-1469302156962037760)} 0 114
   [junit4]   2> 4180 T9 C0 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 4180 T9 C0 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 4182 T9 C0 oasc.SolrCore.openNewSearcher SolrIndexSearcher has not changed - not re-opening: org.apache.solr.search.SolrIndexSearcher
   [junit4]   2> 4182 T9 C0 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 4183 T9 C0 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=/update params={commit=true&softCommit=false&waitSearcher=true} {commit=} 0 4
   [junit4]   2> 4399 T9 okma.MorphlineContext.importCommandBuilders Importing commands
   [junit4]   2> 5594 T9 okma.MorphlineContext.importCommandBuilders Done importing commands
   [junit4]   2> 7076 T9 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/'
   [junit4]   2> 7105 T9 oasc.SolrConfig.initLibs Adding specified lib dirs to ClassLoader
   [junit4]   2> 7106 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../contrib/extraction/lib (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../contrib/extraction/lib).
   [junit4]   2> 7107 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../dist).
   [junit4]   2> 7107 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../contrib/clustering/lib/ (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../contrib/clustering/lib).
   [junit4]   2> 7107 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../dist).
   [junit4]   2> 7108 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../contrib/langid/lib/ (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../contrib/langid/lib).
   [junit4]   2> 7108 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../dist).
   [junit4]   2> 7109 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../contrib/velocity/lib (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../contrib/velocity/lib).
   [junit4]   2> 7109 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../dist).
   [junit4]   2> 7110 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: /non/existent/dir/yields/warning (resolved as: /non/existent/dir/yields/warning).
   [junit4]   2> 7146 T9 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
   [junit4]   2> 7207 T9 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 7208 T9 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 7220 T9 oass.IndexSchema.readSchema [null] Schema name=example
   [junit4]   2> 7607 T9 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 7622 T9 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 7626 T9 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 7654 T9 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/'
   [junit4]   2> 7682 T9 oasc.SolrConfig.initLibs Adding specified lib dirs to ClassLoader
   [junit4]   2> 7682 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../contrib/extraction/lib (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../contrib/extraction/lib).
   [junit4]   2> 7683 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../dist).
   [junit4]   2> 7683 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../contrib/clustering/lib/ (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../contrib/clustering/lib).
   [junit4]   2> 7684 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../dist).
   [junit4]   2> 7684 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../contrib/langid/lib/ (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../contrib/langid/lib).
   [junit4]   2> 7685 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../dist).
   [junit4]   2> 7685 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../contrib/velocity/lib (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../contrib/velocity/lib).
   [junit4]   2> 7686 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../dist).
   [junit4]   2> 7686 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: /non/existent/dir/yields/warning (resolved as: /non/existent/dir/yields/warning).
   [junit4]   2> 7718 T9 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
   [junit4]   2> 7791 T9 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 7792 T9 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 7802 T9 oass.IndexSchema.readSchema [null] Schema name=example
   [junit4]   2> 8154 T9 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 8167 T9 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 8171 T9 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 8695 T9 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/'
   [junit4]   2> 8722 T9 oasc.SolrConfig.initLibs Adding specified lib dirs to ClassLoader
   [junit4]   2> 8722 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../contrib/extraction/lib (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../contrib/extraction/lib).
   [junit4]   2> 8723 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../dist).
   [junit4]   2> 8723 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../contrib/clustering/lib/ (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../contrib/clustering/lib).
   [junit4]   2> 8724 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../dist).
   [junit4]   2> 8724 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../contrib/langid/lib/ (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../contrib/langid/lib).
   [junit4]   2> 8724 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../dist).
   [junit4]   2> 8725 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../contrib/velocity/lib (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../contrib/velocity/lib).
   [junit4]   2> 8725 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../dist).
   [junit4]   2> 8726 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: /non/existent/dir/yields/warning (resolved as: /non/existent/dir/yields/warning).
   [junit4]   2> 8757 T9 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
   [junit4]   2> 8814 T9 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 8814 T9 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 8824 T9 oass.IndexSchema.readSchema [null] Schema name=example
   [junit4]   2> 9190 T9 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 9203 T9 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 9207 T9 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 9348 T9 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/'
   [junit4]   2> 9376 T9 oasc.SolrConfig.initLibs Adding specified lib dirs to ClassLoader
   [junit4]   2> 9377 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../contrib/extraction/lib (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../contrib/extraction/lib).
   [junit4]   2> 9377 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../dist).
   [junit4]   2> 9378 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../contrib/clustering/lib/ (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../contrib/clustering/lib).
   [junit4]   2> 9378 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../dist).
   [junit4]   2> 9378 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../contrib/langid/lib/ (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../contrib/langid/lib).
   [junit4]   2> 9379 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../dist).
   [junit4]   2> 9379 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../contrib/velocity/lib (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../contrib/velocity/lib).
   [junit4]   2> 9380 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../dist).
   [junit4]   2> 9380 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: /non/existent/dir/yields/warning (resolved as: /non/existent/dir/yields/warning).
   [junit4]   2> 9410 T9 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
   [junit4]   2> 9465 T9 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 9466 T9 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 9474 T9 oass.IndexSchema.readSchema [null] Schema name=example
   [junit4]   2> 9804 T9 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 9815 T9 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 9818 T9 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 10004 T9 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/'
   [junit4]   2> 10029 T9 oasc.SolrConfig.initLibs Adding specified lib dirs to ClassLoader
   [junit4]   2> 10029 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../contrib/extraction/lib (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../contrib/extraction/lib).
   [junit4]   2> 10030 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../dist).
   [junit4]   2> 10030 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../contrib/clustering/lib/ (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../contrib/clustering/lib).
   [junit4]   2> 10031 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../dist).
   [junit4]   2> 10031 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../contrib/langid/lib/ (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../contrib/langid/lib).
   [junit4]   2> 10032 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../dist).
   [junit4]   2> 10032 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../contrib/velocity/lib (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../contrib/velocity/lib).
   [junit4]   2> 10032 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../dist).
   [junit4]   2> 10033 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: /non/existent/dir/yields/warning (resolved as: /non/existent/dir/yields/warning).
   [junit4]   2> 10075 T9 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
   [junit4]   2> 10131 T9 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 10132 T9 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 10141 T9 oass.IndexSchema.readSchema [null] Schema name=example
   [junit4]   2> 10484 T9 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 10493 T9 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 10497 T9 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> ASYNC  NEW_CORE C1 name=collection1 org.apache.solr.core.SolrCore@f8a54
   [junit4]   2> 10522 T9 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=/update params={} {deleteByQuery=*:* (-1469302163653001216)} 0 1
   [junit4]   2> 10523 T9 C1 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 10523 T9 C1 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 10524 T9 C1 oasc.SolrCore.openNewSearcher SolrIndexSearcher has not changed - not re-opening: org.apache.solr.search.SolrIndexSearcher
   [junit4]   2> 10524 T9 C1 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 10524 T9 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=/update params={commit=true&softCommit=false&waitSearcher=true} {commit=} 0 1
   [junit4]   2> 11046 T9 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=/update params={} {add=[testPPT_various.ppt#0 (1469302164142686208)]} 0 59
   [junit4]   2> 11049 T9 C1 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
   [junit4]   2> ASYNC  NEW_CORE C2 name=collection1 org.apache.solr.core.SolrCore@f8a54
   [junit4]   2> 11164 T9 C2 oass.SolrIndexSearcher.<init> Opening Searcher@1e132a5[collection1] main
   [junit4]   2> 11166 T9 C2 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 11166 T11 oasc.QuerySenderListener.newSearcher QuerySenderListener sending requests to Searcher@1e132a5[collection1] main{UninvertingDirectoryReader(Uninverting(_0(5.0):C1))}
   [junit4]   2> 11166 T11 oasc.QuerySenderListener.newSearcher QuerySenderListener done.
   [junit4]   2> 11167 T11 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1e132a5[collection1] main{UninvertingDirectoryReader(Uninverting(_0(5.0):C1))}
   [junit4]   2> 11168 T9 C2 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=/update params={commit=true&softCommit=true&waitSearcher=true} {commit=} 0 119
   [junit4]   2> 11178 T9 C2 oasc.SolrCore.execute [collection1] webapp=null path=/select params={q=*%3A*&rows=2147483647} hits=1 status=0 QTime=7 
   [junit4]   2> ASYNC  NEW_CORE C3 name=collection1 org.apache.solr.core.SolrCore@f8a54
   [junit4]   2> 12502 T9 C3 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=/update params={} {add=[testPPT_various.pptx#0 (1469302165724987392)]} 0 5
   [junit4]   2> 12503 T9 C3 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
   [junit4]   2> 12526 T9 C3 oass.SolrIndexSearcher.<init> Opening Searcher@eab743[collection1] main
   [junit4]   2> 12527 T9 C3 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 12527 T11 oasc.QuerySenderListener.newSearcher QuerySenderListener sending requests to Searcher@eab743[collection1] main{UninvertingDirectoryReader(Uninverting(_0(5.0):C1) Uninverting(_1(5.0):C1))}
   [junit4]   2> 12527 T11 oasc.QuerySenderListener.newSearcher QuerySenderListener done.
   [junit4]   2> 12527 T11 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@eab743[collection1] main{UninvertingDirectoryReader(Uninverting(_0(5.0):C1) Uninverting(_1(5.0):C1))}
   [junit4]   2> 12528 T9 C3 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=/update params={commit=true&softCommit=true&waitSearcher=true} {commit=} 0 25
   [junit4]   2> 12529 T9 C3 oasc.SolrCore.execute [collection1] webapp=null path=/select params={q=*%3A*&rows=2147483647} hits=2 status=0 QTime=0 
   [junit4]   2> 12711 T9 C3 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=/update params={} {add=[testEXCEL.xlsx#0 (1469302165945188352)]} 0 4
   [junit4]   2> 12711 T9 C3 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
   [junit4]   2> 12717 T9 C3 oass.SolrIndexSearcher.<init> Opening Searcher@71bb9b[collection1] main
   [junit4]   2> 12717 T9 C3 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 12717 T11 oasc.QuerySenderListener.newSearcher QuerySenderListener sending requests to Searcher@71bb9b[collection1] main{UninvertingDirectoryReader(Uninverting(_0(5.0):C1) Uninverting(_1(5.0):C1) Uninverting(_2(5.0):C1))}
   [junit4]   2> 12718 T11 oasc.QuerySenderListener.newSearcher QuerySenderListener done.
   [junit4]   2> 12718 T11 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@71bb9b[collection1] main{UninvertingDirectoryReader(Uninverting(_0(5.0):C1) Uninverting(_1(5.0):C1) Uninverting(_2(5.0):C1))}
   [junit4]   2> 12719 T9 C3 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=/update params={commit=true&softCommit=true&waitSearcher=true} {commit=} 0 8
   [junit4]   2> 12719 T9 C3 oasc.SolrCore.execute [collection1] webapp=null path=/select params={q=*%3A*&rows=2147483647} hits=3 status=0 QTime=0 
   [junit4]   2> 12968 T9 C3 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=/update params={} {add=[testEXCEL.xls#0 (1469302166214672384)]} 0 3
   [junit4]   2> 12969 T9 C3 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
   [junit4]   2> 12974 T9 C3 oass.SolrIndexSearcher.<init> Opening Searcher@49ec8e[collection1] main
   [junit4]   2> 12974 T9 C3 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 12975 T11 oasc.QuerySenderListener.newSearcher QuerySenderListener sending requests to Searcher@49ec8e[collection1] main{UninvertingDirectoryReader(Uninverting(_0(5.0):C1) Uninverting(_1(5.0):C1) Uninverting(_2(5.0):C1) Uninverting(_3(5.0):C1))}
   [junit4]   2> 12975 T11 oasc.QuerySenderListener.newSearcher QuerySenderListener done.
   [junit4]   2> 12976 T11 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@49ec8e[collection1] main{UninvertingDirectoryReader(Uninverting(_0(5.0):C1) Uninverting(_1(5.0):C1) Uninverting(_2(5.0):C1) Uninverting(_3(5.0):C1))}
   [junit4]   2> 12977 T9 C3 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=/update params={commit=true&softCommit=true&waitSearcher=true} {commit=} 0 8
   [junit4]   2> 12978 T9 C3 oasc.SolrCore.execute [collection1] webapp=null path=/select params={q=*%3A*&rows=2147483647} hits=4 status=0 QTime=1 
   [junit4]   2> 13051 T9 C3 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=/update params={} {add=[testPages.pages#0 (1469302166299607040)]} 0 6
   [junit4]   2> 13052 T9 C3 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
   [junit4]   2> 13063 T9 C3 oass.SolrIndexSearcher.<init> Opening Searcher@584f0[collection1] main
   [junit4]   2> 13064 T9 C3 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 13064 T11 oasc.QuerySenderListener.newSearcher QuerySenderListener sending requests to Searcher@584f0[collection1] main{UninvertingDirectoryReader(Uninverting(_0(5.0):C1) Uninverting(_1(5.0):C1) Uninverting(_2(5.0):C1) Uninverting(_3(5.0):C1) Uninverting(_4(5.0):C1))}
   [junit4]   2> 13065 T11 oasc.QuerySenderListener.newSearcher QuerySenderListener done.
   [junit4]   2> 13065 T11 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@584f0[collection1] main{UninvertingDirectoryReader(Uninverting(_0(5.0):C1) Uninverting(_1(5.0):C1) Uninverting(_2(5.0):C1) Uninverting(_3(5.0):C1) Uninverting(_4(5.0):C1))}
   [junit4]   2> 13065 T9 C3 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=/update params={commit=true&softCommit=true&waitSearcher=true} {commit=} 0 13
   [junit4]   2> 13066 T9 C3 oasc.SolrCore.execute [collection1] webapp=null path=/select params={q=*%3A*&rows=2147483647} hits=5 status=0 QTime=0 
   [junit4]   2> 13214 T9 C3 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=/update params={} {add=[testRTFVarious.rtf#0 (1469302166473670656)]} 0 2
   [junit4]   2> 13215 T9 C3 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
   [junit4]   2> 13220 T9 C3 oass.SolrIndexSearcher.<init> Opening Searcher@11c7093[collection1] main
   [junit4]   2> 13221 T9 C3 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 13221 T11 oasc.QuerySenderListener.newSearcher QuerySenderListener sending requests to Searcher@11c7093[collection1] main{UninvertingDirectoryReader(Uninverting(_0(5.0):C1) Uninverting(_1(5.0):C1) Uninverting(_2(5.0):C1) Uninverting(_3(5.0):C1) Uninverting(_4(5.0):C1) Uninverting(_5(5.0):C1))}
   [junit4]   2> 13221 T11 oasc.QuerySenderListener.newSearcher QuerySenderListener done.
   [junit4]   2> 13222 T11 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@11c7093[collection1] main{UninvertingDirectoryReader(Uninverting(_0(5.0):C1) Uninverting(_1(5.0):C1) Uninverting(_2(5.0):C1) Uninverting(_3(5.0):C1) Uninverting(_4(5.0):C1) Uninverting(_5(5.0):C1))}
   [junit4]   2> 13222 T9 C3 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=/update params={commit=true&softCommit=true&waitSearcher=true} {commit=} 0 7
   [junit4]   2> 13223 T9 C3 oasc.SolrCore.execute [collection1] webapp=null path=/select params={q=*%3A*&rows=2147483647} hits=6 status=0 QTime=0 
   [junit4]   2> 13241 T9 C3 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=/update params={} {add=[complex.mbox#0 (1469302166497787904)]} 0 8
   [junit4]   2> 13241 T9 C3 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
   [junit4]   2> 13250 T9 C3 oass.SolrIndexSearcher.<init> Opening Searcher@efbc1b[collection1] main
   [junit4]   2> 13251 T9 C3 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 13251 T11 oasc.QuerySenderListener.newSearcher QuerySenderListener sending requests to Searcher@efbc1b[collection1] main{UninvertingDirectoryReader(Uninverting(_0(5.0):C1) Uninverting(_1(5.0):C1) Uninverting(_2(5.0):C1) Uninverting(_3(5.0):C1) Uninverting(_4(5.0):C1) Uninverting(_5(5.0):C1) Uninverting(_6(5.0):C1))}
   [junit4]   2> 13252 T11 oasc.QuerySenderListener.newSearcher QuerySenderListener done.
   [junit4]   2> 13252 T11 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@efbc1b[collection1] main{UninvertingDirectoryReader(Uninverting(_0(5.0):C1) Uninverting(_1(5.0):C1) Uninverting(_2(5.0):C1) Uninverting(_3(5.0):C1) Uninverting(_4(5.0):C1) Uninverting(_5(5.0):C1) Uninverting(_6(5.0):C1))}
   [junit4]   2> 13253 T9 C3 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=/update params={commit=true&softCommit=true&waitSearcher=true} {commit=} 0 12
   [junit4]   2> 13254 T9 C3 oasc.SolrCore.execute [collection1] webapp=null path=/select params={q=*%3A*&rows=2147483647} hits=7 status=0 QTime=0 
   [junit4]   2> 13329 T9 C3 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=/update params={} {add=[test-outlook.msg#0 (1469302166594256896)]} 0 3
   [junit4]   2> 13330 T9 C3 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
   [junit4]   2> 13336 T9 C3 oass.SolrIndexSearcher.<init> Opening Searcher@97c438[collection1] main
   [junit4]   2> 13337 T9 C3 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 13337 T11 oasc.QuerySenderListener.newSearcher QuerySenderListener sending requests to Searcher@97c438[collection1] main{UninvertingDirectoryReader(Uninverting(_0(5.0):C1) Uninverting(_1(5.0):C1) Uninverting(_2(5.0):C1) Uninverting(_3(5.0):C1) Uninverting(_4(5.0):C1) Uninverting(_5(5.0):C1) Uninverting(_6(5.0):C1) Uninverting(_7(5.0):C1))}
   [junit4]   2> 13338 T11 oasc.QuerySenderListener.newSearcher QuerySenderListener done.
   [junit4]   2> 13338 T11 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@97c438[collection1] main{UninvertingDirectoryReader(Uninverting(_0(5.0):C1) Uninverting(_1(5.0):C1) Uninverting(_2(5.0):C1) Uninverting(_3(5.0):C1) Uninverting(_4(5.0):C1) Uninverting(_5(5.0):C1) Uninverting(_6(5.0):C1) Uninverting(_7(5.0):C1))}
   [junit4]   2> 13339 T9 C3 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=/update params={commit=true&softCommit=true&waitSearcher=true} {commit=} 0 9
   [junit4]   2> 13340 T9 C3 oasc.SolrCore.execute [collection1] webapp=null path=/select params={q=*%3A*&rows=2147483647} hits=8 status=0 QTime=0 
   [junit4]   2> 13369 T9 C3 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=/update params={} {add=[testEMLX.emlx#0 (1469302166637248512)]} 0 2
   [junit4]   2> 13370 T9 C3 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
   [junit4]   2> 13428 T9 C3 oass.SolrIndexSearcher.<init> Opening Searcher@1c10103[collection1] main
   [junit4]   2> 13429 T9 C3 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 13430 T11 oasc.QuerySenderListener.newSearcher QuerySenderListener sending requests to Searcher@1c10103[collection1] main{UninvertingDirectoryReader(Uninverting(_0(5.0):C1) Uninverting(_1(5.0):C1) Uninverting(_2(5.0):C1) Uninverting(_3(5.0):C1) Uninverting(_4(5.0):C1) Uninverting(_5(5.0):C1) Uninverting(_6(5.0):C1) Uninverting(_7(5.0):C1) Uninverting(_8(5.0):C1))}
   [junit4]   2> 13431 T11 oasc.QuerySenderListener.newSearcher QuerySenderListener done.
   [junit4]   2> 13432 T11 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1c10103[collection1] main{UninvertingDirectoryReader(Uninverting(_0(5.0):C1) Uninverting(_1(5.0):C1) Uninverting(_2(5.0):C1) Uninverting(_3(5.0):C1) Uninverting(_4(5.0):C1) Uninverting(_5(5.0):C1) Uninverting(_6(5.0):C1) Uninverting(_7(5.0):C1) Uninverting(_8(5.0):C1))}
   [junit4]   2> 13433 T9 C3 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=/update params={commit=true&softCommit=true&waitSearcher=true} {commit=} 0 63
   [junit4]   2> 13434 T9 C3 oasc.SolrCore.execute [collection1] webapp=null path=/select params={q=*%3A*&rows=2147483647} hits=9 status=0 QTime=0 
   [junit4]   2> ASYNC  NEW_CORE C4 name=collection1 org.apache.solr.core.SolrCore@f8a54
   [junit4]   2> 13642 T9 C4 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=/update params={} {add=[testRFC822#0 (1469302166923509760)]} 0 2
   [junit4]   2> 13643 T9 C4 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
   [junit4]   2> 13652 T9 C4 oass.SolrIndexSearcher.<init> Opening Searcher@1bb9f9a[collection1] main
   [junit4]   2> 13653 T9 C4 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 13653 T11 oasc.QuerySenderListener.newSearcher QuerySenderListener sending requests to Searcher@1bb9f9a[collection1] main{UninvertingDirectoryReader(Uninverting(_0(5.0):C1) Uninverting(_1(5.0):C1) Uninverting(_2(5.0):C1) Uninverting(_3(5.0):C1) Uninverting(_4(5.0):C1) Uninverting(_5(5.0):C1) Uninverting(_6(5.0):C1) Uninverting(_7(5.0):C1) Uninverting(_8(5.0):C1) Uninverting(_9(5.0):C1))}
   [junit4]   2> 13653 T11 oasc.QuerySenderListener.newSearcher QuerySenderListener done.
   [junit4]   2> 13654 T11 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1bb9f9a[collection1] main{UninvertingDirectoryReader(Uninverting(_0(5.0):C1) Uninverting(_1(5.0):C1) Uninverting(_2(5.0):C1) Uninverting(_3(5.0):C1) Uninverting(_4(5.0):C1) Uninverting(_5(5.0):C1) Uninverting(_6(5.0):C1) Uninverting(_7(5.0):C1) Uninverting(_8(5.0):C1) Uninverting(_9(5.0):C1))}
   [junit4]   2> 13657 T9 C4 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=/update params={commit=true&softCommit=true&waitSearcher=true} {commit=} 0 14
   [junit4]   2> 13658 T9 C4 oasc.SolrCore.execute [collection1] webapp=null path=/select params={q=*%3A*&rows=2147483647} hits=10 status=0 QTime=0 
   [junit4]   2> 13826 T9 C4 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=/update params={} {add=[rsstest.rss#0 (1469302167116447744)]} 0 1
   [junit4]   2> 13827 T9 C4 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
   [junit4]   2> 13832 T9 C4 oass.SolrIndexSearcher.<init> Opening Searcher@1f9ff8e[collection1] main
   [junit4]   2> 13832 T9 C4 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 13832 T11 oasc.QuerySenderListener.newSearcher QuerySenderListener sending requests to Searcher@1f9ff8e[collection1] main{UninvertingDirectoryReader(Uninverting(_a(5.0):C10) Uninverting(_b(5.0):C1))}
   [junit4]   2> 13833 T11 oasc.QuerySenderListener.newSearcher QuerySenderListener done.
   [junit4]   2> 13833 T11 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1f9ff8e[collection1] main{UninvertingDirectoryReader(Uninverting(_a(5.0):C10) Uninverting(_b(5.0):C1))}
   [junit4]   2> 13839 T9 C4 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=/update params={commit=true&softCommit=true&waitSearcher=true} {commit=} 0 12
   [junit4]   2> 13840 T9 C4 oasc.SolrCore.execute [collection1] webapp=null path=/select params={q=*%3A*&rows=2147483647} hits=11 status=0 QTime=0 
   [junit4]   2> 13878 T9 C4 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=/update params={} {add=[testMP3i18n.mp3#0 (1469302167170973696)]} 0 2
   [junit4]   2> 13879 T9 C4 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
   [junit4]   2> 13882 T9 C4 oass.SolrIndexSearcher.<init> Opening Searcher@96f5ac[collection1] main
   [junit4]   2> 13883 T9 C4 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 13883 T11 oasc.QuerySenderListener.newSearcher QuerySenderListener sending requests to Searcher@96f5ac[collection1] main{UninvertingDirectoryReader(Uninverting(_a(5.0):C10) Uninverting(_b(5.0):C1) Uninverting(_c(5.0):C1))}
   [junit4]   2> 13883 T11 oasc.QuerySenderListener.newSearcher QuerySenderListener done.
   [junit4]   2> 13884 T11 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@96f5ac[collection1] main{UninvertingDirectoryReader(Uninverting(_a(5.0):C10) Uninverting(_b(5.0):C1) Uninverting(_c(5.0):C1))}
   [junit4]   2> 13884 T9 C4 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=/update params={commit=true&softCommit=true&waitSearcher=true} {commit=} 0 5
   [junit4]   2> 13885 T9 C4 oasc.SolrCore.execute [collection1] webapp=null path=/select params={q=*%3A*&rows=2147483647} hits=12 status=0 QTime=0 
   [junit4]   2> 13939 T9 C4 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=/update params={} {add=[testAIFF.aif#0 (1469302167234936832)]} 0 1
   [junit4]   2> 13940 T9 C4 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
   [junit4]   2> 13944 T9 C4 oass.SolrIndexSearcher.<init> Opening Searcher@1ca643[collection1] main
   [junit4]   2> 13945 T9 C4 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 13945 T11 oasc.QuerySenderListener.newSearcher QuerySenderListener sending requests to Searcher@1ca643[collection1] main{UninvertingDirectoryReader(Uninverting(_a(5.0):C10) Uninverting(_b(5.0):C1) Uninverting(_c(5.0):C1) Uninverting(_d(5.0):C1))}
   [junit4]   2> 13945 T11 oasc.QuerySenderListener.newSearcher QuerySenderListener done.
   [junit4]   2> 13946 T11 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1ca643[collection1] main{UninvertingDirectoryReader(Uninverting(_a(5.0):C10) Uninverting(_b(5.0):C1) Uninverting(_c(5.0):C1) Uninverting(_d(5.0):C1))}
   [junit4]   2> 13946 T9 C4 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=/update params={commit=true&softCommit=true&waitSearcher=true} {commit=} 0 6
   [junit4]   2> 13947 T9 C4 oasc.SolrCore.execute [collection1] webapp=null path=/select params={q=*%3A*&rows=2147483647} hits=13 status=0 QTime=1 
   [junit4]   2> 13972 T9 C4 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=/update params={} {add=[testFLAC.flac#0 (1469302167269539840)]} 0 2
   [junit4]   2> 13973 T9 C4 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
   [junit4]   2> 13977 T9 C4 oass.SolrIndexSearcher.<init> Opening Searcher@7689c7[collection1] main
   [junit4]   2> 13977 T9 C4 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 13977 T11 oasc.QuerySenderListener.newSearcher QuerySenderListener sending requests to Searcher@7689c7[collection1] main{UninvertingDirectoryReader(Uninverting(_a(5.0):C10) Uninverting(_b(5.0):C1) Uninverting(_c(5.0):C1) Uninverting(_d(5.0):C1) Uninverting(_e(5.0):C1))}
   [junit4]   2> 13978 T11 oasc.QuerySenderListener.newSearcher QuerySenderListener done.
   [junit4]   2> 13978 T11 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7689c7[collection1] main{UninvertingDirectoryReader(Uninverting(_a(5.0):C10) Uninverting(_b(5.0):C1) Uninverting(_c(5.0):C1) Uninverting(_d(5.0):C1) Uninverting(_e(5.0):C1))}
   [junit4]   2> 13979 T9 C4 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=/update params={commit=true&softCommit=true&waitSearcher=true} {commit=} 0 6
   [junit4]   2> 13979 T9 C4 oasc.SolrCore.execute [collection1] webapp=null path=/select params={q=*%3A*&rows=2147483647} hits=14 status=0 QTime=0 
   [junit4]   2> 14110 T9 C4 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=/update params={} {add=[testMP4.m4a#0 (1469302167414243328)]} 0 2
   [junit4]   2> 14111 T9 C4 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
   [junit4]   2> 14114 T9 C4 oass.SolrIndexSearcher.<init> Opening Searcher@243b6c[collection1] main
   [junit4]   2> 14115 T9 C4 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 14115 T11 oasc.QuerySenderListener.newSearcher QuerySenderListener sending requests to Searcher@243b6c[collection1] main{UninvertingDirectoryReader(Uninverting(_a(5.0):C10) Uninverting(_b(5.0):C1) Uninverting(_c(5.0):C1) Uninverting(_d(5.0):C1) Uninverting(_e(5.0):C1) Uninverting(_f(5.0):C1))}
   [junit4]   2> 14116 T11 oasc.QuerySenderListener.newSearcher QuerySenderListener done.
   [junit4]   2> 14116 T11 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@243b6c[collection1] main{UninvertingDirectoryReader(Uninverting(_a(5.0):C10) Uninverting(_b(5.0):C1) Uninverting(_c(5.0):C1) Uninverting(_d(5.0):C1) Uninverting(_e(5.0):C1) Uninverting(_f(5.0):C1))}
   [junit4]   2> 14117 T9 C4 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=/update params={commit=true&softCommit=true&waitSearcher=true} {commit=} 0 6
   [junit4]   2> 14118 T9 C4 oasc.SolrCore.execute [collection1] webapp=null path=/select params={q=*%3A*&rows=2147483647} hits=15 status=0 QTime=1 
   [junit4]   2> 14127 T9 C4 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=/update params={} {add=[testWAV.wav#0 (1469302167433117696)]} 0 1
   [junit4]   2> 14128 T9 C4 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
   [junit4]   2> 14132 T9 C4 oass.SolrIndexSearcher.<init> Opening Searcher@90516b[collection1] main
   [junit4]   2> 14133 T9 C4 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 14133 T11 oasc.QuerySenderListener.newSearcher QuerySenderListener sending requests to Searcher@90516b[collection1] main{UninvertingDirectoryReader(Uninverting(_a(5.0):C10) Uninverting(_b(5.0):C1) Uninverting(_c(5.0):C1) Uninverting(_d(5.0):C1) Uninverting(_e(5.0):C1) Uninverting(_f(5.0):C1) Uninverting(_g(5.0):C1))}
   [junit4]   2> 14133 T11 oasc.QuerySenderListener.newSearcher QuerySenderListener done.
   [junit4]   2> 14133 T11 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@90516b[collection1] main{UninvertingDirectoryReader(Uninverting(_a(5.0):C10) Uninverting(_b(5.0):C1) Uninverting(_c(5.0):C1) Uninverting(_d(5.0):C1) Uninverting(_e(5.0):C1) Uninverting(_f(5.0):C1) Uninverting(_g(5.0):C1))}
   [junit4]   2> 14134 T9 C4 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=/update params={commit=true&softCommit=true&waitSearcher=true} {commit=} 0 6
   [junit4]   2> 14135 T9 C4 oasc.SolrCore.execute [collection1] webapp=null path=/select params={q=*%3A*&rows=2147483647} hits=16 status=0 QTime=1 
   [junit4]   2> 14148 T9 C4 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=/update params={} {add=[testFLV.flv#0 (1469302167454089216)]} 0 1
   [junit4]   2> 14149 T9 C4 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
   [junit4]   2> 14152 T9 C4 oass.SolrIndexSearcher.<init> Opening Searcher@1659674[collection1] main
   [junit4]   2> 14153 T9 C4 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 14153 T11 oasc.QuerySenderListener.newSearcher QuerySenderListener sending requests to Searcher@1659674[collection1] main{UninvertingDirectoryReader(Uninverting(_a(5.0):C10) Uninverting(_b(5.0):C1) Uninverting(_c(5.0):C1) Uninverting(_d(5.0):C1) Uninverting(_e(5.0):C1) Uninverting(_f(5.0):C1) Uninverting(_g(5.0):C1) Uninverting(_h(5.0):C1))}
   [junit4]   2> 14154 T11 oasc.QuerySenderListener.newSearcher QuerySenderListener done.
   [junit4]   2> 14155 T11 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1659674[collection1] main{UninvertingDirectoryReader(Uninverting(_a(5.0):C10) Uninverting(_b(5.0):C1) Uninverting(_c(5.0):C1) Uninverting(_d(5.0):C1) Uninverting(_e(5.0):C1) Uninverting(_f(5.0):C1) Uninverting(_g(5.0):C1) Uninverting(_h(5.0):C1))}
   [junit4]   2> 14156 T9 C4 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=/update params={commit=true&softCommit=true&waitSearcher=true} {commit=} 0 7
   [junit4]   2> 14157 T9 C4 oasc.SolrCore.execute [collection1] webapp=null path=/select params={q=*%3A*&rows=2147483647} hits=17 status=0 QTime=0 
   [junit4]   2> 14164 T9 C4 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=/update params={} {add=[testBMP.bmp#0 (1469302167470866432)]} 0 1
   [junit4]   2> 14164 T9 C4 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
   [junit4]   2> 14167 T9 C4 oass.SolrIndexSearcher.<init> Opening Searcher@6a6ea4[collection1] main
   [junit4]   2> 14168 T9 C4 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 14168 T11 oasc.QuerySenderListener.newSearcher QuerySenderListener sending requests to Searcher@6a6ea4[collection1] main{UninvertingDirectoryReader(Uninverting(_a(5.0):C10) Uninverting(_b(5.0):C1) Uninverting(_c(5.0):C1) Uninverting(_d(5.0):C1) Uninverting(_e(5.0):C1) Uninverting(_f(5.0):C1) Uninverting(_g(5.0):C1) Uninverting(_h(5.0):C1) Uninverting(_i(5.0):C1))}
   [junit4]   2> 14169 T11 oasc.QuerySenderListener.newSearcher QuerySenderListener done.
   [junit4]   2> 14169 T11 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6a6ea4[collection1] main{UninvertingDirectoryReader(Uninverting(_a(5.0):C10) Uninverting(_b(5.0):C1) Uninverting(_c(5.0):C1) Uninverting(_d(5.0):C1) Uninverting(_e(5.0):C1) Uninverting(_f(5.0):C1) Uninverting(_g(5.0):C1) Uninverting(_h(5.0):C1) Uninverting(_i(5.0):C1))}
   [junit4]   2> 14170 T9 C4 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=/update params={commit=true&softCommit=true&waitSearcher=true} {commit=} 0 6
   [junit4]   2> 14171 T9 C4 oasc.SolrCore.execute [collection1] webapp=null path=/select params={q=*%3A*&rows=2147483647} hits=18 status=0 QTime=0 
   [junit4]   2> 14176 T9 C4 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=/update params={} {add=[testPNG.png#0 (1469302167483449344)]} 0 1
   [junit4]   2> 14176 T9 C4 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
   [junit4]   2> 14183 T9 C4 oass.SolrIndexSearcher.<init> Opening Searcher@1f8bdcd[collection1] main
   [junit4]   2> 14184 T9 C4 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 14184 T11 oasc.QuerySenderListener.newSearcher QuerySenderListener sending requests to Searcher@1f8bdcd[collection1] main{UninvertingDirectoryReader(Uninverting(_a(5.0):C10) Uninverting(_b(5.0):C1) Uninverting(_c(5.0):C1) Uninverting(_d(5.0):C1) Uninverting(_e(5.0):C1) Uninverting(_f(5.0):C1) Uninverting(_g(5.0):C1) Uninverting(_h(5.0):C1) Uninverting(_i(5.0):C1) Uninverting(_j(5.0):C1))}
   [junit4]   2> 14184 T11 oasc.QuerySenderListener.newSearcher QuerySenderListener done.
   [junit4]   2> 14184 T11 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1f8bdcd[collection1] main{UninvertingDirectoryReader(Uninverting(_a(5.0):C10) Uninverting(_b(5.0):C1) Uninverting(_c(5.0):C1) Uninverting(_d(5.0):C1) Uninverting(_e(5.0):C1) Uninverting(_f(5.0):C1) Uninverting(_g(5.0):C1) Uninverting(_h(5.0):C1) Uninverting(_i(5.0):C1) Uninverting(_j(5.0):C1))}
   [junit4]   2> 14185 T9 C4 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=/update params={commit=true&softCommit=true&waitSearcher=true} {commit=} 0 9
   [junit4]   2> 14187 T9 C4 oasc.SolrCore.execute [collection1] webapp=null path=/select params={q=*%3A*&rows=2147483647} hits=19 status=0 QTime=1 
   [junit4]   2> 14199 T9 C4 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=/update params={} {add=[testPSD.psd#0 (1469302167507566592)]} 0 1
   [junit4]   2> 14200 T9 C4 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
   [junit4]   2> 14204 T9 C4 oass.SolrIndexSearcher.<init> Opening Searcher@dcd3c2[collection1] main
   [junit4]   2> 14205 T9 C4 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 14205 T11 oasc.QuerySenderListener.newSearcher QuerySenderListener sending requests to Searcher@dcd3c2[collection1] main{UninvertingDirectoryReader(Uninverting(_a(5.0):C10) Uninverting(_b(5.0):C1) Uninverting(_c(5.0):C1) Uninverting(_d(5.0):C1) Uninverting(_e(5.0):C1) Uninverting(_f(5.0):C1) Uninverting(_g(5.0):C1) Uninverting(_h(5.0):C1) Uninverting(_i(5.0):C1) Uninverting(_j(5.0):C1) Uninverting(_l(5.0):C1))}
   [junit4]   2> 14206 T11 oasc.QuerySenderListener.newSearcher QuerySenderListener done.
   [junit4]   2> 14206 T11 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@dcd3c2[collection1] main{UninvertingDirectoryReader(Uninverting(_a(5.0):C10) Uninverting(_b(5.0):C1) Uninverting(_c(5.0):C1) Uninverting(_d(5.0):C1) Uninverting(_e(5.0):C1) Uninverting(_f(5.0):C1) Uninverting(_g(5.0):C1) Uninverting(_h(5.0):C1) Uninverting(_i(5.0):C1) Uninverting(_j(5.0):C1) Uninverting(_l(5.0):C1))}
   [junit4]   2> 14206 T9 C4 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=/update params={commit=true&softCommit=true&waitSearcher=true} {commit=} 0 6
   [junit4]   2> 14207 T9 C4 oasc.SolrCore.execute [collection1] webapp=null path=/select params={q=*%3A*&rows=2147483647} hits=20 status=0 QTime=0 
   [junit4]   2> 14236 T9 C4 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=/update params={} {add=[testSVG.svg#0 (1469302167546363904)]} 0 1
   [junit4]   2> 14237 T9 C4 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
   [junit4]   2> 14244 T9 C4 oass.SolrIndexSearcher.<init> Opening Searcher@c9daa2[collection1] main
   [junit4]   2> 14244 T9 C4 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 14244 T11 oasc.QuerySenderListener.newSearcher QuerySenderListener sending requests to Searcher@c9daa2[collection1] main{UninvertingDirectoryReader(Uninverting(_k(5.0):C19) Uninverting(_l(5.0):C1) Uninverting(_m(5.0):C1))}
   [junit4]   2> 14245 T11 oasc.QuerySenderListener.newSearcher QuerySenderListener done.
   [junit4]   2> 14246 T11 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@c9daa2[collection1] main{UninvertingDirectoryReader(Uninverting(_k(5.0):C19) Uninverting(_l(5.0):C1) Uninverting(_m(5.0):C1))}
   [junit4]   2> 14251 T9 C4 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=/update params={commit=true&softCommit=true&waitSearcher=true} {commit=} 0 14
   [junit4]   2> 14252 T9 C4 oasc.SolrCore.execute [collection1] webapp=null path=/select params={q=*%3A*&rows=2147483647} hits=21 status=0 QTime=0 
   [junit4]   2> 14339 T9 C4 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=/update params={} {add=[testTIFF.tif#0 (1469302167653318656)]} 0 3
   [junit4]   2> 14340 T9 C4 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
   [junit4]   2> 14344 T9 C4 oass.SolrIndexSearcher.<init> Opening Searcher@19fb0c4[collection1] main
   [junit4]   2> 14345 T9 C4 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 14345 T11 oasc.QuerySenderListener.newSearcher QuerySenderListener sending requests to Searcher@19fb0c4[collection1] main{UninvertingDirectoryReader(Uninverting(_k(5.0):C19) Uninverting(_l(5.0):C1) Uninverting(_m(5.0):C1) Uninverting(_n(5.0):C1))}
   [junit4]   2> 14346 T11 oasc.QuerySenderListener.newSearcher QuerySenderListener done.
   [junit4]   2> 14346 T11 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@19fb0c4[collection1] main{UninvertingDirectoryReader(Uninverting(_k(5.0):C19) Uninverting(_l(5.0):C1) Uninverting(_m(5.0):C1) Uninverting(_n(5.0):C1))}
   [junit4]   2> 14346 T9 C4 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=/update params={commit=true&softCommit=true&waitSearcher=true} {commit=} 0 6
   [junit4]   2> 14347 T9 C4 oasc.SolrCore.execute [collection1] webapp=null path=/select params={q=*%3A*&rows=2147483647} hits=22 status=0 QTime=0 
   [junit4]   2> 14401 T9 C4 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=/update params={} {add=[testVISIO.vsd#0 (1469302167719378944)]} 0 2
   [junit4]   2> 14402 T9 C4 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
   [junit4]   2> 14406 T9 C4 oass.SolrIndexSearcher.<init> Opening Searcher@1c91d75[collection1] main
   [junit4]   2> 14407 T9 C4 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 14407 T11 oasc.QuerySenderListener.newSearcher QuerySenderListener sending requests to Searcher@1c91d75[collection1] main{UninvertingDirectoryReader(Uninverting(_k(5.0):C19) Uninverting(_l(5.0):C1) Uninverting(_m(5.0):C1) Uninverting(_n(5.0):C1) Uninverting(_o(5.0):C1))}
   [junit4]   2> 14407 T11 oasc.QuerySenderListener.newSearcher QuerySenderListener done.
   [junit4]   2> 14408 T11 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1c91d75[collection1] main{UninvertingDirectoryReader(Uninverting(_k(5.0):C19) Uninverting(_l(5.0):C1) Uninverting(_m(5.0):C1) Uninverting(_n(5.0):C1) Uninverting(_o(5.0):C1))}
   [junit4]   2> 14409 T9 C4 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=/update params={commit=true&softCommit=true&waitSearcher=true} {commit=} 0 7
   [junit4]   2> 14409 T9 C4 oasc.SolrCore.execute [collection1] webapp=null path=/select params={q=*%3A*&rows=2147483647} hits=23 status=0 QTime=0 
   [junit4]   2> 14413 T9 C4 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
   [junit4]   2> 14414 T9 C4 oasc.SolrCore.openNewSearcher SolrIndexSearcher has not changed - not re-opening: org.apache.solr.search.SolrIndexSearcher
   [junit4]   2> 14414 T9 C4 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 14414 T9 C4 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=/update params={commit=true&softCommit=true&waitSearcher=true} {commit=} 0 1
   [junit4]   2> 14415 T9 C4 oasc.SolrCore.execute [collection1] webapp=null path=/select params={q=*%3A*&rows=2147483647} hits=23 status=0 QTime=0 
   [junit4]   2> 14417 T9 oas.SolrTestCaseJ4.tearDown ###Ending testSolrCellDocumentTypes2
   [junit4]   2> 14426 T9 oas.SolrTestCaseJ4.setUp ###Starting testSolrCellJPGCompressed
   [junit4]   2> 14468 T9 C4 oass.SolrIndexSearcher.<init> Opening Searcher@144f2f3[collection1] realtime
   [junit4]   2> 14469 T9 C4 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=/update params={} {deleteByQuery=*:* (-1469302167747690496)} 0 42
   [junit4]   2> 14469 T9 C4 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 14470 T9 C4 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@d2eead lockFactory=NativeFSLockFactory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/contrib/solr-morphlines-cell/test/J0/./temp/solr.morphlines.cell.SolrCellMorphlineTest-8A8C4DD978E5F3CF-001/init-core-data-001/index),segFN=segments_1,generation=1}
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@d2eead lockFactory=NativeFSLockFactory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/contrib/solr-morphlines-cell/test/J0/./temp/solr.morphlines.cell.SolrCellMorphlineTest-8A8C4DD978E5F3CF-001/init-core-data-001/index),segFN=segments_2,generation=2}
   [junit4]   2> 14470 T9 C4 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
   [junit4]   2> 14471 T9 C4 oass.SolrIndexSearcher.<init> Opening Searcher@1504ac2[collection1] main
   [junit4]   2> 14471 T9 C4 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 14471 T11 oasc.QuerySenderListener.newSearcher QuerySenderListener sending requests to Searcher@1504ac2[collection1] main{UninvertingDirectoryReader()}
   [junit4]   2> 14472 T11 oasc.QuerySenderListener.newSearcher QuerySenderListener done.
   [junit4]   2> 14473 T11 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1504ac2[collection1] main{UninvertingDirectoryReader()}
   [junit4]   2> 14475 T9 C4 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=/update params={commit=true&softCommit=false&waitSearcher=true} {commit=} 0 6
   [junit4]   2> 14482 T9 okma.MorphlineContext.importCommandBuilders Importing commands
   [junit4]   2> 14931 T9 okma.MorphlineContext.importCommandBuilders Done importing commands
   [junit4]   2> 15276 T9 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/'
   [junit4]   2> 15302 T9 oasc.SolrConfig.initLibs Adding specified lib dirs to ClassLoader
   [junit4]   2> 15303 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../contrib/extraction/lib (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../contrib/extraction/lib).
   [junit4]   2> 15303 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../dist).
   [junit4]   2> 15303 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../contrib/clustering/lib/ (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../contrib/clustering/lib).
   [junit4]   2> 15304 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../dist).
   [junit4]   2> 15305 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../contrib/langid/lib/ (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../contrib/langid/lib).
   [junit4]   2> 15305 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../dist).
   [junit4]   2> 15305 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../contrib/velocity/lib (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../contrib/velocity/lib).
   [junit4]   2> 15306 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../dist).
   [junit4]   2> 15306 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: /non/existent/dir/yields/warning (resolved as: /non/existent/dir/yields/warning).
   [junit4]   2> 15337 T9 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
   [junit4]   2> 15416 T9 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 15417 T9 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 15428 T9 oass.IndexSchema.readSchema [null] Schema name=example
   [junit4]   2> 15784 T9 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 15794 T9 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 15799 T9 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 15818 T9 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/'
   [junit4]   2> 15844 T9 oasc.SolrConfig.initLibs Adding specified lib dirs to ClassLoader
   [junit4]   2> 15845 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../contrib/extraction/lib (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../contrib/extraction/lib).
   [junit4]   2> 15845 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../dist).
   [junit4]   2> 15846 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../contrib/clustering/lib/ (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../contrib/clustering/lib).
   [junit4]   2> 15846 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../dist).
   [junit4]   2> 15847 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../contrib/langid/lib/ (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../contrib/langid/lib).
   [junit4]   2> 15847 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../dist).
   [junit4]   2> 15848 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../contrib/velocity/lib (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../contrib/velocity/lib).
   [junit4]   2> 15848 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../dist).
   [junit4]   2> 15848 T9 oasc.SolrResourceLoader.ad

[...truncated too long message...]

to add to classloader: ../../../dist/ (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/contrib/morphlines-core/src/test-files/solr/collection1/../../../dist).
   [junit4]   2> 23902 T9 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: /non/existent/dir/yields/warning (resolved as: /non/existent/dir/yields/warning).
   [junit4]   2> 23943 T9 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
   [junit4]   2> 23999 T9 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 24000 T9 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 24008 T9 oass.IndexSchema.readSchema [null] Schema name=example
   [junit4]   2> 24343 T9 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 24351 T9 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 24354 T9 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> ASYNC  NEW_CORE C9 name=collection1 org.apache.solr.core.SolrCore@f8a54
   [junit4]   2> 24373 T9 C9 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=/update params={} {deleteByQuery=*:* (-1469302178175778816)} 0 1
   [junit4]   2> 24377 T9 C9 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 24378 T9 C9 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 24378 T9 C9 oasc.SolrCore.openNewSearcher SolrIndexSearcher has not changed - not re-opening: org.apache.solr.search.SolrIndexSearcher
   [junit4]   2> 24378 T9 C9 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 24379 T9 C9 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=/update params={commit=true&softCommit=false&waitSearcher=true} {commit=} 0 2
   [junit4]   2> 24382 T9 C9 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=/update params={} {add=[testXML2.xml#0 (1469302178186264576)]} 0 1
   [junit4]   2> 24383 T9 C9 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
   [junit4]   2> 24385 T9 C9 oass.SolrIndexSearcher.<init> Opening Searcher@67be50[collection1] main
   [junit4]   2> 24387 T9 C9 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 24387 T11 oasc.QuerySenderListener.newSearcher QuerySenderListener sending requests to Searcher@67be50[collection1] main{UninvertingDirectoryReader(Uninverting(_1a(5.0):C1))}
   [junit4]   2> 24388 T11 oasc.QuerySenderListener.newSearcher QuerySenderListener done.
   [junit4]   2> 24388 T11 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@67be50[collection1] main{UninvertingDirectoryReader(Uninverting(_1a(5.0):C1))}
   [junit4]   2> 24389 T9 C9 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=/update params={commit=true&softCommit=true&waitSearcher=true} {commit=} 0 6
   [junit4]   2> 24390 T9 C9 oasc.SolrCore.execute [collection1] webapp=null path=/select params={q=*%3A*&rows=2147483647} hits=1 status=0 QTime=1 
   [junit4]   2> 24390 T9 C9 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
   [junit4]   2> 24390 T9 C9 oasc.SolrCore.openNewSearcher SolrIndexSearcher has not changed - not re-opening: org.apache.solr.search.SolrIndexSearcher
   [junit4]   2> 24391 T9 C9 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 24391 T9 C9 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=/update params={commit=true&softCommit=true&waitSearcher=true} {commit=} 0 1
   [junit4]   2> 24392 T9 C9 oasc.SolrCore.execute [collection1] webapp=null path=/select params={q=*%3A*&rows=2147483647} hits=1 status=0 QTime=1 
   [junit4]   2> 24392 T9 oas.SolrTestCaseJ4.tearDown ###Ending testSolrCellXML
   [junit4]   2> 24394 T9 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> 24394 T9 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=9251057
   [junit4]   2> 24394 T9 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@f8a54
   [junit4]   2> 24395 T9 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=56,autocommit maxTime=60000ms,autocommits=0,soft autocommit maxTime=1000ms,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=1,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=61,cumulative_deletesById=0,cumulative_deletesByQuery=9,cumulative_errors=0,transaction_logs_total_size=126170,transaction_logs_total_number=9}
   [junit4]   2> 24396 T9 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 24396 T9 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 24396 T9 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 24397 T9 C9 oasu.DirectUpdateHandler2.closeWriter Committing on IndexWriter close.
   [junit4]   2> 24397 T9 C9 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@d2eead lockFactory=NativeFSLockFactory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/contrib/solr-morphlines-cell/test/J0/./temp/solr.morphlines.cell.SolrCellMorphlineTest-8A8C4DD978E5F3CF-001/init-core-data-001/index),segFN=segments_4,generation=4}
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@d2eead lockFactory=NativeFSLockFactory@/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/contrib/solr-morphlines-cell/test/J0/./temp/solr.morphlines.cell.SolrCellMorphlineTest-8A8C4DD978E5F3CF-001/init-core-data-001/index),segFN=segments_5,generation=5}
   [junit4]   2> 24398 T9 C9 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 5
   [junit4]   2> 24399 T9 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 24399 T9 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 24400 T9 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/contrib/solr-morphlines-cell/test/J0/./temp/solr.morphlines.cell.SolrCellMorphlineTest-8A8C4DD978E5F3CF-001/init-core-data-001/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/contrib/solr-morphlines-cell/test/J0/./temp/solr.morphlines.cell.SolrCellMorphlineTest-8A8C4DD978E5F3CF-001/init-core-data-001/index;done=false>>]
   [junit4]   2> 24400 T9 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/contrib/solr-morphlines-cell/test/J0/./temp/solr.morphlines.cell.SolrCellMorphlineTest-8A8C4DD978E5F3CF-001/init-core-data-001/index
   [junit4]   2> 24401 T9 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/contrib/solr-morphlines-cell/test/J0/./temp/solr.morphlines.cell.SolrCellMorphlineTest-8A8C4DD978E5F3CF-001/init-core-data-001 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/contrib/solr-morphlines-cell/test/J0/./temp/solr.morphlines.cell.SolrCellMorphlineTest-8A8C4DD978E5F3CF-001/init-core-data-001;done=false>>]
   [junit4]   2> 24401 T9 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/contrib/solr-morphlines-cell/test/J0/./temp/solr.morphlines.cell.SolrCellMorphlineTest-8A8C4DD978E5F3CF-001/init-core-data-001
   [junit4]   2> NOTE: leaving temporary files on disk at: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/contrib/solr-morphlines-cell/test/J0/./temp/solr.morphlines.cell.SolrCellMorphlineTest-8A8C4DD978E5F3CF-001
   [junit4]   2> NOTE: test params are: codec=Lucene41, sim=DefaultSimilarity, locale=tr, timezone=Etc/GMT+0
   [junit4]   2> NOTE: Linux 3.8.0-39-generic i386/Oracle Corporation 1.7.0_60-ea (32-bit)/cpus=8,threads=1,free=153579072,total=224657408
   [junit4]   2> NOTE: All tests run in this JVM: [SolrCellMorphlineTest]
   [junit4] Completed in 24.54s, 5 tests, 1 failure <<< FAILURES!

[...truncated 9 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:467: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:447: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:45: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:209: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:440: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:496: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1296: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:920: There were test failures: 1 suite, 5 tests, 1 failure

Total time: 70 minutes 57 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.7.0_60-ea-b15 -client -XX:+UseParallelGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.8.0_05) - Build # 10400 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/10400/
Java: 64bit/jdk1.8.0_05 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC

1 tests failed.
REGRESSION:  org.apache.solr.cloud.HttpPartitionTest.testDistribSearch

Error Message:
createcollection the collection error [Watcher fired on path: null state: SyncConnected type None]

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: createcollection the collection error [Watcher fired on path: null state: SyncConnected type None]
	at __randomizedtesting.SeedInfo.seed([304B8C08D7EFFE21:B1AD0210A0B09E1D]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:554)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:210)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:206)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1500)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1460)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1514)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1456)
	at org.apache.solr.cloud.HttpPartitionTest.testRf2(HttpPartitionTest.java:154)
	at org.apache.solr.cloud.HttpPartitionTest.doTest(HttpPartitionTest.java:141)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:863)
	at sun.reflect.GeneratedMethodAccessor39.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:483)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:793)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:453)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 11627 lines...]
   [junit4] Suite: org.apache.solr.cloud.HttpPartitionTest
   [junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-304B8C08D7EFFE21-001/init-core-data-001
   [junit4]   2> 1333633 T5949 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /_x/he
   [junit4]   2> 1333636 T5949 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> 1333636 T5949 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1333637 T5950 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 1333737 T5949 oasc.ZkTestServer.run start zk server on port:35940
   [junit4]   2> 1333738 T5949 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1346169 T5953 oazsp.FileTxnLog.commit WARN fsync-ing the write ahead log in SyncThread:0 took 12430ms which will adversely effect operation latency. See the ZooKeeper troubleshooting guide
   [junit4]   2> 1346170 T5951 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1463fa570e90000, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 1346172 T5956 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6e275294 name:ZooKeeperConnection Watcher:127.0.0.1:35940 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1346172 T5949 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1346172 T5949 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 1346175 T5949 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1346176 T5958 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3245c60f name:ZooKeeperConnection Watcher:127.0.0.1:35940/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1346177 T5949 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1346177 T5949 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 1346180 T5949 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 1346182 T5949 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 1346183 T5949 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 1346185 T5949 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 1346185 T5949 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 1346188 T5949 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 1346188 T5949 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 1346190 T5949 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1346190 T5949 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1346192 T5949 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 1346192 T5949 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 1346193 T5949 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 1346194 T5949 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 1346196 T5949 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 1346197 T5949 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 1346198 T5949 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 1346198 T5949 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 1346200 T5949 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1346200 T5949 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1346202 T5949 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1346202 T5949 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1346204 T5949 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 1346204 T5949 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 1346206 T5949 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 1346206 T5949 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 1346469 T5949 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1346471 T5949 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:51083
   [junit4]   2> 1346472 T5949 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1346472 T5949 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1346472 T5949 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-304B8C08D7EFFE21-001/tempDir-002
   [junit4]   2> 1346473 T5949 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-304B8C08D7EFFE21-001/tempDir-002/'
   [junit4]   2> 1346483 T5949 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-304B8C08D7EFFE21-001/tempDir-002/solr.xml
   [junit4]   2> 1346494 T5949 oasc.CoreContainer.<init> New CoreContainer 1187976505
   [junit4]   2> 1346494 T5949 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-304B8C08D7EFFE21-001/tempDir-002/]
   [junit4]   2> 1346495 T5949 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1346495 T5949 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1346495 T5949 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1346496 T5949 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1346496 T5949 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1346496 T5949 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1346496 T5949 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1346497 T5949 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1346497 T5949 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1346497 T5949 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1346497 T5949 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1346498 T5949 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1346498 T5949 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:35940/solr
   [junit4]   2> 1346498 T5949 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1346499 T5949 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1346501 T5969 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@23acc2d9 name:ZooKeeperConnection Watcher:127.0.0.1:35940 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1346502 T5949 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1346504 T5949 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1346505 T5971 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5f6bf740 name:ZooKeeperConnection Watcher:127.0.0.1:35940/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1346506 T5949 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1346507 T5949 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 1346509 T5949 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 1346511 T5949 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
   [junit4]   2> 1346512 T5949 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
   [junit4]   2> 1346514 T5949 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
   [junit4]   2> 1346516 T5949 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 1346517 T5949 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50340__x%2Fhe
   [junit4]   2> 1346517 T5949 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50340__x%2Fhe
   [junit4]   2> 1346524 T5949 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 1346525 T5949 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 1346528 T5949 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:50340__x%2Fhe
   [junit4]   2> 1346528 T5949 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 1346531 T5949 oasc.Overseer.start Overseer (id=91830822204145668-127.0.0.1:50340__x%2Fhe-n_0000000000) starting
   [junit4]   2> 1346533 T5949 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 1346539 T5973 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 1346539 T5949 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 1346540 T5949 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 1346541 T5949 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1346543 T5972 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 1346551 T5974 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
   [junit4]   2> 1346551 T5974 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1346552 T5971 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1346552 T5974 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1346552 T5972 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1346553 T5972 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:50340/_x/he",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:50340__x%2Fhe",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 1346553 T5972 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
   [junit4]   2> 1346553 T5972 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 1346554 T5971 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1346555 T5971 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1347552 T5974 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1347552 T5974 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
   [junit4]   2> 1347553 T5974 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1347554 T5974 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 1347555 T5974 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1347555 T5974 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-304B8C08D7EFFE21-001/tempDir-002/collection1/'
   [junit4]   2> 1347555 T5974 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-304B8C08D7EFFE21-001/tempDir-002/collection1/lib/.svn/' to classloader
   [junit4]   2> 1347556 T5974 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-304B8C08D7EFFE21-001/tempDir-002/collection1/lib/classes/' to classloader
   [junit4]   2> 1347556 T5974 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-304B8C08D7EFFE21-001/tempDir-002/collection1/lib/README' to classloader
   [junit4]   2> 1347579 T5974 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
   [junit4]   2> 1347590 T5974 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1347591 T5974 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1347598 T5974 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1347710 T5974 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1347714 T5974 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1347715 T5974 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1347723 T5974 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1347725 T5974 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1347727 T5974 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1347727 T5974 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1347728 T5974 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1347728 T5974 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1347729 T5974 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1347729 T5974 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1347729 T5974 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 1347729 T5974 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1347729 T5974 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-304B8C08D7EFFE21-001/tempDir-002/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-304B8C08D7EFFE21-001/tempDir-001/control/data/
   [junit4]   2> 1347730 T5974 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6e7f8284
   [junit4]   2> 1347730 T5974 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-304B8C08D7EFFE21-001/tempDir-001/control/data
   [junit4]   2> 1347730 T5974 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-304B8C08D7EFFE21-001/tempDir-001/control/data/index/
   [junit4]   2> 1347730 T5974 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-304B8C08D7EFFE21-001/tempDir-001/control/data/index' doesn't exist. Creating new index...
   [junit4]   2> 1347731 T5974 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-304B8C08D7EFFE21-001/tempDir-001/control/data/index
   [junit4]   2> 1347731 T5974 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=14, maxMergeAtOnceExplicit=49, maxMergedSegmentMB=53.896484375, floorSegmentMB=1.7998046875, forceMergeDeletesPctAllowed=27.309534603953946, segmentsPerTier=36.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 1347732 T5974 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@c44f9df lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@76c0e766),segFN=segments_1,generation=1}
   [junit4]   2> 1347732 T5974 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1347734 T5974 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1347735 T5974 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1347735 T5974 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1347735 T5974 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1347736 T5974 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1347736 T5974 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1347736 T5974 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1347736 T5974 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1347736 T5974 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1347737 T5974 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1347737 T5974 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 1347737 T5974 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1347737 T5974 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1347737 T5974 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1347738 T5974 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1347738 T5974 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1347738 T5974 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 1347740 T5974 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1347741 T5974 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1347741 T5974 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1347742 T5974 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=19, maxMergeAtOnceExplicit=39, maxMergedSegmentMB=74.33984375, floorSegmentMB=2.0693359375, forceMergeDeletesPctAllowed=17.396277749256917, segmentsPerTier=43.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.15396876960193434
   [junit4]   2> 1347742 T5974 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@c44f9df lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@76c0e766),segFN=segments_1,generation=1}
   [junit4]   2> 1347742 T5974 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1347742 T5974 oass.SolrIndexSearcher.<init> Opening Searcher@1cb4f9ba[collection1] main
   [junit4]   2> 1347742 T5974 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 1347743 T5974 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1347743 T5974 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 1347744 T5974 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1347744 T5974 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 1347744 T5974 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1347745 T5974 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1347745 T5974 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1347745 T5974 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
   [junit4]   2> 1347745 T5974 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 1347746 T5975 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1cb4f9ba[collection1] main{UninvertingDirectoryReader()}
   [junit4]   2> 1347747 T5974 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1347748 T5978 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:50340/_x/he collection:control_collection shard:shard1
   [junit4]   2> 1347748 T5949 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
   [junit4]   2> 1347749 T5949 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1347750 T5978 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 1347752 T5949 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1347753 T5981 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@46f6fad3 name:ZooKeeperConnection Watcher:127.0.0.1:35940/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1347753 T5949 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1347754 T5949 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1347755 T5978 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 1347756 T5971 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1347756 T5949 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 1347757 T5972 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1347779 T5971 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1347779 T5978 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 1347780 T5978 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C3156 name=collection1 org.apache.solr.core.SolrCore@b8483c8 url=http://127.0.0.1:50340/_x/he/collection1 node=127.0.0.1:50340__x%2Fhe C3156_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:50340/_x/he, core=collection1, node_name=127.0.0.1:50340__x%2Fhe}
   [junit4]   2> 1347780 T5978 C3156 P50340 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:50340/_x/he/collection1/
   [junit4]   2> 1347780 T5978 C3156 P50340 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 1347780 T5978 C3156 P50340 oasc.SyncStrategy.syncToMe http://127.0.0.1:50340/_x/he/collection1/ has no replicas
   [junit4]   2> 1347780 T5978 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:50340/_x/he/collection1/ shard1
   [junit4]   2> 1347780 T5978 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 1347784 T5971 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1347786 T5971 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1347887 T5981 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1347887 T5971 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1347935 T5978 oasc.ZkController.register We are http://127.0.0.1:50340/_x/he/collection1/ and leader is http://127.0.0.1:50340/_x/he/collection1/
   [junit4]   2> 1347935 T5978 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:50340/_x/he
   [junit4]   2> 1347935 T5978 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 1347935 T5978 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
   [junit4]   2> 1347935 T5978 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1347936 T5971 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1347937 T5971 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1347937 T5971 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1347937 T5978 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1347938 T5972 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1347938 T5972 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:50340/_x/he",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:50340__x%2Fhe",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 1347939 T5971 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1348019 T5949 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
   [junit4]   2> 1348020 T5949 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1348021 T5949 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:54458
   [junit4]   2> 1348021 T5949 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1348022 T5949 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1348022 T5949 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-304B8C08D7EFFE21-001/tempDir-003
   [junit4]   2> 1348022 T5949 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-304B8C08D7EFFE21-001/tempDir-003/'
   [junit4]   2> 1348035 T5949 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-304B8C08D7EFFE21-001/tempDir-003/solr.xml
   [junit4]   2> 1348041 T5981 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1348041 T5971 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1348058 T5949 oasc.CoreContainer.<init> New CoreContainer 2023776489
   [junit4]   2> 1348059 T5949 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-304B8C08D7EFFE21-001/tempDir-003/]
   [junit4]   2> 1348059 T5949 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1348059 T5949 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1348060 T5949 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1348060 T5949 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1348060 T5949 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1348060 T5949 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1348061 T5949 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1348061 T5949 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1348061 T5949 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1348062 T5949 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1348062 T5949 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1348063 T5949 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1348064 T5949 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:35940/solr
   [junit4]   2> 1348064 T5949 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1348065 T5949 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1348068 T5992 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@28227551 name:ZooKeeperConnection Watcher:127.0.0.1:35940 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1348068 T5949 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1348070 T5949 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1348070 T5994 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@59c9faf6 name:ZooKeeperConnection Watcher:127.0.0.1:35940/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1348071 T5949 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1348074 T5949 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1349077 T5949 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41130__x%2Fhe
   [junit4]   2> 1349079 T5949 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:41130__x%2Fhe
   [junit4]   2> 1349093 T5995 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 1349093 T5995 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1349095 T5971 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1349095 T5995 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1349095 T5971 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1349096 T5971 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1349097 T5972 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1349098 T5972 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:41130/_x/he",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:41130__x%2Fhe",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 1349098 T5972 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
   [junit4]   2> 1349098 T5972 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
   [junit4]   2> 1349100 T5971 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1349202 T5981 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1349202 T5971 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1349202 T5994 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1350096 T5995 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1350096 T5995 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 1350097 T5995 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1350097 T5995 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 1350097 T5995 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1350098 T5995 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-304B8C08D7EFFE21-001/tempDir-003/collection1/'
   [junit4]   2> 1350098 T5995 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-304B8C08D7EFFE21-001/tempDir-003/collection1/lib/.svn/' to classloader
   [junit4]   2> 1350099 T5995 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-304B8C08D7EFFE21-001/tempDir-003/collection1/lib/classes/' to classloader
   [junit4]   2> 1350099 T5995 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-304B8C08D7EFFE21-001/tempDir-003/collection1/lib/README' to classloader
   [junit4]   2> 1350121 T5995 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
   [junit4]   2> 1350133 T5995 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1350134 T5995 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1350138 T5995 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1350242 T5995 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1350245 T5995 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1350247 T5995 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1350253 T5995 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1350254 T5995 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1350256 T5995 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1350257 T5995 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1350257 T5995 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1350257 T5995 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1350258 T5995 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1350258 T5995 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1350258 T5995 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 1350258 T5995 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1350258 T5995 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-304B8C08D7EFFE21-001/tempDir-003/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-304B8C08D7EFFE21-001/tempDir-001/jetty1/
   [junit4]   2> 1350259 T5995 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6e7f8284
   [junit4]   2> 1350259 T5995 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-304B8C08D7EFFE21-001/tempDir-001/jetty1
   [junit4]   2> 1350259 T5995 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-304B8C08D7EFFE21-001/tempDir-001/jetty1/index/
   [junit4]   2> 1350259 T5995 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-304B8C08D7EFFE21-001/tempDir-001/jetty1/index' doesn't exist. Creating new index...
   [junit4]   2> 1350260 T5995 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-304B8C08D7EFFE21-001/tempDir-001/jetty1/index
   [junit4]   2> 1350260 T5995 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=14, maxMergeAtOnceExplicit=49, maxMergedSegmentMB=53.896484375, floorSegmentMB=1.7998046875, forceMergeDeletesPctAllowed=27.309534603953946, segmentsPerTier=36.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 1350260 T5995 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@52f79040 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@14187ddd),segFN=segments_1,generation=1}
   [junit4]   2> 1350261 T5995 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1350263 T5995 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1350263 T5995 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1350263 T5995 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1350264 T5995 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1350264 T5995 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1350264 T5995 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1350264 T5995 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1350264 T5995 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1350264 T5995 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1350265 T5995 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1350265 T5995 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 1350265 T5995 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1350265 T5995 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1350266 T5995 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1350266 T5995 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1350266 T5995 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1350267 T5995 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 1350268 T5995 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1350269 T5995 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1350270 T5995 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1350270 T5995 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=19, maxMergeAtOnceExplicit=39, maxMergedSegmentMB=74.33984375, floorSegmentMB=2.0693359375, forceMergeDeletesPctAllowed=17.396277749256917, segmentsPerTier=43.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.15396876960193434
   [junit4]   2> 1350270 T5995 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@52f79040 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@14187ddd),segFN=segments_1,generation=1}
   [junit4]   2> 1350271 T5995 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1350271 T5995 oass.SolrIndexSearcher.<init> Opening Searcher@290e020b[collection1] main
   [junit4]   2> 1350271 T5995 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 1350272 T5995 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1350272 T5995 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 1350272 T5995 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1350272 T5995 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 1350272 T5995 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1350273 T5995 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1350273 T5995 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1350273 T5995 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
   [junit4]   2> 1350273 T5995 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 1350275 T5996 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@290e020b[collection1] main{UninvertingDirectoryReader()}
   [junit4]   2> 1350277 T5995 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1350277 T5999 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:41130/_x/he collection:collection1 shard:shard2
   [junit4]   2> 1350278 T5949 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
   [junit4]   2> 1350278 T5949 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1350278 T5999 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
   [junit4]   2> 1350281 T5999 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
   [junit4]   2> 1350283 T5971 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1350283 T5999 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 1350283 T5999 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> 1350283 T5971 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1350283 T5971 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> ASYNC  NEW_CORE C3157 name=collection1 org.apache.solr.core.SolrCore@28817c4e url=http://127.0.0.1:41130/_x/he/collection1 node=127.0.0.1:41130__x%2Fhe C3157_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:41130/_x/he, core=collection1, node_name=127.0.0.1:41130__x%2Fhe}
   [junit4]   2> 1350283 T5999 C3157 P41130 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:41130/_x/he/collection1/
   [junit4]   2> 1350284 T5999 C3157 P41130 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 1350284 T5999 C3157 P41130 oasc.SyncStrategy.syncToMe http://127.0.0.1:41130/_x/he/collection1/ has no replicas
   [junit4]   2> 1350284 T5972 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1350284 T5999 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:41130/_x/he/collection1/ shard2
   [junit4]   2> 1350284 T5999 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
   [junit4]   2> 1350288 T5971 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1350288 T5971 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1350291 T5971 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1350393 T5971 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1350393 T5994 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1350393 T5981 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1350438 T5999 oasc.ZkController.register We are http://127.0.0.1:41130/_x/he/collection1/ and leader is http://127.0.0.1:41130/_x/he/collection1/
   [junit4]   2> 1350438 T5999 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:41130/_x/he
   [junit4]   2> 1350439 T5999 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 1350439 T5999 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
   [junit4]   2> 1350439 T5999 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1350440 T5971 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1350440 T5971 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1350440 T5999 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1350440 T5971 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1350441 T5972 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1350442 T5972 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:41130/_x/he",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:41130__x%2Fhe",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 1350443 T5971 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1350560 T5981 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1350560 T5971 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1350560 T5994 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1350561 T5949 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
   [junit4]   2> 1350562 T5949 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1350563 T5949 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:48395
   [junit4]   2> 1350564 T5949 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1350564 T5949 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1350564 T5949 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-304B8C08D7EFFE21-001/tempDir-004
   [junit4]   2> 1350565 T5949 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-304B8C08D7EFFE21-001/tempDir-004/'
   [junit4]   2> 1350575 T5949 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-304B8C08D7EFFE21-001/tempDir-004/solr.xml
   [junit4]   2> 1350586 T5949 oasc.CoreContainer.<init> New CoreContainer 130649407
   [junit4]   2> 1350587 T5949 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-304B8C08D7EFFE21-001/tempDir-004/]
   [junit4]   2> 1350587 T5949 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1350588 T5949 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1350588 T5949 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1350588 T5949 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1350588 T5949 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1350589 T5949 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1350589 T5949 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1350589 T5949 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1350589 T5949 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1350590 T5949 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1350590 T5949 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1350590 T5949 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1350591 T5949 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:35940/solr
   [junit4]   2> 1350591 T5949 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1350592 T5949 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1350593 T6011 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@480ad855 name:ZooKeeperConnection Watcher:127.0.0.1:35940 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1350593 T5949 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1350595 T5949 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1350596 T6013 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@20642f5b name:ZooKeeperConnection Watcher:127.0.0.1:35940/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1350596 T5949 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1350600 T5949 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1351602 T5949 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44020__x%2Fhe
   [junit4]   2> 1351604 T5949 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:44020__x%2Fhe
   [junit4]   2> 1351614 T6014 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 1351614 T6014 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1351616 T5971 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1351616 T5971 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1351616 T5971 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1351616 T6014 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1351618 T5972 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1351619 T5972 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:44020/_x/he",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:44020__x%2Fhe",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 1351619 T5972 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
   [junit4]   2> 1351620 T5972 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 1351623 T5971 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1351726 T6013 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1351726 T5994 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1351726 T5971 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1351726 T5981 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1352617 T6014 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1352617 T6014 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 1352618 T6014 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1352619 T6014 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 1352620 T6014 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1352621 T6014 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-304B8C08D7EFFE21-001/tempDir-004/collection1/'
   [junit4]   2> 1352621 T6014 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-304B8C08D7EFFE21-001/tempDir-004/collection1/lib/.svn/' to classloader
   [junit4]   2> 1352622 T6014 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-304B8C08D7EFFE21-001/tempDir-004/collection1/lib/classes/' to classloader
   [junit4]   2> 1352622 T6014 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest-304B8C08D7EFFE21-001/tempDir-004/collection1/lib/README' to classloader
   [junit4]   2> 1352653 T6014 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
   [junit4]   2> 1352666 T6014 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1352667 T6014 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1352671 T6014 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1352758 T6014 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1352761 T6014 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1352763 T6014 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1352772 T6014 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1352776 T6014 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1352779 T6014 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1352781 T6014 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1352781 T6014 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1352781 T6014 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1352783 T6014 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1352783 T6014 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1352784 T6014 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 1352784 T6014 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1352784 T6014 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-304B8C08D7EFFE21-001/tempDir-004/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-304B8C08D7EFFE21-001/tempDir-001/jetty2/
   [junit4]   2> 1352785 T6014 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6e7f8284
   [junit4]   2> 1352785 T6014 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-304B8C08D7EFFE21-001/tempDir-001/jetty2
   [junit4]   2> 1352786 T6014 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-304B8C08D7EFFE21-001/tempDir-001/jetty2/index/
   [junit4]   2> 1352786 T6014 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-304B8C08D7EFFE21-001/tempDir-001/jetty2/index' doesn't exist. Creating new index...
   [junit4]   2> 1352787 T6014 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-304B8C08D7EFFE21-001/tempDir-001/jetty2/index
   [junit4]   2> 1352787 T6014 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=14, maxMergeAtOnceExplicit=49, maxMergedSegmentMB=53.896484375, floorSegmentMB=1.7998046875, forceMergeDeletesPctAllowed=27.309534603953946, segmentsPerTier=36.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 1352788 T6014 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@8928fc lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@40d04c68),segFN=segments_1,generation=1}
   [junit4]   2> 1352789 T6014 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1352793 T6014 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1352794 T6014 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1352794 T6014 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1352794 T6014 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1352795 T6014 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1352795 T6014 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1352796 T6014 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1352796 T6014 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1352796 T6014 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1352797 T6014 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1352798 T6014 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 1352798 T6014 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1352799 T6014 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1352799 T6014 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1352800 T6014 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1352800 T6014 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1352801 T6014 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 1352804 T6014 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1352807 T6014 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1352807 T6014 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1352808 T6014 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=19, maxMergeAtOnceExplicit=39, maxMergedSegmentMB=74.33984375, floorSegmentMB=2.0693359375, forceMergeDeletesPctAllowed=17.396277749256917, segmentsPerTier=43.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.15396876960193434
   [junit4]   2> 1352809 T6014 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@8928fc lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@40d04c68),segFN=segments_1,generation=1}
   [junit4]   2> 1352809 T6014 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1352809 T6014 oass.SolrIndexSearcher.<init> Opening Searcher@27029578[collection1] main
   [junit4]   2> 1352810 T6014 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 1352811 T6014 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1352811 T6014 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 1352813 T6014 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1352813 T6014 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 1352813 T6014 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1352814 T6014 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1352815 T6014 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1352815 T6014 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
   [junit4]   2> 1352815 T6014 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 1352818 T6015 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@27029578[collection1] main{UninvertingDirectoryReader()}
   [junit4]   2> 1352826 T6014 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1352827 T6018 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:44020/_x/he collection:collection1 shard:shard1
   [junit4]   2> 1352827 T5949 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
   [junit4]   2> 1352827 T6018 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 1352828 T5949 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1352829 T5949 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1352829 T5949 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 30000 for each attempt
   [junit4]   2> 1352829 T5949 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):30000
   [junit4]   2> 1352830 T5949 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1352830 T6018 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 1352831 T5971 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1352831 T5971 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1352832 T6018 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 1352832 T6018 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> 1352832 T5971 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> ASYNC  NEW_CORE C3158 name=collection1 org.apache.solr.core.SolrCore@6b45a6de url=http://127.0.0.1:44020/_x/he/collection1 node=127.0.0.1:44020__x%2Fhe C3158_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:44020/_x/he, core=collection1, node_name=127.0.0.1:44020__x%2Fhe}
   [junit4]   2> 1352832 T6018 C3158 P44020 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:44020/_x/he/collection1/
   [junit4]   2> 1352832 T5972 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1352832 T6018 C3158 P44020 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 1352833 T6018 C3158 P44020 oasc.SyncStrategy.syncToMe http://127.0.0.1:44020/_x/he/collection1/ has no replicas
   [junit4]   2> 1352833 T6018 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:44020/_x/he/collection1/ shard1
   [junit4]   2> 1352833 T6018 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 1352834 T5971 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1352835 T5971 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1352837 T5971 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1352940 T5971 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1352940 T6013 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1352940 T5981 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1352940 T5994 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1352986 T6018 oasc.ZkController.register We are http://127.0.0.1:44020/_x/he/collection1/ and leader is http://127.0.0.1:44020/_x/he/collection1/
   [junit4]   2> 1352986 T6018 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:44020/_x/he
   [junit4]   2> 1352986 T6018 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 1352986 T6018 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
   [junit4]   2> 1352987 T6018 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1352989 T5971 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1352989 T5971 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1352989 T5971 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1352989 T6018 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1352991 T5972 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1352992 T5972 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:44020/_x/he",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:44020__x%2Fhe",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":"core_node2"}
   [junit4]   2> 1352995 T5971 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1353098 T5971 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1353098 T5981 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1353098 T5994 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1353098 T6013 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1353831 T5949 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1353833 T5949 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
   [junit4]   2> 1353834 T5979 oasc.SocketProxy$Acceptor.run accepted Socket[addr=/127.0.0.1,port=52602,localport=50340], receiveBufferSize:131015
   [junit4]   2> 1353839 T5979 oasc.SocketProxy$Bridge.<init> proxy connection Socket[addr=/127.0.0.1,port=51083,localport=51692], receiveBufferSize=131003
   [junit4]   2> ASYNC  NEW_CORE C3159 name=collection1 org.apache.solr.core.SolrCore@b8483c8 url=http://127.0.0.1:50340/_x/he/collection1 node=127.0.0.1:50340__x%2Fhe C3159_STATE=coll:control_collection core:collection1 props:{state=active, base_url=http://127.0.0.1:50340/_x/he, core=collection1, node_name=127.0.0.1:50340__x%2Fhe, leader=true}
   [junit4]   2> 1353840 T5965 C3159 P50340 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1353840 T5965 C3159 P50340 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 1353841 T5965 C3159 P50340 oasc.SolrCore.openNewSearcher SolrIndexSearcher has not changed - not re-opening: org.apache.solr.search.SolrIndexSearcher
   [junit4]   2> 1353841 T5965 C3159 P50340 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 1353842 T5965 C3159 P50340 oasup.LogUpdateProcessor.finish [collection1] webapp=/_x/he path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2} {commit=} 0 2
   [junit4]   2> 1353843 T6019 oasc.SocketProxy$Acceptor.run accepted Socket[addr=/127.0.0.1,port=42326,localport=44020], receiveBufferSize:131015
   [junit4]   2> 1353845 T6019 oasc.SocketProxy$Bridge.<init> proxy connection Socket[addr=/127.0.0.1,port=48395,localport=42560], receiveBufferSize=131003
   [junit4]   2> 1353851 T6019 oasc.SocketProxy$Acceptor.run accepted Socket[addr=/127.0.0.1,port=42328,localport=44020], receiveBufferSize:131015
   [junit4]   2> 1353852 T6019 oasc.SocketProxy$Bridge.<init> proxy connection Socket[addr=/127.0.0.1,port=48395,localport=42562], receiveBufferSize=131003
   [junit4]   2>  C3158_STATE=coll:collection1 core:collection1 props:{state=active, base_url=http://127.0.0.1:44020/_x/he, core=collection1, node_name=127.0.0.1:44020__x%2Fhe, leader=true}
   [junit4]   2> 1353854 T6006 C3158 P44020 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1353855 T6006 C3158 P44020 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 1353856 T6006 C3158 P44020 oasc.SolrCore.openNewSearcher SolrIndexSearcher has not changed - not re-opening: org.

[...truncated too long message...]

tpSolrServer.executeMethod(HttpSolrServer.java:554)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:210)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:206)
   [junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1500)
   [junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1460)
   [junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1514)
   [junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1456)
   [junit4]    > 	at org.apache.solr.cloud.HttpPartitionTest.testRf2(HttpPartitionTest.java:154)
   [junit4]    > 	at org.apache.solr.cloud.HttpPartitionTest.doTest(HttpPartitionTest.java:141)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:863)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 1372041 T5949 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.HttpPartitionTest-304B8C08D7EFFE21-001
   [junit4]   2> 38414 T5948 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 6 leaked thread(s).
   [junit4]   2> 1372670 T6041 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:277)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:274)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:274)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:306)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:85)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:289)
   [junit4]   2> 
   [junit4]   2> 1372670 T5971 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 1372759 T6044 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:277)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:274)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:274)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:306)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:85)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:289)
   [junit4]   2> 
   [junit4]   2> 1372759 T5994 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 1372852 T6013 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> NOTE: test params are: codec=CheapBastard, sim=DefaultSimilarity, locale=cs, timezone=SystemV/YST9YDT
   [junit4]   2> NOTE: Linux 3.8.0-39-generic amd64/Oracle Corporation 1.8.0_05 (64-bit)/cpus=8,threads=1,free=286168432,total=518979584
   [junit4]   2> NOTE: All tests run in this JVM: [BasicFunctionalityTest, BinaryUpdateRequestHandlerTest, LoggingHandlerTest, TestRemoteStreaming, TestSchemaResource, UnloadDistributedZkTest, ScriptEngineTest, AsyncMigrateRouteKeyTest, TestValueSourceCache, UpdateParamsTest, HdfsWriteToMultipleCollectionsTest, DistributedQueryComponentCustomSortTest, SuggesterFSTTest, PolyFieldTest, AutoCommitTest, TestDefaultSearchFieldResource, SampleTest, CopyFieldTest, TestPostingsSolrHighlighter, ReturnFieldsTest, DistributedTermsComponentTest, ChaosMonkeyNothingIsSafeTest, FastVectorHighlighterTest, SoftAutoCommitTest, AnalysisErrorHandlingTest, MoreLikeThisHandlerTest, DistributedSpellCheckComponentTest, LukeRequestHandlerTest, SpellingQueryConverterTest, TestExpandComponent, ShardSplitTest, SuggesterTest, ExternalFileFieldSortTest, AddSchemaFieldsUpdateProcessorFactoryTest, TimeZoneUtilsTest, DistributedDebugComponentTest, TestSolrIndexConfig, TestStressUserVersions, TestCharFilters, TestInitQParser, TestExceedMaxTermLength, TestCopyFieldCollectionResource, ShardRoutingTest, SliceStateUpdateTest, TestPseudoReturnFields, OverseerRolesTest, TestCoreContainer, TestSolrQueryParser, SpellPossibilityIteratorTest, RegexBoostProcessorTest, ZkControllerTest, DistributedQueryComponentOptimizationTest, TestConfigSets, HdfsBasicDistributedZk2Test, TestJoin, PrimitiveFieldTypeTest, TestTrie, TestQueryUtils, TestStressVersions, SOLR749Test, TestSolrXmlPersistence, TestFieldCollectionResource, StressHdfsTest, SliceStateTest, TestConfig, TestCursorMarkWithoutUniqueKey, HdfsRecoveryZkTest, ZkCLITest, TestFieldSortValues, TestSchemaVersionResource, TestSystemIdResolver, BasicDistributedZkTest, UpdateRequestProcessorFactoryTest, TestCollationFieldDocValues, TestRequestStatusCollectionAPI, TestPHPSerializedResponseWriter, CoreAdminRequestStatusTest, AbstractAnalyticsFacetTest, TestReloadAndDeleteDocs, PreAnalyzedUpdateProcessorTest, TestFaceting, PreAnalyzedFieldTest, MBeansHandlerTest, TestFieldTypeCollectionResource, SolrCoreTest, TestExtendedDismaxParser, ModifyConfFileTest, LeaderElectionTest, EchoParamsTest, TestSort, TestRandomDVFaceting, QueryParsingTest, TestSolrQueryParserResource, TestRandomMergePolicy, ResponseLogComponentTest, ExpressionTest, SyncSliceTest, OverseerTest, RecoveryZkTest, FullSolrCloudDistribCmdsTest, TestRandomFaceting, HardAutoCommitTest, SimpleFacetsTest, StatsComponentTest, TestGroupingSearch, BadIndexSchemaTest, TestFunctionQuery, TestBadConfig, HighlighterTest, CurrencyFieldOpenExchangeTest, CurrencyFieldXmlFileTest, TestCoreDiscovery, AnalysisAfterCoreReloadTest, CoreAdminHandlerTest, NoCacheHeaderTest, WordBreakSolrSpellCheckerTest, SolrCoreCheckLockOnStartupTest, DirectUpdateHandlerOptimizeTest, DefaultValueUpdateProcessorTest, DocValuesMultiTest, DistanceFunctionTest, TestSolrDeletionPolicy1, SolrInfoMBeanTest, TestSurroundQueryParser, StandardRequestHandlerTest, TestReversedWildcardFilterFactory, DocumentAnalysisRequestHandlerTest, TestOmitPositions, TermsComponentTest, RequestHandlersTest, PathHierarchyTokenizerFactoryTest, TestIndexingPerformance, RequiredFieldsTest, IndexSchemaRuntimeFieldTest, TestCollationField, JSONWriterTest, JsonLoaderTest, TestComponentsName, CoreContainerCoreInitFailuresTest, TestLFUCache, HighlighterConfigTest, BadComponentTest, TestDocSet, NumericFieldsTest, MinimalSchemaTest, DirectSolrConnectionTest, TestLuceneMatchVersion, SynonymTokenizerTest, TestDFRSimilarityFactory, TestLMDirichletSimilarityFactory, TestIBSimilarityFactory, TestDefaultSimilarityFactory, ResourceLoaderTest, TestFastOutputStream, URLClassifyProcessorTest, TestFastLRUCache, TestSuggestSpellingConverter, ClusterStateTest, ZkNodePropsTest, UUIDFieldTest, CircularListTest, SolrTestCaseJ4Test, TestDistributedMissingSort, TestHighlightDedupGrouping, FieldFacetTest, AssignTest, CollectionsAPIAsyncDistributedZkTest, CustomCollectionTest, HttpPartitionTest]
   [junit4] Completed on J0 in 39.44s, 1 test, 1 error <<< FAILURES!

[...truncated 192 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:467: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:447: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:45: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:496: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1296: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:920: There were test failures: 406 suites, 1688 tests, 1 error, 36 ignored (15 assumptions)

Total time: 67 minutes 19 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.8.0_05 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure