You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2014/09/02 08:46:30 UTC

[JENKINS] Lucene-Solr-Tests-4.x-Java7 - Build # 2081 - Failure

Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java7/2081/

2 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.handler.TestReplicationHandlerBackup

Error Message:
1 thread leaked from SUITE scope at org.apache.solr.handler.TestReplicationHandlerBackup:     1) Thread[id=5253, name=Thread-1894, state=RUNNABLE, group=TGRP-TestReplicationHandlerBackup]         at java.net.PlainSocketImpl.socketConnect(Native Method)         at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)         at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)         at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)         at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)         at java.net.Socket.connect(Socket.java:579)         at java.net.Socket.connect(Socket.java:528)         at sun.net.NetworkClient.doConnect(NetworkClient.java:180)         at sun.net.www.http.HttpClient.openServer(HttpClient.java:432)         at sun.net.www.http.HttpClient.openServer(HttpClient.java:527)         at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:652)         at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1323)         at java.net.URL.openStream(URL.java:1037)         at org.apache.solr.handler.TestReplicationHandlerBackup$BackupThread.run(TestReplicationHandlerBackup.java:313)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.handler.TestReplicationHandlerBackup: 
   1) Thread[id=5253, name=Thread-1894, state=RUNNABLE, group=TGRP-TestReplicationHandlerBackup]
        at java.net.PlainSocketImpl.socketConnect(Native Method)
        at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
        at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
        at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
        at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
        at java.net.Socket.connect(Socket.java:579)
        at java.net.Socket.connect(Socket.java:528)
        at sun.net.NetworkClient.doConnect(NetworkClient.java:180)
        at sun.net.www.http.HttpClient.openServer(HttpClient.java:432)
        at sun.net.www.http.HttpClient.openServer(HttpClient.java:527)
        at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:652)
        at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1323)
        at java.net.URL.openStream(URL.java:1037)
        at org.apache.solr.handler.TestReplicationHandlerBackup$BackupThread.run(TestReplicationHandlerBackup.java:313)
	at __randomizedtesting.SeedInfo.seed([26228DB1CF3E6922]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.handler.TestReplicationHandlerBackup

Error Message:
There are still zombie threads that couldn't be terminated:    1) Thread[id=5253, name=Thread-1894, state=RUNNABLE, group=TGRP-TestReplicationHandlerBackup]         at java.net.PlainSocketImpl.socketConnect(Native Method)         at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)         at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)         at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)         at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)         at java.net.Socket.connect(Socket.java:579)         at java.net.Socket.connect(Socket.java:528)         at sun.net.NetworkClient.doConnect(NetworkClient.java:180)         at sun.net.www.http.HttpClient.openServer(HttpClient.java:432)         at sun.net.www.http.HttpClient.openServer(HttpClient.java:527)         at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:652)         at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1323)         at java.net.URL.openStream(URL.java:1037)         at org.apache.solr.handler.TestReplicationHandlerBackup$BackupThread.run(TestReplicationHandlerBackup.java:313)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   1) Thread[id=5253, name=Thread-1894, state=RUNNABLE, group=TGRP-TestReplicationHandlerBackup]
        at java.net.PlainSocketImpl.socketConnect(Native Method)
        at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
        at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
        at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
        at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
        at java.net.Socket.connect(Socket.java:579)
        at java.net.Socket.connect(Socket.java:528)
        at sun.net.NetworkClient.doConnect(NetworkClient.java:180)
        at sun.net.www.http.HttpClient.openServer(HttpClient.java:432)
        at sun.net.www.http.HttpClient.openServer(HttpClient.java:527)
        at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:652)
        at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1323)
        at java.net.URL.openStream(URL.java:1037)
        at org.apache.solr.handler.TestReplicationHandlerBackup$BackupThread.run(TestReplicationHandlerBackup.java:313)
	at __randomizedtesting.SeedInfo.seed([26228DB1CF3E6922]:0)




Build Log:
[...truncated 11965 lines...]
   [junit4] Suite: org.apache.solr.handler.TestReplicationHandlerBackup
   [junit4]   2> Creating dataDir: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./temp/solr.handler.TestReplicationHandlerBackup-26228DB1CF3E6922-001/init-core-data-001
   [junit4]   2> 2280730 T5233 oas.SolrTestCaseJ4.setUp ###Starting doTestBackup
   [junit4]   2> 2280756 T5233 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 2280761 T5233 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:51690
   [junit4]   2> 2280762 T5233 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 2280762 T5233 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 2280762 T5233 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./temp/solr.handler.TestReplicationHandlerBackup-26228DB1CF3E6922-001/solr-instance-001
   [junit4]   2> 2280763 T5233 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./temp/solr.handler.TestReplicationHandlerBackup-26228DB1CF3E6922-001/solr-instance-001/'
   [junit4]   2> 2280823 T5233 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./temp/solr.handler.TestReplicationHandlerBackup-26228DB1CF3E6922-001/solr-instance-001/solr.xml
   [junit4]   2> 2280927 T5233 oasc.CoreContainer.<init> New CoreContainer 1668452574
   [junit4]   2> 2280928 T5233 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./temp/solr.handler.TestReplicationHandlerBackup-26228DB1CF3E6922-001/solr-instance-001/]
   [junit4]   2> 2280929 T5233 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 2280929 T5233 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 2280930 T5233 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 2280930 T5233 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 2280930 T5233 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 2280931 T5233 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 2280931 T5233 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 2280931 T5233 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 2280932 T5233 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 2280932 T5233 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 2280933 T5233 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 2280933 T5233 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 2280933 T5233 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 2280939 T5243 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./temp/solr.handler.TestReplicationHandlerBackup-26228DB1CF3E6922-001/solr-instance-001/collection1/'
   [junit4]   2> 2280987 T5243 oasc.SolrConfig.<init> Using Lucene MatchVersion: 4.11.0
   [junit4]   2> 2281031 T5243 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 2281032 T5243 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 2281039 T5243 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 2281060 T5243 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 2281061 T5243 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from instancedir /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./temp/solr.handler.TestReplicationHandlerBackup-26228DB1CF3E6922-001/solr-instance-001/collection1/
   [junit4]   2> 2281062 T5243 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 2281062 T5243 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./temp/solr.handler.TestReplicationHandlerBackup-26228DB1CF3E6922-001/solr-instance-001/collection1/, dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./temp/solr.handler.TestReplicationHandlerBackup-26228DB1CF3E6922-001/solr-instance-001/collection1/data/
   [junit4]   2> 2281062 T5243 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
   [junit4]   2> 2281063 T5243 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./temp/solr.handler.TestReplicationHandlerBackup-26228DB1CF3E6922-001/solr-instance-001/collection1/data
   [junit4]   2> 2281063 T5243 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./temp/solr.handler.TestReplicationHandlerBackup-26228DB1CF3E6922-001/solr-instance-001/collection1/data/index/
   [junit4]   2> 2281063 T5243 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./temp/solr.handler.TestReplicationHandlerBackup-26228DB1CF3E6922-001/solr-instance-001/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 2281064 T5243 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./temp/solr.handler.TestReplicationHandlerBackup-26228DB1CF3E6922-001/solr-instance-001/collection1/data/index
   [junit4]   2> 2281064 T5243 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=10, maxMergeAtOnceExplicit=35, maxMergedSegmentMB=14.84765625, floorSegmentMB=1.1171875, forceMergeDeletesPctAllowed=24.714358407911835, segmentsPerTier=11.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.14100013698173558
   [junit4]   2> 2281065 T5243 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@24a37d94 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@477013da),segFN=segments_1,generation=1}
   [junit4]   2> 2281065 T5243 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 2281066 T5243 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 2281067 T5243 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 2281067 T5243 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 2281067 T5243 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 2281068 T5243 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 2281068 T5243 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 2281068 T5243 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 2281068 T5243 oasc.RequestHandlers.initHandlersFromConfig WARN Multiple requestHandler registered to the same name: /update ignoring: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 2281069 T5243 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 2281098 T5243 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2281100 T5243 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2281103 T5243 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2281105 T5243 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2281107 T5243 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2281110 T5243 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 2281110 T5243 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 2281110 T5243 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=47, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.783623183556906]
   [junit4]   2> 2281111 T5243 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@24a37d94 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@477013da),segFN=segments_1,generation=1}
   [junit4]   2> 2281111 T5243 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 2281112 T5243 oass.SolrIndexSearcher.<init> Opening Searcher@530709e1[collection1] main
   [junit4]   2> 2281112 T5243 oasr.ManagedResourceStorage$FileStorageIO.configure File-based storage initialized to use dir: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./temp/solr.handler.TestReplicationHandlerBackup-26228DB1CF3E6922-001/solr-instance-001/collection1/conf
   [junit4]   2> 2281112 T5243 oasr.RestManager.init Initializing RestManager with initArgs: {storageDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./temp/solr.handler.TestReplicationHandlerBackup-26228DB1CF3E6922-001/solr-instance-001/collection1/conf}
   [junit4]   2> 2281113 T5243 oasr.ManagedResourceStorage.load Reading _rest_managed.json using file:dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./temp/solr.handler.TestReplicationHandlerBackup-26228DB1CF3E6922-001/solr-instance-001/collection1/conf
   [junit4]   2> 2281114 T5243 oasr.ManagedResource.reloadFromStorage WARN No stored data found for /rest/managed
   [junit4]   2> 2281114 T5243 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using file:dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./temp/solr.handler.TestReplicationHandlerBackup-26228DB1CF3E6922-001/solr-instance-001/collection1/conf
   [junit4]   2> 2281115 T5243 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 2281115 T5243 oash.ReplicationHandler.inform Replication enabled for following config files: schema-replication2.xml:schema.xml
   [junit4]   2> 2281115 T5243 oash.ReplicationHandler.inform Commits will be reserved for  10000
   [junit4]   2> 2281116 T5244 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@530709e1[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 2281116 T5243 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 2281116 T5233 oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1
   [junit4]   2> 2281117 T5233 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> ASYNC  NEW_CORE C1018 name=collection1 org.apache.solr.core.SolrCore@438cf91
   [junit4]   2> 2281119 T5236 C1018 oasu.DirectUpdateHandler2.deleteAll [collection1] REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 2281121 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {deleteByQuery=*:*} 0 2
   [junit4]   2> 2281125 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[0]} 0 1
   [junit4]   2> 2281128 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[1]} 0 0
   [junit4]   2> 2281131 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[2]} 0 0
   [junit4]   2> 2281134 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[3]} 0 0
   [junit4]   2> 2281137 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[4]} 0 0
   [junit4]   2> 2281140 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[5]} 0 0
   [junit4]   2> 2281143 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[6]} 0 0
   [junit4]   2> 2281146 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[7]} 0 0
   [junit4]   2> 2281149 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[8]} 0 0
   [junit4]   2> 2281152 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[9]} 0 0
   [junit4]   2> 2281155 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[10]} 0 0
   [junit4]   2> 2281158 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[11]} 0 0
   [junit4]   2> 2281161 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[12]} 0 0
   [junit4]   2> 2281164 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[13]} 0 0
   [junit4]   2> 2281167 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[14]} 0 0
   [junit4]   2> 2281170 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[15]} 0 0
   [junit4]   2> 2281173 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[16]} 0 0
   [junit4]   2> 2281176 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[17]} 0 0
   [junit4]   2> 2281179 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[18]} 0 0
   [junit4]   2> 2281182 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[19]} 0 0
   [junit4]   2> 2281185 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[20]} 0 0
   [junit4]   2> 2281188 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[21]} 0 0
   [junit4]   2> 2281191 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[22]} 0 0
   [junit4]   2> 2281194 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[23]} 0 0
   [junit4]   2> 2281197 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[24]} 0 0
   [junit4]   2> 2281200 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[25]} 0 0
   [junit4]   2> 2281203 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[26]} 0 0
   [junit4]   2> 2281206 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[27]} 0 0
   [junit4]   2> 2281208 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[28]} 0 0
   [junit4]   2> 2281211 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[29]} 0 0
   [junit4]   2> 2281214 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[30]} 0 0
   [junit4]   2> 2281216 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[31]} 0 0
   [junit4]   2> 2281218 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[32]} 0 0
   [junit4]   2> 2281221 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[33]} 0 0
   [junit4]   2> 2281224 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[34]} 0 0
   [junit4]   2> 2281227 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[35]} 0 0
   [junit4]   2> 2281230 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[36]} 0 0
   [junit4]   2> 2281232 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[37]} 0 0
   [junit4]   2> 2281234 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[38]} 0 0
   [junit4]   2> 2281236 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[39]} 0 0
   [junit4]   2> 2281238 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[40]} 0 0
   [junit4]   2> 2281241 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[41]} 0 0
   [junit4]   2> 2281243 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[42]} 0 0
   [junit4]   2> 2281246 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[43]} 0 0
   [junit4]   2> 2281248 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[44]} 0 0
   [junit4]   2> 2281251 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[45]} 0 0
   [junit4]   2> 2281253 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[46]} 0 0
   [junit4]   2> 2281256 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[47]} 0 0
   [junit4]   2> 2281258 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[48]} 0 0
   [junit4]   2> 2281260 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[49]} 0 0
   [junit4]   2> 2281262 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[50]} 0 0
   [junit4]   2> 2281264 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[51]} 0 0
   [junit4]   2> 2281266 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[52]} 0 0
   [junit4]   2> 2281268 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[53]} 0 0
   [junit4]   2> 2281270 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[54]} 0 0
   [junit4]   2> 2281272 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[55]} 0 0
   [junit4]   2> 2281274 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[56]} 0 0
   [junit4]   2> 2281276 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[57]} 0 0
   [junit4]   2> 2281278 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[58]} 0 0
   [junit4]   2> 2281281 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[59]} 0 0
   [junit4]   2> 2281284 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[60]} 0 0
   [junit4]   2> 2281288 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[61]} 0 0
   [junit4]   2> 2281297 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[62]} 0 0
   [junit4]   2> 2281300 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[63]} 0 0
   [junit4]   2> 2281302 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[64]} 0 0
   [junit4]   2> 2281304 T5236 C1018 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 2281308 T5236 C1018 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@24a37d94 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@477013da),segFN=segments_1,generation=1}
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@24a37d94 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@477013da),segFN=segments_2,generation=2}
   [junit4]   2> 2281309 T5236 C1018 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
   [junit4]   2> 2281310 T5236 C1018 oass.SolrIndexSearcher.<init> Opening Searcher@3c6f3a9e[collection1] main
   [junit4]   2> 2281311 T5236 C1018 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 2281311 T5244 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3c6f3a9e[collection1] main{StandardDirectoryReader(segments_2:4:nrt _0(4.11.0):C65)}
   [junit4]   2> 2281311 T5236 C1018 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&commit=true&waitSearcher=true&softCommit=false&wt=javabin} {commit=} 0 7
   [junit4]   2> 2281315 T5238 C1018 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=details} status=0 QTime=0 
   [junit4]   2> 2281332 T5237 C1018 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={name=ljxffblmiglfym&command=backup} status=0 QTime=17 
   [junit4]   2> 2281333 T5248 oash.SnapShooter.createSnapshot Creating backup snapshot...
   [junit4]   2> 2281352 T5248 oash.SnapShooter.createSnapshot Done creating backup snapshot, completed at: Tue Sep 02 08:36:24 CEST 2014
   [junit4]   2> 2281352 T5248 oash.SnapShooter.createSnapshot Done creating backup snapshot: ljxffblmiglfym
   [junit4]   2> 2281519 T5237 C1018 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=details} status=0 QTime=1 
   [junit4]   2> 2282528 T5238 C1018 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=details} status=0 QTime=0 
   [junit4]   2> 2282530 T5237 C1018 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={name=opfz&command=backup} status=0 QTime=2 
   [junit4]   2> 2282530 T5250 oash.SnapShooter.createSnapshot Creating backup snapshot...
   [junit4]   2> 2282546 T5250 oash.SnapShooter.createSnapshot Done creating backup snapshot, completed at: Tue Sep 02 08:36:25 CEST 2014
   [junit4]   2> 2282547 T5250 oash.SnapShooter.createSnapshot Done creating backup snapshot: opfz
   [junit4]   2> 2282731 T5237 C1018 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=details} status=0 QTime=1 
   [junit4]   2> 2282738 T5238 C1018 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=details} status=0 QTime=0 
   [junit4]   2> 2282744 T5237 C1018 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={name=ljxffblmiglfym&command=deletebackup} status=0 QTime=7 
   [junit4]   2> 2282744 T5252 oash.SnapShooter.deleteNamedSnapshot Deleting snapshot: ljxffblmiglfym
   [junit4]   2> 2282941 T5237 C1018 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=details} status=0 QTime=0 
   [junit4]   2> 2282944 T5237 C1018 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=details} status=0 QTime=0 
   [junit4]   2> 2282944 T5233 oas.SolrTestCaseJ4.tearDown ###Ending doTestBackup
   [junit4]   2> 2282945 T5238 C1018 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={name=opfz&command=deletebackup} status=0 QTime=1 
   [junit4]   2> 2282945 T5233 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1668452574
   [junit4]   2> 2282945 T5254 oash.SnapShooter.deleteNamedSnapshot Deleting snapshot: opfz
   [junit4]   2> 2282947 T5233 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
   [junit4]   2> 2282947 T5238 C1018 oasc.SolrException.log ERROR null:org.eclipse.jetty.io.EofException
   [junit4]   2> 		at org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:142)
   [junit4]   2> 		at org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:107)
   [junit4]   2> 		at sun.nio.cs.StreamEncoder.writeBytes(StreamEncoder.java:221)
   [junit4]   2> 		at sun.nio.cs.StreamEncoder.implFlushBuffer(StreamEncoder.java:291)
   [junit4]   2> 		at sun.nio.cs.StreamEncoder.implFlush(StreamEncoder.java:295)
   [junit4]   2> 		at sun.nio.cs.StreamEncoder.flush(StreamEncoder.java:141)
   [junit4]   2> 		at java.io.OutputStreamWriter.flush(OutputStreamWriter.java:229)
   [junit4]   2> 		at org.apache.solr.util.FastWriter.flush(FastWriter.java:137)
   [junit4]   2> 		at org.apache.solr.servlet.SolrDispatchFilter.writeResponse(SolrDispatchFilter.java:766)
   [junit4]   2> 		at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:426)
   [junit4]   2> 		at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:207)
   [junit4]   2> 		at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
   [junit4]   2> 		at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:137)
   [junit4]   2> 		at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
   [junit4]   2> 		at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
   [junit4]   2> 		at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
   [junit4]   2> 		at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
   [junit4]   2> 		at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
   [junit4]   2> 		at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
   [junit4]   2> 		at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
   [junit4]   2> 		at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
   [junit4]   2> 		at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
   [junit4]   2> 		at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
   [junit4]   2> 		at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
   [junit4]   2> 		at org.eclipse.jetty.server.Server.handle(Server.java:368)
   [junit4]   2> 		at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
   [junit4]   2> 		at org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53)
   [junit4]   2> 		at org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:942)
   [junit4]   2> 		at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:1004)
   [junit4]   2> 		at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:640)
   [junit4]   2> 		at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
   [junit4]   2> 		at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72)
   [junit4]   2> 		at org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264)
   [junit4]   2> 		at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
   [junit4]   2> 		at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
   [junit4]   2> 		at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 	
   [junit4]   2> 2282949 T5238 C1018 oasc.SolrException.log ERROR null:org.eclipse.jetty.io.EofException
   [junit4]   2> 		at org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:142)
   [junit4]   2> 		at org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:107)
   [junit4]   2> 		at sun.nio.cs.StreamEncoder.writeBytes(StreamEncoder.java:221)
   [junit4]   2> 		at sun.nio.cs.StreamEncoder.implFlushBuffer(StreamEncoder.java:291)
   [junit4]   2> 		at sun.nio.cs.StreamEncoder.implFlush(StreamEncoder.java:295)
   [junit4]   2> 		at sun.nio.cs.StreamEncoder.flush(StreamEncoder.java:141)
   [junit4]   2> 		at java.io.OutputStreamWriter.flush(OutputStreamWriter.java:229)
   [junit4]   2> 		at org.apache.solr.util.FastWriter.flush(FastWriter.java:137)
   [junit4]   2> 		at org.apache.solr.servlet.SolrDispatchFilter.writeResponse(SolrDispatchFilter.java:766)
   [junit4]   2> 		at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:426)
   [junit4]   2> 		at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:207)
   [junit4]   2> 		at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
   [junit4]   2> 		at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:137)
   [junit4]   2> 		at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
   [junit4]   2> 		at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
   [junit4]   2> 		at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
   [junit4]   2> 		at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
   [junit4]   2> 		at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
   [junit4]   2> 		at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
   [junit4]   2> 		at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
   [junit4]   2> 		at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
   [junit4]   2> 		at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
   [junit4]   2> 		at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
   [junit4]   2> 		at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
   [junit4]   2> 		at org.eclipse.jetty.server.Server.handle(Server.java:368)
   [junit4]   2> 		at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
   [junit4]   2> 		at org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53)
   [junit4]   2> 		at org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:942)
   [junit4]   2> 		at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:1004)
   [junit4]   2> 		at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:640)
   [junit4]   2> 		at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
   [junit4]   2> 		at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72)
   [junit4]   2> 		at org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264)
   [junit4]   2> 		at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
   [junit4]   2> 		at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
   [junit4]   2> 		at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 	
   [junit4]   2> 2282951 T5238 C1018 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@438cf91
   [junit4]   2> 2282952 T5238 C1018 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=65,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0}
   [junit4]   2> 2282953 T5238 C1018 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 2282953 T5238 C1018 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 2282954 T5238 C1018 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 2282955 T5238 C1018 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 2282956 T5238 C1018 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 2282956 T5238 C1018 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./temp/solr.handler.TestReplicationHandlerBackup-26228DB1CF3E6922-001/solr-instance-001/collection1/data [CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./temp/solr.handler.TestReplicationHandlerBackup-26228DB1CF3E6922-001/solr-instance-001/collection1/data;done=false>>]
   [junit4]   2> 2282956 T5238 C1018 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./temp/solr.handler.TestReplicationHandlerBackup-26228DB1CF3E6922-001/solr-instance-001/collection1/data
   [junit4]   2> 2282957 T5238 C1018 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./temp/solr.handler.TestReplicationHandlerBackup-26228DB1CF3E6922-001/solr-instance-001/collection1/data/index [CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./temp/solr.handler.TestReplicationHandlerBackup-26228DB1CF3E6922-001/solr-instance-001/collection1/data/index;done=false>>]
   [junit4]   2> 2282957 T5238 C1018 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./temp/solr.handler.TestReplicationHandlerBackup-26228DB1CF3E6922-001/solr-instance-001/collection1/data/index
   [junit4]   2> 2287954 T5233 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> 7233 T5232 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> 27391 T5232 ccr.ThreadLeakControl.checkThreadLeaks SEVERE 1 thread leaked from SUITE scope at org.apache.solr.handler.TestReplicationHandlerBackup: 
   [junit4]   2> 	   1) Thread[id=5253, name=Thread-1894, state=RUNNABLE, group=TGRP-TestReplicationHandlerBackup]
   [junit4]   2> 	        at java.net.PlainSocketImpl.socketConnect(Native Method)
   [junit4]   2> 	        at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
   [junit4]   2> 	        at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
   [junit4]   2> 	        at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
   [junit4]   2> 	        at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
   [junit4]   2> 	        at java.net.Socket.connect(Socket.java:579)
   [junit4]   2> 	        at java.net.Socket.connect(Socket.java:528)
   [junit4]   2> 	        at sun.net.NetworkClient.doConnect(NetworkClient.java:180)
   [junit4]   2> 	        at sun.net.www.http.HttpClient.openServer(HttpClient.java:432)
   [junit4]   2> 	        at sun.net.www.http.HttpClient.openServer(HttpClient.java:527)
   [junit4]   2> 	        at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:652)
   [junit4]   2> 	        at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1323)
   [junit4]   2> 	        at java.net.URL.openStream(URL.java:1037)
   [junit4]   2> 	        at org.apache.solr.handler.TestReplicationHandlerBackup$BackupThread.run(TestReplicationHandlerBackup.java:313)
   [junit4]   2> 27392 T5232 ccr.ThreadLeakControl.tryToInterruptAll Starting to interrupt leaked threads:
   [junit4]   2> 	   1) Thread[id=5253, name=Thread-1894, state=RUNNABLE, group=TGRP-TestReplicationHandlerBackup]
   [junit4]   2> 30399 T5232 ccr.ThreadLeakControl.tryToInterruptAll SEVERE There are still zombie threads that couldn't be terminated:
   [junit4]   2> 	   1) Thread[id=5253, name=Thread-1894, state=RUNNABLE, group=TGRP-TestReplicationHandlerBackup]
   [junit4]   2> 	        at java.net.PlainSocketImpl.socketConnect(Native Method)
   [junit4]   2> 	        at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
   [junit4]   2> 	        at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
   [junit4]   2> 	        at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
   [junit4]   2> 	        at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
   [junit4]   2> 	        at java.net.Socket.connect(Socket.java:579)
   [junit4]   2> 	        at java.net.Socket.connect(Socket.java:528)
   [junit4]   2> 	        at sun.net.NetworkClient.doConnect(NetworkClient.java:180)
   [junit4]   2> 	        at sun.net.www.http.HttpClient.openServer(HttpClient.java:432)
   [junit4]   2> 	        at sun.net.www.http.HttpClient.openServer(HttpClient.java:527)
   [junit4]   2> 	        at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:652)
   [junit4]   2> 	        at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1323)
   [junit4]   2> 	        at java.net.URL.openStream(URL.java:1037)
   [junit4]   2> 	        at org.apache.solr.handler.TestReplicationHandlerBackup$BackupThread.run(TestReplicationHandlerBackup.java:313)
   [junit4]   2> NOTE: test params are: codec=Lucene410: {id=FST41, name=FST41}, docValues:{}, sim=DefaultSimilarity, locale=en_AU, timezone=Europe/Copenhagen
   [junit4]   2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_65 (64-bit)/cpus=16,threads=2,free=55567176,total=345505792
   [junit4]   2> NOTE: All tests run in this JVM: [TestStandardQParsers, TestRemoteStreaming, TestCustomSort, PolyFieldTest, TestUpdate, SoftAutoCommitTest, CachingDirectoryFactoryTest, SearchHandlerTest, SortByFunctionTest, TestPseudoReturnFields, CopyFieldTest, EnumFieldTest, FieldAnalysisRequestHandlerTest, TermsComponentTest, ShardSplitTest, FileBasedSpellCheckerTest, SpatialFilterTest, TestCloudManagedSchemaConcurrent, BasicFunctionalityTest, ClusterStateTest, TestSimpleQParserPlugin, TestDynamicFieldResource, EchoParamsTest, SpellPossibilityIteratorTest, TestFastLRUCache, TestManagedStopFilterFactory, QueryResultKeyTest, HdfsLockFactoryTest, TestSortingResponseWriter, TestCharFilters, ZkCLITest, SolrIndexSplitterTest, TestParamSet, TestStressLucene, ClusterStateUpdateTest, TestSystemIdResolver, TestPartialUpdateDeduplication, TestBadConfig, MoreLikeThisHandlerTest, MultiTermTest, StandardRequestHandlerTest, DefaultValueUpdateProcessorTest, UniqFieldsUpdateProcessorFactoryTest, TestShardHandlerFactory, BasicZkTest, TestSolrXmlPersistence, OverseerTest, SimpleFacetsTest, TestSchemaSimilarityResource, OverseerRolesTest, OverseerStatusTest, TestReplicationHandler, SyncSliceTest, ShardRoutingTest, TestCloudPivotFacet, MigrateRouteKeyTest, AliasIntegrationTest, DistributedTermsComponentTest, RemoteQueryErrorTest, SolrCmdDistributorTest, AnalyticsMergeStrategyTest, DistributedQueryComponentCustomSortTest, CursorPagingTest, TestGroupingSearch, AutoCommitTest, BlockDirectoryTest, DistributedDebugComponentTest, TestReplicationHandlerBackup]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestReplicationHandlerBackup -Dtests.seed=26228DB1CF3E6922 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=en_AU -Dtests.timezone=Europe/Copenhagen -Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.00s J1 | TestReplicationHandlerBackup (suite) <<<
   [junit4]    > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.handler.TestReplicationHandlerBackup: 
   [junit4]    >    1) Thread[id=5253, name=Thread-1894, state=RUNNABLE, group=TGRP-TestReplicationHandlerBackup]
   [junit4]    >         at java.net.PlainSocketImpl.socketConnect(Native Method)
   [junit4]    >         at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
   [junit4]    >         at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
   [junit4]    >         at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
   [junit4]    >         at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
   [junit4]    >         at java.net.Socket.connect(Socket.java:579)
   [junit4]    >         at java.net.Socket.connect(Socket.java:528)
   [junit4]    >         at sun.net.NetworkClient.doConnect(NetworkClient.java:180)
   [junit4]    >         at sun.net.www.http.HttpClient.openServer(HttpClient.java:432)
   [junit4]    >         at sun.net.www.http.HttpClient.openServer(HttpClient.java:527)
   [junit4]    >         at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:652)
   [junit4]    >         at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1323)
   [junit4]    >         at java.net.URL.openStream(URL.java:1037)
   [junit4]    >         at org.apache.solr.handler.TestReplicationHandlerBackup$BackupThread.run(TestReplicationHandlerBackup.java:313)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([26228DB1CF3E6922]:0)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   [junit4]    >    1) Thread[id=5253, name=Thread-1894, state=RUNNABLE, group=TGRP-TestReplicationHandlerBackup]
   [junit4]    >         at java.net.PlainSocketImpl.socketConnect(Native Method)
   [junit4]    >         at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
   [junit4]    >         at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
   [junit4]    >         at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
   [junit4]    >         at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
   [junit4]    >         at java.net.Socket.connect(Socket.java:579)
   [junit4]    >         at java.net.Socket.connect(Socket.java:528)
   [junit4]    >         at sun.net.NetworkClient.doConnect(NetworkClient.java:180)
   [junit4]    >         at sun.net.www.http.HttpClient.openServer(HttpClient.java:432)
   [junit4]    >         at sun.net.www.http.HttpClient.openServer(HttpClient.java:527)
   [junit4]    >         at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:652)
   [junit4]    >         at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1323)
   [junit4]    >         at java.net.URL.openStream(URL.java:1037)
   [junit4]    >         at org.apache.solr.handler.TestReplicationHandlerBackup$BackupThread.run(TestReplicationHandlerBackup.java:313)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([26228DB1CF3E6922]:0)
   [junit4] Completed on J1 in 30.46s, 1 test, 2 errors <<< FAILURES!

[...truncated 433 lines...]
BUILD FAILED
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:492: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:472: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:60: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/extra-targets.xml:39: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build.xml:189: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/common-build.xml:494: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:1344: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:959: There were test failures: 423 suites, 1751 tests, 2 suite-level errors, 407 ignored (23 assumptions)

Total time: 69 minutes 25 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Sending artifact delta relative to Lucene-Solr-Tests-4.x-Java7 #2080
Archived 5 artifacts
Archive block size is 32768
Received 0 blocks and 189581412 bytes
Compression is 0.0%
Took 32 sec
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-Tests-4.x-Java7 - Build # 2082 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java7/2082/

1 tests failed.
FAILED:  org.apache.solr.client.solrj.TestLBHttpSolrServer.testReliability

Error Message:
No live SolrServers available to handle this request

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request
	at __randomizedtesting.SeedInfo.seed([98ED9618768A98EB:59254B5ED7EC4942]:0)
	at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:525)
	at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:91)
	at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:301)
	at org.apache.solr.client.solrj.TestLBHttpSolrServer.testReliability(TestLBHttpSolrServer.java:222)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:63868/solr
	at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:558)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:210)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:206)
	at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:478)
	... 44 more
Caused by: java.net.SocketTimeoutException: Read timed out
	at java.net.SocketInputStream.socketRead0(Native Method)
	at java.net.SocketInputStream.read(SocketInputStream.java:152)
	at java.net.SocketInputStream.read(SocketInputStream.java:122)
	at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
	at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
	at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:260)
	at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
	at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
	at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:271)
	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:123)
	at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:682)
	at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:486)
	at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:863)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:106)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:57)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:448)
	... 47 more




Build Log:
[...truncated 12821 lines...]
   [junit4] Suite: org.apache.solr.client.solrj.TestLBHttpSolrServer
   [junit4]   2> SLF4J: Class path contains multiple SLF4J bindings.
   [junit4]   2> SLF4J: Found binding in [jar:file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/solrj/test-lib/slf4j-log4j12-1.7.6.jar!/org/slf4j/impl/StaticLoggerBinder.class]
   [junit4]   2> SLF4J: Found binding in [jar:file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/lib/slf4j-log4j12-1.7.6.jar!/org/slf4j/impl/StaticLoggerBinder.class]
   [junit4]   2> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
   [junit4]   2> SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
   [junit4]   2> log4j:WARN No such property [conversionPattern] in org.apache.solr.util.SolrLogLayout.
   [junit4]   2> Creating dataDir: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/./temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/init-core-data-001
   [junit4]   2> 4919 T11 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (true)
   [junit4]   2> 5127 T11 oas.SolrTestCaseJ4.setUp ###Starting testReliability
   [junit4]   2> 6769 T11 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 7330 T11 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:42720
   [junit4]   2> 7599 T11 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 7819 T11 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 7820 T11 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/./temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-0-001
   [junit4]   2> 7821 T11 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/./temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-0-001/'
   [junit4]   2> 9036 T11 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/./temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-0-001/solr.xml
   [junit4]   2> 9401 T11 oasc.CoreContainer.<init> New CoreContainer 525639105
   [junit4]   2> 9410 T11 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/./temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-0-001/]
   [junit4]   2> 9663 T11 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 9664 T11 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 9665 T11 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 9665 T11 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 9666 T11 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 9669 T11 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 9670 T11 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 9671 T11 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 9672 T11 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 10081 T11 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 10103 T11 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 10109 T11 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 10119 T11 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 10865 T23 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/./temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-0-001/collection1/'
   [junit4]   2> 11055 T23 oasc.SolrConfig.<init> Using Lucene MatchVersion: 4.11.0
   [junit4]   2> 11396 T23 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 11455 T23 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 11510 T23 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 11728 T23 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.IntField]. Please consult documentation how to replace it accordingly.
   [junit4]   2> 11809 T23 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 11833 T23 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from instancedir /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/./temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-0-001/collection1/
   [junit4]   2> 12287 T23 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockFSDirectoryFactory
   [junit4]   2> 12366 T23 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/./temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-0-001/collection1/, dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/./temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-0-001/collection1/data/
   [junit4]   2> 12367 T23 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
   [junit4]   2> 12580 T23 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-0-001/collection1/data
   [junit4]   2> 12583 T23 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/./temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-0-001/collection1/data/index/
   [junit4]   2> 12585 T23 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/./temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-0-001/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 12638 T23 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-0-001/collection1/data/index
   [junit4]   2> 13085 T23 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(SimpleFSDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-0-001/collection1/data/index lockFactory=NativeFSLockFactory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-0-001/collection1/data/index),segFN=segments_1,generation=1}
   [junit4]   2> 13095 T23 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 15057 T23 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 15184 T23 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 15185 T23 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 15186 T23 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 15187 T23 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 15250 T23 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 15251 T23 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
   [junit4]   2> 15252 T23 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
   [junit4]   2> 15272 T23 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
   [junit4]   2> 15301 T23 oasc.RequestHandlers.initHandlersFromConfig WARN Multiple requestHandler registered to the same name: /update ignoring: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 15302 T23 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 15375 T23 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 15579 T23 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 15613 T23 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 15616 T23 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 15619 T23 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 15622 T23 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 15750 T23 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 15751 T23 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 15799 T23 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(SimpleFSDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-0-001/collection1/data/index lockFactory=NativeFSLockFactory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-0-001/collection1/data/index),segFN=segments_1,generation=1}
   [junit4]   2> 15801 T23 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 15958 T23 oass.SolrIndexSearcher.<init> Opening Searcher@37f4ff60[collection1] main
   [junit4]   2> 16059 T23 oasr.ManagedResourceStorage$FileStorageIO.configure File-based storage initialized to use dir: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/./temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-0-001/collection1/conf
   [junit4]   2> 16060 T23 oasr.RestManager.init Initializing RestManager with initArgs: {storageDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/./temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-0-001/collection1/conf}
   [junit4]   2> 16274 T23 oasr.ManagedResourceStorage.load Reading _rest_managed.json using file:dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/./temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-0-001/collection1/conf
   [junit4]   2> 16277 T23 oasr.ManagedResource.reloadFromStorage WARN No stored data found for /rest/managed
   [junit4]   2> 16301 T23 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using file:dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/./temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-0-001/collection1/conf
   [junit4]   2> 16302 T23 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 16582 T23 oash.ReplicationHandler.inform Commits will be reserved for  10000
   [junit4]   2> 16583 T24 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@37f4ff60[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 16583 T23 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 16602 T11 oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0
   [junit4]   2> 16603 T11 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> ASYNC  NEW_CORE C0 name=collection1 org.apache.solr.core.SolrCore@28c53639
   [junit4]   2> 19633 T17 C0 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[0, 1, 2, 3, 4, 5, 6, 7, 8, 9]} 0 1152
   [junit4]   2> 19952 T17 C0 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 21405 T17 C0 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(SimpleFSDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-0-001/collection1/data/index lockFactory=NativeFSLockFactory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-0-001/collection1/data/index),segFN=segments_1,generation=1}
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(SimpleFSDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-0-001/collection1/data/index lockFactory=NativeFSLockFactory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-0-001/collection1/data/index),segFN=segments_2,generation=2}
   [junit4]   2> 21408 T17 C0 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
   [junit4]   2> 21724 T17 C0 oass.SolrIndexSearcher.<init> Opening Searcher@642d5561[collection1] main
   [junit4]   2> 21731 T17 C0 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 21751 T24 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@642d5561[collection1] main{StandardDirectoryReader(segments_2:3:nrt _0(4.11.0):c10)}
   [junit4]   2> 21753 T17 C0 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&waitSearcher=true&commit=true&softCommit=false&version=2} {commit=} 0 1801
   [junit4]   2> 21781 T11 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 21785 T11 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:32226
   [junit4]   2> 21787 T11 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 21788 T11 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 21789 T11 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/./temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-1-001
   [junit4]   2> 21791 T11 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/./temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-1-001/'
   [junit4]   2> 21865 T11 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/./temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-1-001/solr.xml
   [junit4]   2> 22050 T11 oasc.CoreContainer.<init> New CoreContainer 1500684970
   [junit4]   2> 22051 T11 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/./temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-1-001/]
   [junit4]   2> 22054 T11 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 22056 T11 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 22057 T11 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 22058 T11 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 22059 T11 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 22060 T11 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 22062 T11 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 22063 T11 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 22064 T11 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 22066 T11 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 22068 T11 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 22069 T11 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 22070 T11 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 22081 T35 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/./temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-1-001/collection1/'
   [junit4]   2> 22147 T35 oasc.SolrConfig.<init> Using Lucene MatchVersion: 4.11.0
   [junit4]   2> 22210 T35 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 22212 T35 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 22222 T35 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 22248 T35 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 22249 T35 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from instancedir /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/./temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-1-001/collection1/
   [junit4]   2> 22250 T35 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockFSDirectoryFactory
   [junit4]   2> 22251 T35 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/./temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-1-001/collection1/, dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/./temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-1-001/collection1/data/
   [junit4]   2> 22251 T35 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
   [junit4]   2> 22253 T35 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-1-001/collection1/data
   [junit4]   2> 22255 T35 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/./temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-1-001/collection1/data/index/
   [junit4]   2> 22256 T35 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/./temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-1-001/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 22258 T35 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-1-001/collection1/data/index
   [junit4]   2> 22265 T35 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(SimpleFSDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-1-001/collection1/data/index lockFactory=NativeFSLockFactory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-1-001/collection1/data/index),segFN=segments_1,generation=1}
   [junit4]   2> 22266 T35 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 22268 T35 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 22269 T35 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 22270 T35 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 22270 T35 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 22271 T35 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 22271 T35 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 22272 T35 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
   [junit4]   2> 22272 T35 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
   [junit4]   2> 22273 T35 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
   [junit4]   2> 22273 T35 oasc.RequestHandlers.initHandlersFromConfig WARN Multiple requestHandler registered to the same name: /update ignoring: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 22274 T35 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 22274 T35 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 22299 T35 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 22302 T35 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 22304 T35 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 22306 T35 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 22309 T35 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 22315 T35 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 22315 T35 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 22319 T35 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(SimpleFSDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-1-001/collection1/data/index lockFactory=NativeFSLockFactory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-1-001/collection1/data/index),segFN=segments_1,generation=1}
   [junit4]   2> 22319 T35 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 22320 T35 oass.SolrIndexSearcher.<init> Opening Searcher@3679278a[collection1] main
   [junit4]   2> 22321 T35 oasr.ManagedResourceStorage$FileStorageIO.configure File-based storage initialized to use dir: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/./temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-1-001/collection1/conf
   [junit4]   2> 22321 T35 oasr.RestManager.init Initializing RestManager with initArgs: {storageDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/./temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-1-001/collection1/conf}
   [junit4]   2> 22322 T35 oasr.ManagedResourceStorage.load Reading _rest_managed.json using file:dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/./temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-1-001/collection1/conf
   [junit4]   2> 22324 T35 oasr.ManagedResource.reloadFromStorage WARN No stored data found for /rest/managed
   [junit4]   2> 22324 T35 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using file:dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/./temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-1-001/collection1/conf
   [junit4]   2> 22325 T35 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 22325 T35 oash.ReplicationHandler.inform Commits will be reserved for  10000
   [junit4]   2> 22326 T36 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3679278a[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 22326 T35 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 22328 T11 oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0
   [junit4]   2> 22329 T11 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> ASYNC  NEW_CORE C1 name=collection1 org.apache.solr.core.SolrCore@3da02761
   [junit4]   2> 22339 T28 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[0, 1, 2, 3, 4, 5, 6, 7, 8, 9]} 0 6
   [junit4]   2> 22344 T28 C1 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 22376 T28 C1 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(SimpleFSDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-1-001/collection1/data/index lockFactory=NativeFSLockFactory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-1-001/collection1/data/index),segFN=segments_1,generation=1}
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(SimpleFSDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-1-001/collection1/data/index lockFactory=NativeFSLockFactory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-1-001/collection1/data/index),segFN=segments_2,generation=2}
   [junit4]   2> 22377 T28 C1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
   [junit4]   2> 22384 T28 C1 oass.SolrIndexSearcher.<init> Opening Searcher@547da7dd[collection1] main
   [junit4]   2> 22385 T28 C1 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 22385 T36 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@547da7dd[collection1] main{StandardDirectoryReader(segments_2:3:nrt _0(4.11.0):c10)}
   [junit4]   2> 22387 T28 C1 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&waitSearcher=true&commit=true&softCommit=false&version=2} {commit=} 0 43
   [junit4]   2> 22408 T11 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 22410 T11 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:63868
   [junit4]   2> 22411 T11 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 22412 T11 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 22413 T11 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/./temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-2-001
   [junit4]   2> 22413 T11 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/./temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-2-001/'
   [junit4]   2> 22471 T11 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/./temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-2-001/solr.xml
   [junit4]   2> 22594 T11 oasc.CoreContainer.<init> New CoreContainer 878818280
   [junit4]   2> 22594 T11 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/./temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-2-001/]
   [junit4]   2> 22596 T11 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 22597 T11 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 22597 T11 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 22598 T11 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 22599 T11 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 22599 T11 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 22600 T11 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 22601 T11 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 22602 T11 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 22603 T11 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 22604 T11 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 22605 T11 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 22606 T11 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 22615 T47 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/./temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-2-001/collection1/'
   [junit4]   2> 22695 T47 oasc.SolrConfig.<init> Using Lucene MatchVersion: 4.11.0
   [junit4]   2> 22780 T47 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 22782 T47 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 22795 T47 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 22824 T47 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 22826 T47 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from instancedir /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/./temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-2-001/collection1/
   [junit4]   2> 22827 T47 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockFSDirectoryFactory
   [junit4]   2> 22828 T47 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/./temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-2-001/collection1/, dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/./temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-2-001/collection1/data/
   [junit4]   2> 22828 T47 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
   [junit4]   2> 22830 T47 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-2-001/collection1/data
   [junit4]   2> 22832 T47 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/./temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-2-001/collection1/data/index/
   [junit4]   2> 22833 T47 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/./temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-2-001/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 22835 T47 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-2-001/collection1/data/index
   [junit4]   2> 22843 T47 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(SimpleFSDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-2-001/collection1/data/index lockFactory=NativeFSLockFactory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-2-001/collection1/data/index),segFN=segments_1,generation=1}
   [junit4]   2> 22844 T47 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 22848 T47 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 22849 T47 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 22849 T47 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 22850 T47 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 22851 T47 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 22851 T47 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 22852 T47 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
   [junit4]   2> 22853 T47 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
   [junit4]   2> 22853 T47 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
   [junit4]   2> 22854 T47 oasc.RequestHandlers.initHandlersFromConfig WARN Multiple requestHandler registered to the same name: /update ignoring: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 22854 T47 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 22855 T47 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 22883 T47 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 22886 T47 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 22888 T47 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 22891 T47 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 22894 T47 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 22898 T47 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 22899 T47 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 22903 T47 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(SimpleFSDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-2-001/collection1/data/index lockFactory=NativeFSLockFactory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-2-001/collection1/data/index),segFN=segments_1,generation=1}
   [junit4]   2> 22904 T47 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 22905 T47 oass.SolrIndexSearcher.<init> Opening Searcher@7b0f62cb[collection1] main
   [junit4]   2> 22906 T47 oasr.ManagedResourceStorage$FileStorageIO.configure File-based storage initialized to use dir: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/./temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-2-001/collection1/conf
   [junit4]   2> 22906 T47 oasr.RestManager.init Initializing RestManager with initArgs: {storageDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/./temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-2-001/collection1/conf}
   [junit4]   2> 22907 T47 oasr.ManagedResourceStorage.load Reading _rest_managed.json using file:dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/./temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-2-001/collection1/conf
   [junit4]   2> 22909 T47 oasr.ManagedResource.reloadFromStorage WARN No stored data found for /rest/managed
   [junit4]   2> 22910 T47 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using file:dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/./temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-2-001/collection1/conf
   [junit4]   2> 22911 T47 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 22911 T47 oash.ReplicationHandler.inform Commits will be reserved for  10000
   [junit4]   2> 22912 T48 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7b0f62cb[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 22912 T47 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 22914 T11 oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0
   [junit4]   2> 22915 T11 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> ASYNC  NEW_CORE C2 name=collection1 org.apache.solr.core.SolrCore@475478ad
   [junit4]   2> 22928 T40 C2 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[0, 1, 2, 3, 4, 5, 6, 7, 8, 9]} 0 8
   [junit4]   2> 22934 T40 C2 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 22977 T40 C2 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(SimpleFSDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-2-001/collection1/data/index lockFactory=NativeFSLockFactory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-2-001/collection1/data/index),segFN=segments_1,generation=1}
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(SimpleFSDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-2-001/collection1/data/index lockFactory=NativeFSLockFactory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-2-001/collection1/data/index),segFN=segments_2,generation=2}
   [junit4]   2> 22978 T40 C2 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
   [junit4]   2> 22988 T40 C2 oass.SolrIndexSearcher.<init> Opening Searcher@1a1577da[collection1] main
   [junit4]   2> 22989 T40 C2 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 22989 T48 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1a1577da[collection1] main{StandardDirectoryReader(segments_2:3:nrt _0(4.11.0):c10)}
   [junit4]   2> 22990 T40 C2 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&waitSearcher=true&commit=true&softCommit=false&version=2} {commit=} 0 56
   [junit4]   2> 22995 T11 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1500684970
   [junit4]   2> 22997 T11 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@3da02761
   [junit4]   2> 22998 T11 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=10,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 22999 T11 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 23000 T11 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 23001 T11 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 23009 T11 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 23010 T11 oasc.CachingDirectoryFactory.close Closing MockFSDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 23012 T11 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-1-001/collection1/data [CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-1-001/collection1/data;done=false>>]
   [junit4]   2> 23013 T11 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-1-001/collection1/data
   [junit4]   2> 23014 T11 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-1-001/collection1/data/index [CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-1-001/collection1/data/index;done=false>>]
   [junit4]   2> 23015 T11 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-1-001/collection1/data/index
   [junit4]   2> 23182 T11 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
   [junit4]   2> 28820 T41 C2 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={wt=javabin&version=2&q=*:*} hits=10 status=0 QTime=240 
   [junit4]   2> ASYNC  NEW_CORE C3 name=collection1 org.apache.solr.core.SolrCore@28c53639
   [junit4]   2> 28820 T22 C3 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={wt=javabin&version=2&q=*:*} hits=10 status=0 QTime=758 
   [junit4]   2> 28831 T11 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=525639105
   [junit4]   2> 28831 T50 oahic.DefaultRequestDirector.tryExecute I/O exception (java.net.SocketException) caught when processing request: Connection reset
   [junit4]   2> 28832 T11 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
   [junit4]   2> 28833 T50 oahic.DefaultRequestDirector.tryExecute Retrying request
   [junit4]   2> 28869 T22 C3 oasc.SolrException.log ERROR null:org.eclipse.jetty.io.EofException
   [junit4]   2> 		at org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:142)
   [junit4]   2> 		at org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:107)
   [junit4]   2> 		at org.apache.solr.common.util.FastOutputStream.flush(FastOutputStream.java:214)
   [junit4]   2> 		at org.apache.solr.common.util.FastOutputStream.flushBuffer(FastOutputStream.java:207)
   [junit4]   2> 		at org.apache.solr.common.util.JavaBinCodec.marshal(JavaBinCodec.java:98)
   [junit4]   2> 		at org.apache.solr.response.BinaryResponseWriter.write(BinaryResponseWriter.java:52)
   [junit4]   2> 		at org.apache.solr.servlet.SolrDispatchFilter.writeResponse(SolrDispatchFilter.java:758)
   [junit4]   2> 		at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:426)
   [junit4]   2> 		at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:207)
   [junit4]   2> 		at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
   [junit4]   2> 		at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:137)
   [junit4]   2> 		at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
   [junit4]   2> 		at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
   [junit4]   2> 		at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
   [junit4]   2> 		at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
   [junit4]   2> 		at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
   [junit4]   2> 		at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
   [junit4]   2> 		at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
   [junit4]   2> 		at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
   [junit4]   2> 		at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
   [junit4]   2> 		at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
   [junit4]   2> 		at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
   [junit4]   2> 		at org.eclipse.jetty.server.Server.handle(Server.java:368)
   [junit4]   2> 		at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
   [junit4]   2> 		at org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53)
   [junit4]   2> 		at org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:942)
   [junit4]   2> 		at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:1004)
   [junit4]   2> 		at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:640)
   [junit4]   2> 		at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
   [junit4]   2> 		at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72)
   [junit4]   2> 		at org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264)
   [junit4]   2> 		at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
   [junit4]   2> 		at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
   [junit4]   2> 		at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 	
   [junit4]   2> 28871 T22 C3 oasc.SolrException.log ERROR null:org.eclipse.jetty.io.EofException
   [junit4]   2> 		at org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:142)
   [junit4]   2> 		at org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:107)
   [junit4]   2> 		at org.apache.solr.common.util.FastOutputStream.flush(FastOutputStream.java:214)
   [junit4]   2> 		at org.apache.solr.common.util.FastOutputStream.flushBuffer(FastOutputStream.java:207)
   [junit4]   2> 		at org.apache.solr.common.util.JavaBinCodec.marshal(JavaBinCodec.java:98)
   [junit4]   2> 		at org.apache.solr.response.BinaryResponseWriter.write(BinaryResponseWriter.java:52)
   [junit4]   2> 		at org.apache.solr.servlet.SolrDispatchFilter.writeResponse(SolrDispatchFilter.java:758)
   [junit4]   2> 		at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:426)
   [junit4]   2> 		at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:207)
   [junit4]   2> 		at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
   [junit4]   2> 		at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:137)
   [junit4]   2> 		at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
   [junit4]   2> 		at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
   [junit4]   2> 		at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
   [junit4]   2> 		at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
   [junit4]   2> 		at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
   [junit4]   2> 		at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
   [junit4]   2> 		at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
   [junit4]   2> 		at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
   [junit4]   2> 		at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
   [junit4]   2> 		at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
   [junit4]   2> 		at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
   [junit4]   2> 		at org.eclipse.jetty.server.Server.handle(Server.java:368)
   [junit4]   2> 		at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
   [junit4]   2> 		at org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53)
   [junit4]   2> 		at org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:942)
   [junit4]   2> 		at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:1004)
   [junit4]   2> 		at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:640)
   [junit4]   2> 		at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
   [junit4]   2> 		at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72)
   [junit4]   2> 		at org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264)
   [junit4]   2> 		at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
   [junit4]   2> 		at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
   [junit4]   2> 		at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 	
   [junit4]   2> 28973 T18 C3 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={wt=javabin&sort=_docid_+asc&distrib=false&rows=0&version=2&q=*:*} hits=10 status=0 QTime=143 
   [junit4]   2> 28974 T18 C3 oasc.SolrException.log ERROR null:org.eclipse.jetty.io.EofException
   [junit4]   2> 		at org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:142)
   [junit4]   2> 		at org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:107)
   [junit4]   2> 		at org.apache.solr.common.util.FastOutputStream.flush(FastOutputStream.java:214)
   [junit4]   2> 		at org.apache.solr.common.util.FastOutputStream.flushBuffer(FastOutputStream.java:207)
   [junit4]   2> 		at org.apache.solr.common.util.JavaBinCodec.marshal(JavaBinCodec.java:98)
   [junit4]   2> 		at org.apache.solr.response.BinaryResponseWriter.write(BinaryResponseWriter.java:52)
   [junit4]   2> 		at org.apache.solr.servlet.SolrDispatchFilter.writeResponse(SolrDispatchFilter.java:758)
   [junit4]   2> 		at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:426)
   [junit4]   2> 		at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:207)
   [junit4]   2> 		at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
   [junit4]   2> 		at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:137)
   [junit4]   2> 		at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
   [junit4]   2> 		at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
   [junit4]   2> 		at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
   [junit4]   2> 		at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
   [junit4]   2> 		at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
   [junit4]   2> 		at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
   [junit4]   2> 		at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
   [junit4]   2> 		at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
   [junit4]   2> 		at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
   [junit4]   2> 		at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
   [junit4]   2> 		at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
   [junit4]   2> 		at org.eclipse.jetty.server.Server.handle(Server.java:368)
   [junit4]   2> 		at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
   [junit4]   2> 		at org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53)
   [junit4]   2> 		at org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:942)
   [junit4]   2> 		at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:1004)
   [junit4]   2> 		at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:640)
   [junit4]   2> 		at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
   [junit4]   2> 		at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72)
   [junit4]   2> 		at org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264)
   [junit4]   2> 		at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
   [junit4]   2> 		at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
   [junit4]   2> 		at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 	
   [junit4]   2> 28976 T18 C3 oasc.SolrException.log ERROR null:org.eclipse.jetty.io.EofException
   [junit4]   2> 		at org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:142)
   [junit4]   2> 		at org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:107)
   [junit4]   2> 		at org.apache.solr.common.util.FastOutputStream.flush(FastOutputStream.java:214)
   [junit4]   2> 		at org.apache.solr.common.util.FastOutputStream.flushBuffer(FastOutputStream.java:207)
   [junit4]   2> 		at org.apache.solr.common.util.JavaBinCodec.marshal(JavaBinCodec.java:98)
   [junit4]   2> 		at org.apache.solr.response.BinaryResponseWriter.write(BinaryResponseWriter.java:52)
   [junit4]   2> 		at org.apache.solr.servlet.SolrDispatchFilter.writeResponse(SolrDispatchFilter.java:758)
   [junit4]   2> 		at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:426)
   [junit4]   2> 		at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:207)
   [junit4]   2> 		at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
   [junit4]   2> 		at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:137)
   [junit4]   2> 		at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
   [junit4]   2> 		at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
   [junit4]   2> 		at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
   [junit4]   2> 		at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
   [junit4]   2> 		at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
   [junit4]   2> 		at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
   [junit4]   2> 		at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
   [junit4]   2> 		at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
   [junit4]   2> 		at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
   [junit4]   2> 		at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
   [junit4]   2> 		at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
   [junit4]   2> 		at org.eclipse.jetty.server.Server.handle(Server.java:368)
   [junit4]   2> 		at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
   [junit4]   2> 		at org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53)
   [junit4]   2> 		at org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:942)
   [junit4]   2> 		at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:1004)
   [junit4]   2> 		at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:640)
   [junit4]   2> 		at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
   [junit4]   2> 		at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72)
   [junit4]   2> 		at org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264)
   [junit4]   2> 		at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
   [junit4]   2> 		at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
   [junit4]   2> 		at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 	
   [junit4]   2> 28978 T18 C3 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@28c53639
   [junit4]   2> 28978 T18 C3 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=10,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 28979 T18 C3 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 28979 T18 C3 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 28980 T18 C3 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 28986 T18 C3 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 28987 T18 C3 oasc.CachingDirectoryFactory.close Closing MockFSDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 28987 T18 C3 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-0-001/collection1/data [CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-0-001/collection1/data;done=false>>]
   [junit4]   2> 28988 T18 C3 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-0-001/collection1/data
   [junit4]   2> 28989 T18 C3 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-0-001/collection1/data/index [CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-0-001/collection1/data/index;done=false>>]
   [junit4]   2> 28989 T18 C3 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-0-001/collection1/data/index
   [junit4]   2> 29593 T44 C2 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={wt=javabin&sort=_docid_+asc&distrib=false&rows=0&version=2&q=*:*} hits=10 status=0 QTime=1 
   [junit4]   2> 33864 T11 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=878818280
   [junit4]   2> 33865 T11 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@475478ad
   [junit4]   2> 33866 T11 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=10,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 33867 T11 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 33868 T11 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 33869 T11 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 33876 T11 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 33878 T11 oasc.CachingDirectoryFactory.close Closing MockFSDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 33878 T11 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-2-001/collection1/data [CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-2-001/collection1/data;done=false>>]
   [junit4]   2> 33879 T11 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-2-001/collection1/data
   [junit4]   2> 33881 T11 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-2-001/collection1/data/index [CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-2-001/collection1/data/index;done=false>>]
   [junit4]   2> 33882 T11 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-2-001/collection1/data/index
   [junit4]   2> 33894 T11 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
   [junit4]   2> 38887 T11 oas.SolrTestCaseJ4.tearDown ###Ending testReliability
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestLBHttpSolrServer -Dtests.method=testReliability -Dtests.seed=98ED9618768A98EB -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=pt_PT -Dtests.timezone=EAT -Dtests.file.encoding=US-ASCII
   [junit4] ERROR   34.2s J0 | TestLBHttpSolrServer.testReliability <<<
   [junit4]    > Throwable #1: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([98ED9618768A98EB:59254B5ED7EC4942]:0)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:525)
   [junit4]    > 	at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:91)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:301)
   [junit4]    > 	at org.apache.solr.client.solrj.TestLBHttpSolrServer.testReliability(TestLBHttpSolrServer.java:222)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]    > Caused by: org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:63868/solr
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:558)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:210)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:206)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:478)
   [junit4]    > 	... 44 more
   [junit4]    > Caused by: java.net.SocketTimeoutException: Read timed out
   [junit4]    > 	at java.net.SocketInputStream.socketRead0(Native Method)
   [junit4]    > 	at java.net.SocketInputStream.read(SocketInputStream.java:152)
   [junit4]    > 	at java.net.SocketInputStream.read(SocketInputStream.java:122)
   [junit4]    > 	at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
   [junit4]    > 	at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
   [junit4]    > 	at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
   [junit4]    > 	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
   [junit4]    > 	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
   [junit4]    > 	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:260)
   [junit4]    > 	at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
   [junit4]    > 	at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
   [junit4]    > 	at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
   [junit4]    > 	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:271)
   [junit4]    > 	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:123)
   [junit4]    > 	at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:682)
   [junit4]    > 	at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:486)
   [junit4]    > 	at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:863)
   [junit4]    > 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
   [junit4]    > 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:106)
   [junit4]    > 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:57)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:448)
   [junit4]    > 	... 47 more
   [junit4]   2> 39283 T11 oas.SolrTestCaseJ4.setUp ###Starting testSimple
   [junit4]   2> 39300 T11 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 39303 T11 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:19669
   [junit4]   2> 39305 T11 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 39306 T11 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 39306 T11 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/./temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-0-001
   [junit4]   2> 39307 T11 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/./temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-0-001/'
   [junit4]   2> 39372 T11 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/./temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-0-001/solr.xml
   [junit4]   2> 39532 T11 oasc.CoreContainer.<init> New CoreContainer 842425021
   [junit4]   2> 39532 T11 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/./temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-0-001/]
   [junit4]   2> 39534 T11 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 39534 T11 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 39535 T11 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 39536 T11 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 39536 T11 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 39537 T11 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 39537 T11 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 39538 T11 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 39538 T11 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 39539 T11 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 39540 T11 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 39540 T11 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 39541 T11 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 39548 T60 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/./temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-0-001/collection1/'
   [junit4]   2> 39609 T60 oasc.SolrConfig.<init> Using Lucene MatchVersion: 4.11.0
   [junit4]   2> 39709 T60 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 39710 T60 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 39721 T60 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 39739 T60 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 39741 T60 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from instancedir /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/./temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-0-001/collection1/
   [junit4]   2> 39741 T60 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockFSDirectoryFactory
   [junit4]   2> 39742 T60 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/./temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-0-001/collection1/, dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/./temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-0-001/collection1/data/
   [junit4]   2> 39742 T60 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
   [junit4]   2> 39743 T60 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-0-001/collection1/data
   [junit4]   2> 39744 T60 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/./temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-0-001/collection1/data/index/
   [junit4]   2> 39745 T60 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/./temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-0-001/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 39746 T60 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-0-001/collection1/data/index
   [junit4]   2> 39751 T60 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(SimpleFSDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-0-001/collection1/data/index lockFactory=NativeFSLockFactory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-0-001/collection1/data/index),segFN=segments_1,generation=1}
   [junit4]   2> 39751 T60 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 39753 T60 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 39754 T60 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 39755 T60 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 39755 T60 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 39756 T60 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 39756 T60 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 39757 T60 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
   [junit4]   2> 39757 T60 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
   [junit4]   2> 39757 T60 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
   [junit4]   2> 39758 T60 oasc.RequestHandlers.initHandlersFromConfig WARN Multiple requestHandler registered to the same name: /update ignoring: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 39758 T60 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 39759 T60 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 39773 T60 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 39775 T60 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 39778 T60 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 39780 T60 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 39781 T60 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 39784 T60 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 39784 T60 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 39787 T60 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(SimpleFSDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-0-001/collection1/data/index lockFactory=NativeFSLockFactory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-0-001/collection1/data/index),segFN=segments_1,generation=1}
   [junit4]   2> 39788 T60 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 39788 T60 oass.SolrIndexSearcher.<init> Opening Searcher@16078e37[collection1] main
   [junit4]   2> 39789 T60 oasr.ManagedResourceStorage$FileStorageIO.configure File-based storage initialized to use dir: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/./temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-0-001/collection1/conf
   [junit4]   2> 39789 T60 oasr.RestManager.init Initializing RestManager with initArgs: {storageDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/./temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-0-001/collection1/conf}
   [junit4]   2> 39790 T60 oasr.ManagedResourceStorage.load Reading _rest_managed.json using file:dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/./temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-0-001/collection1/conf
   [junit4]   2> 39791 T60 oasr.ManagedResource.reloadFromStorage WARN No stored data found for /rest/managed
   [junit4]   2> 39792 T60 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using file:dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/./temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-0-001/collection1/conf
   [junit4]   2> 39793 T60 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 39793 T60 oash.ReplicationHandler.inform Commits will be reserved for  10000
   [junit4]   2> 39794 T61 oasc.SolrCore.registerSearcher [col

[...truncated too long message...]

er-98ED9618768A98EB-001/instance-0-001/collection1/conf}
   [junit4]   2> 76738 T146 oasr.ManagedResourceStorage.load Reading _rest_managed.json using file:dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/./temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-0-001/collection1/conf
   [junit4]   2> 76739 T146 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using file:dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/./temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-0-001/collection1/conf
   [junit4]   2> 76740 T146 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed
   [junit4]   2> 76740 T146 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 76741 T146 oash.ReplicationHandler.inform Commits will be reserved for  10000
   [junit4]   2> 76741 T147 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@39c9e47[collection1] main{StandardDirectoryReader(segments_2:3:nrt _0(4.11.0):c10)}
   [junit4]   2> 76741 T146 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 76743 T11 oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0
   [junit4]   2> 76743 T11 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> ASYNC  NEW_CORE C16 name=collection1 org.apache.solr.core.SolrCore@5167e622
   [junit4]   2> 76913 T139 C16 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={wt=javabin&sort=_docid_+asc&distrib=false&rows=0&version=2&q=*:*} hits=10 status=0 QTime=1 
   [junit4]   2> 77948 T139 C16 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={wt=javabin&version=2&q=*:*} hits=10 status=0 QTime=1 
   [junit4]   2> 77951 T11 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1056157384
   [junit4]   2> 77952 T11 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@5167e622
   [junit4]   2> 77952 T11 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 77953 T11 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 77953 T11 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 77953 T11 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 77956 T11 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 77957 T11 oasc.CachingDirectoryFactory.close Closing MockFSDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 77957 T11 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-0-001/collection1/data [CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-0-001/collection1/data;done=false>>]
   [junit4]   2> 77958 T11 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-0-001/collection1/data
   [junit4]   2> 77958 T11 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-0-001/collection1/data/index [CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-0-001/collection1/data/index;done=false>>]
   [junit4]   2> 77959 T11 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-0-001/collection1/data/index
   [junit4]   2> 77966 T11 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
   [junit4]   2> 82989 T11 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=524167614
   [junit4]   2> 82990 T11 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@4c47e0e
   [junit4]   2> 82991 T11 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=10,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 82992 T11 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 82993 T11 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 82993 T11 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 82999 T11 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 83000 T11 oasc.CachingDirectoryFactory.close Closing MockFSDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 83000 T11 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-2-001/collection1/data [CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-2-001/collection1/data;done=false>>]
   [junit4]   2> 83001 T11 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-2-001/collection1/data
   [junit4]   2> 83002 T11 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-2-001/collection1/data/index [CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-2-001/collection1/data/index;done=false>>]
   [junit4]   2> 83003 T11 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001/instance-2-001/collection1/data/index
   [junit4]   2> 83014 T11 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
   [junit4]   2> 88002 T11 oas.SolrTestCaseJ4.tearDown ###Ending testTwoServers
   [junit4]   2> 88008 T11 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-solrj/test/J0/./temp/solr.client.solrj.TestLBHttpSolrServer-98ED9618768A98EB-001
   [junit4]   2> NOTE: test params are: codec=Lucene42, sim=DefaultSimilarity, locale=pt_PT, timezone=EAT
   [junit4]   2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_65 (64-bit)/cpus=16,threads=4,free=113483192,total=243269632
   [junit4]   2> NOTE: All tests run in this JVM: [TestLBHttpSolrServer]
   [junit4] Completed on J0 in 88.86s, 3 tests, 1 error <<< FAILURES!

[...truncated 102 lines...]
BUILD FAILED
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:491: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:471: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:60: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/extra-targets.xml:39: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build.xml:202: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/common-build.xml:494: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:1337: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:952: There were test failures: 52 suites, 302 tests, 1 error

Total time: 68 minutes 14 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Sending artifact delta relative to Lucene-Solr-Tests-4.x-Java7 #2080
Archived 5 artifacts
Archive block size is 32768
Received 0 blocks and 9839702 bytes
Compression is 0.0%
Took 2.8 sec
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure